Showing 1–50 of 215 results for author: Noh, H

Detecting Gait Abnormalities in Foot-Floor Contacts During Walking Through FootstepInduced Structural Vibrations

Authors: Yiwen Dong, Yuyan Wu, Hae Young Noh

Abstract: Gait abnormality detection is critical for the early discovery and progressive tracking of musculoskeletal and neurological disorders, such as Parkinson's and Cerebral Palsy. Especially, analyzing the foot-floor contacts during walking provides important insights into gait patterns, such as contact area, contact force, and contact time, enabling gait abnormality detection through these measurement… ▽ More Gait abnormality detection is critical for the early discovery and progressive tracking of musculoskeletal and neurological disorders, such as Parkinson's and Cerebral Palsy. Especially, analyzing the foot-floor contacts during walking provides important insights into gait patterns, such as contact area, contact force, and contact time, enabling gait abnormality detection through these measurements. Existing studies use various sensing devices to capture such information, including cameras, wearables, and force plates. However, the former two lack force-related information, making it difficult to identify the causes of gait health issues, while the latter has limited coverage of the walking path. In this study, we leverage footstep-induced structural vibrations to infer foot-floor contact profiles and detect gait abnormalities. The main challenge lies in modeling the complex force transfer mechanism between the foot and the floor surfaces, leading to difficulty in reconstructing the force and contact profile during foot-floor interaction using structural vibrations. To overcome the challenge, we first characterize the floor vibration for each contact type (e.g., heel, midfoot, and toe contact) to understand how contact forces and areas affect the induced floor vibration. Then, we leverage the time-frequency response spectrum resulting from those contacts to develop features that are representative of each contact type. Finally, gait abnormalities are detected by comparing the predicted foot-floor contact force and motion with the healthy gait. To evaluate our approach, we conducted a real-world walking experiment with 8 subjects. Our approach achieves 91.6% and 96.7% accuracy in predicting contact type and time, respectively, leading to 91.9% accuracy in detecting various types of gait abnormalities, including asymmetry, dragging, and midfoot/toe contacts. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: The 14th International Workshop on Structural Health Monitoring (IWSHM)

Graviton-photon conversions in Euler-Heisenberg nonlinear electrodynamics

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: We study graviton-photon conversions in an environment of the uniform and constant magnetic field considering Euler-Köckel-Heisenberg-type nonlinear corrections in electrodynamics. We take the transverse-tracefree gauge for gravitons and employ both the field potential and the electric and magnetic (EM) fields for photons. The nonlinear correction causes parity violating (chiral) graviton propagat… ▽ More We study graviton-photon conversions in an environment of the uniform and constant magnetic field considering Euler-Köckel-Heisenberg-type nonlinear corrections in electrodynamics. We take the transverse-tracefree gauge for gravitons and employ both the field potential and the electric and magnetic (EM) fields for photons. The nonlinear correction causes parity violating (chiral) graviton propagation equations, which depend on the two treatments for photons. Thus, the medium becomes effectively birefringent for two polarizations of gravitational waves similar to the photon birefringence a characteristic of the nonlinear correction. In the presence of gravity, due to the nontrivial relation between the potential and EM fields, it is important to present the result using the EM fields. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Comments: 8 pages, no figure

Joint Optimization on Uplink OFDMA and MU-MIMO for IEEE 802.11ax: Deep Hierarchical Reinforcement Learning Approach

Authors: Hyeonho Noh, Harim Lee, Hyun Jong Yang

Abstract: This letter tackles a joint user scheduling, frequency resource allocation (USRA), multi-input-multi-output mode selection (MIMO MS) between single-user MIMO and multi-user (MU) MIMO, and MU-MIMO user selection problem, integrating uplink orthogonal frequency division multiple access (OFDMA) in IEEE 802.11ax. Specifically, we focus on \textit{unsaturated traffic conditions} where users' data deman… ▽ More This letter tackles a joint user scheduling, frequency resource allocation (USRA), multi-input-multi-output mode selection (MIMO MS) between single-user MIMO and multi-user (MU) MIMO, and MU-MIMO user selection problem, integrating uplink orthogonal frequency division multiple access (OFDMA) in IEEE 802.11ax. Specifically, we focus on \textit{unsaturated traffic conditions} where users' data demands fluctuate. In unsaturated traffic conditions, considering packet volumes per user introduces a combinatorial problem, requiring the simultaneous optimization of MU-MIMO user selection and RA along the time-frequency-space axis. Consequently, dealing with the combinatorial nature of this problem, characterized by a large cardinality of unknown variables, poses a challenge that conventional optimization methods find nearly impossible to address. In response, this letter proposes an approach with deep hierarchical reinforcement learning (DHRL) to solve the joint problem. Rather than simply adopting off-the-shelf DHRL, we \textit{tailor} the DHRL to the joint USRA and MS problem, thereby significantly improving the convergence speed and throughput. Extensive simulation results show that the proposed algorithm achieves significantly improved throughput compared to the existing schemes under various unsaturated traffic conditions. △ Less

Submitted 15 April, 2024; v1 submitted 3 April, 2024; originally announced April 2024.

HyperCLOVA X Technical Report

Authors: Kang Min Yoo, Jaegeun Han, Sookyo In, Heewon Jeon, Jisu Jeong, Jaewook Kang, Hyunwook Kim, Kyung-Min Kim, Munhyong Kim, Sungju Kim, Donghyun Kwak, Hanock Kwak, Se Jung Kwon, Bado Lee, Dongsoo Lee, Gichang Lee, Jooho Lee, Baeseong Park, Seongjin Shin, Joonsang Yu, Seolki Baek, Sumin Byeon, Eungsup Cho, Dooseok Choe, Jeesung Han , et al. (371 additional authors not shown)

Abstract: We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean, English, and code data, followed by instruction-tuning with high-quality human-annotated datasets while abiding by strict safety guidelines reflecting our commitment t… ▽ More We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean, English, and code data, followed by instruction-tuning with high-quality human-annotated datasets while abiding by strict safety guidelines reflecting our commitment to responsible AI. The model is evaluated across various benchmarks, including comprehensive reasoning, knowledge, commonsense, factuality, coding, math, chatting, instruction-following, and harmlessness, in both Korean and English. HyperCLOVA X exhibits strong reasoning capabilities in Korean backed by a deep understanding of the language and cultural nuances. Further analysis of the inherent bilingual nature and its extension to multilingualism highlights the model's cross-lingual proficiency and strong generalization ability to untargeted languages, including machine translation between several language pairs and cross-lingual inference tasks. We believe that HyperCLOVA X can provide helpful guidance for regions or countries in developing their sovereign LLMs. △ Less

Submitted 13 April, 2024; v1 submitted 2 April, 2024; originally announced April 2024.

Comments: 44 pages; updated authors list and fixed author names

Align-to-Distill: Trainable Attention Alignment for Knowledge Distillation in Neural Machine Translation

Authors: Heegon Jin, Seonil Son, Jemin Park, Youngseok Kim, Hyungjong Noh, Yeonsoo Lee

Abstract: The advent of scalable deep models and large datasets has improved the performance of Neural Machine Translation. Knowledge Distillation (KD) enhances efficiency by transferring knowledge from a teacher model to a more compact student model. However, KD approaches to Transformer architecture often rely on heuristics, particularly when deciding which teacher layers to distill from. In this paper, w… ▽ More The advent of scalable deep models and large datasets has improved the performance of Neural Machine Translation. Knowledge Distillation (KD) enhances efficiency by transferring knowledge from a teacher model to a more compact student model. However, KD approaches to Transformer architecture often rely on heuristics, particularly when deciding which teacher layers to distill from. In this paper, we introduce the 'Align-to-Distill' (A2D) strategy, designed to address the feature mapping problem by adaptively aligning student attention heads with their teacher counterparts during training. The Attention Alignment Module in A2D performs a dense head-by-head comparison between student and teacher attention heads across layers, turning the combinatorial mapping heuristics into a learning problem. Our experiments show the efficacy of A2D, demonstrating gains of up to +3.61 and +0.63 BLEU points for WMT-2022 De->Dsb and WMT-2014 En->De, respectively, compared to Transformer baselines. △ Less

Submitted 25 March, 2024; v1 submitted 3 March, 2024; originally announced March 2024.

Comments: Accepted to LREC-COLING 2024

MSC Class: 68T50 ACM Class: I.2.7

On gravity as a medium property in Maxwell equations

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: The effect of gravity in Maxwell's equations is often treated as a medium property. The commonly used formulation is based on managing Maxwell's equations in exactly the same form as in Minkowski spacetime and expressing the effect of gravity as a set of constitutive relations. We show that such a set of Maxwell's equations is, in fact, a combination of the electric and magnetic fields defined in… ▽ More The effect of gravity in Maxwell's equations is often treated as a medium property. The commonly used formulation is based on managing Maxwell's equations in exactly the same form as in Minkowski spacetime and expressing the effect of gravity as a set of constitutive relations. We show that such a set of Maxwell's equations is, in fact, a combination of the electric and magnetic fields defined in two different non-covariant ways, both of which fail to identify the associated observer's four-vectors. The suggested constitutive relations are also ad hoc and unjustified. To an observer with a proper four-vector, the effect of gravity can be arranged as effective polarizations and magnetizations appearing in both the homogeneous and inhomogeneous parts. Modifying the homogeneous part by gravity is inevitable to any observer, and the result cannot be interpreted as the medium property. For optical properties one should directly handle Maxwell's equations in curved spacetime. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Comments: 8 pages, no figure, to appear in Gen. Rel. Grav. arXiv admin note: text overlap with arXiv:2307.14555

Stoichiometry Representation Learning with Polymorphic Crystal Structures

Authors: Namkyeong Lee, Heewoong Noh, Gyoung S. Na, Tianfan Fu, Jimeng Sun, Chanyoung Park

Abstract: Despite the recent success of machine learning (ML) in materials science, its success heavily relies on the structural description of crystal, which is itself computationally demanding and occasionally unattainable. Stoichiometry descriptors can be an alternative approach, which reveals the ratio between elements involved to form a certain compound without any structural information. However, it i… ▽ More Despite the recent success of machine learning (ML) in materials science, its success heavily relies on the structural description of crystal, which is itself computationally demanding and occasionally unattainable. Stoichiometry descriptors can be an alternative approach, which reveals the ratio between elements involved to form a certain compound without any structural information. However, it is not trivial to learn the representations of stoichiometry due to the nature of materials science called polymorphism, i.e., a single stoichiometry can exist in multiple structural forms due to the flexibility of atomic arrangements, inducing uncertainties in representation. To this end, we propose PolySRL, which learns the probabilistic representation of stoichiometry by utilizing the readily available structural information, whose uncertainty reveals the polymorphic structures of stoichiometry. Extensive experiments on sixteen datasets demonstrate the superiority of PolySRL, and analysis of uncertainties shed light on the applicability of PolySRL in real-world material discovery. The source code for PolySRL is available at https://github.com/Namkyeong/PolySRL_AI4Science. △ Less

Submitted 17 November, 2023; originally announced December 2023.

Comments: NeurIPS 2023 AI4Science Workshop

Density of States Prediction of Crystalline Materials via Prompt-guided Multi-Modal Transformer

Authors: Namkyeong Lee, Heewoong Noh, Sungwon Kim, Dongmin Hyun, Gyoung S. Na, Chanyoung Park

Abstract: The density of states (DOS) is a spectral property of crystalline materials, which provides fundamental insights into various characteristics of the materials. While previous works mainly focus on obtaining high-quality representations of crystalline materials for DOS prediction, we focus on predicting the DOS from the obtained representations by reflecting the nature of DOS: DOS determines the ge… ▽ More The density of states (DOS) is a spectral property of crystalline materials, which provides fundamental insights into various characteristics of the materials. While previous works mainly focus on obtaining high-quality representations of crystalline materials for DOS prediction, we focus on predicting the DOS from the obtained representations by reflecting the nature of DOS: DOS determines the general distribution of states as a function of energy. That is, DOS is not solely determined by the crystalline material but also by the energy levels, which has been neglected in previous works. In this paper, we propose to integrate heterogeneous information obtained from the crystalline materials and the energies via a multi-modal transformer, thereby modeling the complex relationships between the atoms in the crystalline materials and various energy levels for DOS prediction. Moreover, we propose to utilize prompts to guide the model to learn the crystal structural system-specific interactions between crystalline materials and energies. Extensive experiments on two types of DOS, i.e., Phonon DOS and Electron DOS, with various real-world scenarios demonstrate the superiority of DOSTransformer. The source code for DOSTransformer is available at https://github.com/HeewoongNoh/DOSTransformer. △ Less

Submitted 22 November, 2023; v1 submitted 24 October, 2023; originally announced November 2023.

Comments: NeurIPS 2023. arXiv admin note: text overlap with arXiv:2303.07000

Magnetic functionalization and Catalytic behavior of magnetic nanoparticles during laser photochemical graphitization of polyimide

Authors: Abhishek Sarkar, Ho-won Noh, Ikenna Nlebedim, Prana Shrotriya

Abstract: We report laser-assisted photochemical graphitization of polyimides (PI) into functional magnetic nanocomposites using laser irradiation of PI in the presence of magnetite nanoparticles (MNP). PI Kapton sheets covered with MNP were photochemically treated under ambient conditions using a picosecond pulsed laser (1064nm) to obtain an electrically conductive material. Scanning electron microscopy of… ▽ More We report laser-assisted photochemical graphitization of polyimides (PI) into functional magnetic nanocomposites using laser irradiation of PI in the presence of magnetite nanoparticles (MNP). PI Kapton sheets covered with MNP were photochemically treated under ambient conditions using a picosecond pulsed laser (1064nm) to obtain an electrically conductive material. Scanning electron microscopy of the treated material revealed layered magnetic nanoparticles/graphite nanocomposite structure (MNP/graphite). Four probe conductivity measurements indicated that nanocomposite has an electrical conductivity of 1550 S/m. Superconducting quantum interference device (SQUID) magnetometer-based magnetic characterization of the treated material revealed an anisotropic ferromagnetic response in the MNP/graphite nanocomposite compared to the isotropic response of MNP. Raman spectroscopy of MNP/graphite nanocomposite revealed a four-fold improvement in graphitization, suppression in disorder, and decreased nitrogenous impurities compared to the graphitic material obtained from laser treatment of just PI sheets. X-ray photoelectron spectroscopy, x-ray diffraction, and energy-dispersive x-ray spectroscopy were used to delineate the phase transformations of MNP during the formation of MNP/graphite nanocomposite. Post-mortem characterization indicates a possible photocatalytic effect of MNP during MNP/graphite nanocomposite formation. Under laser irradiation, MNP transformed from the initial Fe3O4 phase to γ-Fe2O3 and Fe5C2 phases and acted as nucleation spots to catalyze the graphitization process of PI. △ Less

Submitted 7 November, 2023; originally announced November 2023.

Pulsar Timing Array Signature from Oscillating Metric Perturbations due to Ultra-light Axion

Authors: Jai-chan Hwang, Donghui Jeong, Hyerim Noh, Clemente Smarra

Abstract: A coherently oscillating ultra-light axion can behave as dark matter. In particular, its coherently oscillating pressure perturbations can source an oscillating scalar metric perturbation, with a characteristic oscillation frequency which is twice the axion Compton frequency. A candidate in the mass range $10^{(-24,-21)}{\rm eV}$ can provide a signal in the frequency range tested by current and fu… ▽ More A coherently oscillating ultra-light axion can behave as dark matter. In particular, its coherently oscillating pressure perturbations can source an oscillating scalar metric perturbation, with a characteristic oscillation frequency which is twice the axion Compton frequency. A candidate in the mass range $10^{(-24,-21)}{\rm eV}$ can provide a signal in the frequency range tested by current and future Pulsar Timing Array (PTA) programs. Involving the pressure perturbations in a highly nonlinear environment, such an analysis demands a relativistic and nonlinear treatment. Here, we provide a rigorous derivation of the effect assuming weak gravity and slow-motion limit of Einstein's gravity in zero-shear gauge and show that dark matter's velocity potential determines the oscillation phase and frequency change. A monochromatic PTA signal correlated with the velocity field would confirm the prediction, for example, by cross-correlating the PTA results with the future local velocity flow measurements. △ Less

Submitted 31 October, 2023; originally announced November 2023.

Comments: 8 pages, no figure

Normalizing flow-based deep variational Bayesian network for seismic multi-hazards and impacts estimation from InSAR imagery

Authors: Xuechun Li, Paula M. Burgi, Wei Ma, Hae Young Noh, David J. Wald, Susu Xu

Abstract: Onsite disasters like earthquakes can trigger cascading hazards and impacts, such as landslides and infrastructure damage, leading to catastrophic losses; thus, rapid and accurate estimates are crucial for timely and effective post-disaster responses. Interferometric Synthetic aperture radar (InSAR) data is important in providing high-resolution onsite information for rapid hazard estimation. Most… ▽ More Onsite disasters like earthquakes can trigger cascading hazards and impacts, such as landslides and infrastructure damage, leading to catastrophic losses; thus, rapid and accurate estimates are crucial for timely and effective post-disaster responses. Interferometric Synthetic aperture radar (InSAR) data is important in providing high-resolution onsite information for rapid hazard estimation. Most recent methods using InSAR imagery signals predict a single type of hazard and thus often suffer low accuracy due to noisy and complex signals induced by co-located hazards, impacts, and irrelevant environmental changes (e.g., vegetation changes, human activities). We introduce a novel stochastic variational inference with normalizing flows derived to jointly approximate posteriors of multiple unobserved hazards and impacts from noisy InSAR imagery. △ Less

Submitted 20 March, 2024; v1 submitted 20 October, 2023; originally announced October 2023.

Comments: This paper needs to be reviewed by the USGS

Modulation Transfer Spectroscopy of the D1 Transition of Potassium: Theory and Experiment

Authors: Andrew D. Innes, Prosenjit Majumder, Heung-Ryoul Noh, Simon. L. Cornish

Abstract: We report on a study of modulation transfer spectroscopy of the $4\textrm{S}_{1/2}\rightarrow 4\textrm{P}_{1/2}$ ($D_{1}$) transition of naturally abundant potassium in a room-temperature vapour cell. This transition is critical for laser cooling and optical pumping of potassium and our study is therefore motivated by the need for robust laser frequency stabilisation. Despite the absence of a clos… ▽ More We report on a study of modulation transfer spectroscopy of the $4\textrm{S}_{1/2}\rightarrow 4\textrm{P}_{1/2}$ ($D_{1}$) transition of naturally abundant potassium in a room-temperature vapour cell. This transition is critical for laser cooling and optical pumping of potassium and our study is therefore motivated by the need for robust laser frequency stabilisation. Despite the absence of a closed transition, the small ground-state hyperfine splitting in potassium results in strong crossover features in the $D_{1}$ modulation transfer spectrum. To emphasise this we compare the $D_{1}$ and $D_{2}$ spectra of potassium with those of rubidium. Further, we compare our experimental results with a detailed theoretical simulation, examining different pump-probe polarization configurations to identify the optimal signals for laser frequency stabilisation. We find good agreement between the experiment and the theory, especially for the $\textrm{lin} \parallel \textrm{lin}$ polarization configuration. △ Less

Submitted 17 October, 2023; v1 submitted 17 October, 2023; originally announced October 2023.

On graviton-photon conversions in magnetic environments

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: Graviton-photon conversions in a given external electric or magnetic field, known as the Gertsenshtein mechanism, are usually treated using the four-potential for photons. In terms of the electric and magnetic (EM) fields, however, proper identification of the fields in curved spacetime is important. By misidentifying the fields in Minkowski form, as is often practiced in the literature, we show t… ▽ More Graviton-photon conversions in a given external electric or magnetic field, known as the Gertsenshtein mechanism, are usually treated using the four-potential for photons. In terms of the electric and magnetic (EM) fields, however, proper identification of the fields in curved spacetime is important. By misidentifying the fields in Minkowski form, as is often practiced in the literature, we show that the final equation for photon conversion is correct in transverse-tracefree gauge only for planar gravitational waves in a uniform and constant external field. Even in the former method, to recover the EM fields from the four-potential in curved spacetime, one should properly take into account the metric involved in the relation. By including the metric perturbation in the graviton conversion equation, we show that a magnetic environment can cause tachyonic instability term in gravitational wave equation. △ Less

Submitted 21 January, 2024; v1 submitted 6 October, 2023; originally announced October 2023.

Comments: 8 pages, no figure, to appear in Phys. Dark. Univ

Gravitational quantum optical interferometry for experimental validation of geometric phase induced by spacetime curvature

Authors: Hansol Noh, Paul M. Alsing, Warner A. Miller, Doyeol Ahn

Abstract: The fundamental theories of general relativity and quantum mechanics are incompatible, presenting a significant theoretical challenge. General relativity offers an effective description of gravity and large-scale dynamics, while quantum mechanics describes phenomena for atomic- to Planck-scale. The Wigner rotation angle (WRA) of a photon induced by gravity, where relativistic effects become observ… ▽ More The fundamental theories of general relativity and quantum mechanics are incompatible, presenting a significant theoretical challenge. General relativity offers an effective description of gravity and large-scale dynamics, while quantum mechanics describes phenomena for atomic- to Planck-scale. The Wigner rotation angle (WRA) of a photon induced by gravity, where relativistic effects become observable in its quantum spin state, is a significant point of interest as a promising candidate for direct observation near Earth by considering its small but measurable order. In this paper, we reveal that the momentum-dependent WRA displays a non-reciprocal characteristic. This distinct behavior leads to a measurable relative WRA difference between two paths of an interferometer within the Earth's gravitational field, while the WRA of a photon has conventionally been viewed as having a trivial value on a closed loop. Building on this finding, we propose an experiment that can be used to test the theoretical framework of the WRA induced in curved spacetime through the use of the Hong-Ou-Mandel (HOM) quantum interference effect for photons in near-Earth orbits. We show that in our proposed experiment the coincident photon counting rate depends on the difference of the momentum-dependent WRA in the two arms of an interferometer. △ Less

Submitted 21 September, 2023; originally announced September 2023.

Comments: 21 pages, 3 figures for main text

Structural Investigation of BaIrO$_3$ by Neutron Diffraction

Authors: Bin Chang, Jinwon Jeong, Han-Jin Noh, Seongsu Lee

Abstract: We report a temperature-dependent neutron diffraction (ND) study on polycrystalline monoclinic BaIrO$_3$ which is famous for charge density wave (CDW) and weak ferromagnetic phase transitions at T$_C$$\sim$180 K simultaneously. A Rietveld analysis on the ND patterns reveals that even though there is no symmetry breaking in crystal structure, a noticeable change in the four kinds of IrO$_{6}$ octah… ▽ More We report a temperature-dependent neutron diffraction (ND) study on polycrystalline monoclinic BaIrO$_3$ which is famous for charge density wave (CDW) and weak ferromagnetic phase transitions at T$_C$$\sim$180 K simultaneously. A Rietveld analysis on the ND patterns reveals that even though there is no symmetry breaking in crystal structure, a noticeable change in the four kinds of IrO$_{6}$ octahedra is isolated as the temperature approaches to T$_C$. Based on the structure analysis results, we calculated the $d$-orbital energy level splittings by crystal electric field for each type of the IrO$_6$ octahedra. By taking into account the strong spin-orbit coupling in Ir 5$d$ orbitals and the lattice distortions obtained from the ND analysis, we propose an electronic configuration model to understand the phase transition of the system, where an effective $J_{\rm eff, 1/2}$ Mott insulating phase and a charge gap phase induced by bonding states between the $J_{\rm eff,1/2}$ states compete each other. △ Less

Submitted 15 August, 2023; originally announced August 2023.

Comments: To appear in Journal of the Korean Physical Society

Maxwell equations in curved spacetime

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: In curved spacetime, Maxwell's equations can be expressed in forms valid in Minkowski background, with the effect of the metric (gravity) appearing as effective polarizations and magnetizations. The electric and magnetic (EM) fields depend on the observer's frame four-vector. We derive Maxwell's equations valid in general curved spacetime using the fields defined in the normal frame, the coordinat… ▽ More In curved spacetime, Maxwell's equations can be expressed in forms valid in Minkowski background, with the effect of the metric (gravity) appearing as effective polarizations and magnetizations. The electric and magnetic (EM) fields depend on the observer's frame four-vector. We derive Maxwell's equations valid in general curved spacetime using the fields defined in the normal frame, the coordinate frame, and two other non-covariant methods used in the literature. By analyzing the case in the generic frame we show that the EM fields, as well as the charge and current densities, defined in non-covariant ways do not correspond to physical ones measured by an observer. We show that modification of the homogeneous part is inevitable to any observer, and such a modification is difficult to interpret as the effective medium property. The normal frame is the relevant one to use as it gives the EM fields measured by an Eulerian observer. △ Less

Submitted 21 December, 2023; v1 submitted 26 July, 2023; originally announced July 2023.

Comments: 12 pages, no figure, published in Eur. Phys. J. C

1st Place Solution to MultiEarth 2023 Challenge on Multimodal SAR-to-EO Image Translation

Authors: Jingi Ju, Hyeoncheol Noh, Minwoo Kim, Dong-Geol Choi

Abstract: The Multimodal Learning for Earth and Environment Workshop (MultiEarth 2023) aims to harness the substantial amount of remote sensing data gathered over extensive periods for the monitoring and analysis of Earth's ecosystems'health. The subtask, Multimodal SAR-to-EO Image Translation, involves the use of robust SAR data, even under adverse weather and lighting conditions, transforming it into high… ▽ More The Multimodal Learning for Earth and Environment Workshop (MultiEarth 2023) aims to harness the substantial amount of remote sensing data gathered over extensive periods for the monitoring and analysis of Earth's ecosystems'health. The subtask, Multimodal SAR-to-EO Image Translation, involves the use of robust SAR data, even under adverse weather and lighting conditions, transforming it into high-quality, clear, and visually appealing EO data. In the context of the SAR2EO task, the presence of clouds or obstructions in EO data can potentially pose a challenge. To address this issue, we propose the Clean Collector Algorithm (CCA), designed to take full advantage of this cloudless SAR data and eliminate factors that may hinder the data learning process. Subsequently, we applied pix2pixHD for the SAR-to-EO translation and Restormer for image enhancement. In the final evaluation, the team 'CDRL' achieved an MAE of 0.07313, securing the top rank on the leaderboard. △ Less

Submitted 21 June, 2023; originally announced June 2023.

TelecomTM: A Fine-Grained and Ubiquitous Traffic Monitoring System Using Pre-Existing Telecommunication Fiber-Optic Cables as Sensors

Authors: Jingxiao Liu, Siyuan Yuan, Yiwen Dong, Biondo Biondi, Hae Young Noh

Abstract: We introduce the TelecomTM system that uses pre-existing telecommunication fiber-optic cables as virtual strain sensors to sense vehicle-induced ground vibrations for fine-grained and ubiquitous traffic monitoring and characterization. Here we call it a virtual sensor because it is a software-based representation of a physical sensor. Due to the extensively installed telecommunication fiber-optic… ▽ More We introduce the TelecomTM system that uses pre-existing telecommunication fiber-optic cables as virtual strain sensors to sense vehicle-induced ground vibrations for fine-grained and ubiquitous traffic monitoring and characterization. Here we call it a virtual sensor because it is a software-based representation of a physical sensor. Due to the extensively installed telecommunication fiber-optic cables at the roadside, our system using redundant dark fibers enables to monitor traffic at low cost with low maintenance. Many existing traffic monitoring approaches use cameras, piezoelectric sensors, and smartphones, but they are limited due to privacy concerns and/or deployment requirements. Previous studies attempted to use telecommunication cables for traffic monitoring, but they were only exploratory and limited to simple tasks at a coarse granularity, e.g., vehicle detection, due to their hardware constraints and real-world challenges. In particular, those challenges are 1) unknown and heterogeneous properties of virtual sensors and 2) large and complex noise conditions. To this end, our TelecomTM system first characterizes the geographic location and analyzes the signal pattern of each virtual sensor through driving tests. We then develop a spatial-domain Bayesian filtering and smoothing algorithm to detect, track, and characterize each vehicle. Our approach uses the spatial dependency of multiple virtual sensors and Newton's laws of motion to combine the distributed sensor data to reduce uncertainties in vehicle detection and tracking. In our real-world evaluation on a two-way traffic road with 1120 virtual sensors, TelecomTM achieved 90.18% vehicle detection accuracy, 27$\times$ and 5$\times$ error reduction for vehicle position and speed tracking compared to a baseline method, and $\pm$3.92% and $\pm$11.98% percent error for vehicle wheelbase and weight estimation, respectively. △ Less

Submitted 4 May, 2023; originally announced May 2023.

Understand Data Preprocessing for Effective End-to-End Training of Deep Neural Networks

Authors: Ping Gong, Yuxin Ma, Cheng Li, Xiaosong Ma, Sam H. Noh

Abstract: In this paper, we primarily focus on understanding the data preprocessing pipeline for DNN Training in the public cloud. First, we run experiments to test the performance implications of the two major data preprocessing methods using either raw data or record files. The preliminary results show that data preprocessing is a clear bottleneck, even with the most efficient software and hardware config… ▽ More In this paper, we primarily focus on understanding the data preprocessing pipeline for DNN Training in the public cloud. First, we run experiments to test the performance implications of the two major data preprocessing methods using either raw data or record files. The preliminary results show that data preprocessing is a clear bottleneck, even with the most efficient software and hardware configuration enabled by NVIDIA DALI, a high-optimized data preprocessing library. Second, we identify the potential causes, exercise a variety of optimization methods, and present their pros and cons. We hope this work will shed light on the new co-design of ``data storage, loading pipeline'' and ``training framework'' and flexible resource configurations between them so that the resources can be fully exploited and performance can be maximized. △ Less

Submitted 18 April, 2023; originally announced April 2023.

CAFS: Class Adaptive Framework for Semi-Supervised Semantic Segmentation

Authors: Jingi Ju, Hyeoncheol Noh, Yooseung Wang, Minseok Seo, Dong-Geol Choi

Abstract: Semi-supervised semantic segmentation learns a model for classifying pixels into specific classes using a few labeled samples and numerous unlabeled images. The recent leading approach is consistency regularization by selftraining with pseudo-labeling pixels having high confidences for unlabeled images. However, using only highconfidence pixels for self-training may result in losing much of the in… ▽ More Semi-supervised semantic segmentation learns a model for classifying pixels into specific classes using a few labeled samples and numerous unlabeled images. The recent leading approach is consistency regularization by selftraining with pseudo-labeling pixels having high confidences for unlabeled images. However, using only highconfidence pixels for self-training may result in losing much of the information in the unlabeled datasets due to poor confidence calibration of modern deep learning networks. In this paper, we propose a class-adaptive semisupervision framework for semi-supervised semantic segmentation (CAFS) to cope with the loss of most information that occurs in existing high-confidence-based pseudolabeling methods. Unlike existing semi-supervised semantic segmentation frameworks, CAFS constructs a validation set on a labeled dataset, to leverage the calibration performance for each class. On this basis, we propose a calibration aware class-wise adaptive thresholding and classwise adaptive oversampling using the analysis results from the validation set. Our proposed CAFS achieves state-ofthe-art performance on the full data partition of the base PASCAL VOC 2012 dataset and on the 1/4 data partition of the Cityscapes dataset with significant margins of 83.0% and 80.4%, respectively. The code is available at https://github.com/cjf8899/CAFS. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Comments: 13 pages, 9 figures

GPT-4 Technical Report

Authors: OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, Irwan Bello, Jake Berdine, Gabriel Bernadett-Shapiro, Christopher Berner, Lenny Bogdonoff, Oleg Boiko , et al. (256 additional authors not shown)

Abstract: We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based mo… ▽ More We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4. △ Less

Submitted 4 March, 2024; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: 100 pages; updated authors list; fixed author names and added citation

Definition of electric and magnetic fields in curved spacetime

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: Defining the electric and magnetic field vectors in curved spacetime requires a proper choice of the observer's frame four-vector. Related literature shows that this fundamental issue in physics still needs to be properly resolved. In recent literature on using electromagnetic means to detect gravitational waves, an ad hoc definition based on regarding $F_{ab}$ with two covariant indices as the sp… ▽ More Defining the electric and magnetic field vectors in curved spacetime requires a proper choice of the observer's frame four-vector. Related literature shows that this fundamental issue in physics still needs to be properly resolved. In recent literature on using electromagnetic means to detect gravitational waves, an ad hoc definition based on regarding $F_{ab}$ with two covariant indices as the special relativistic one is popular. We show that by assigning physical fields to tensor components in that way, one cannot identify the frame four-vector allowing such a choice, thus failing to properly define the external charge and current densities in that frame. We propose the normal frame as the proper one. In this frame, the weak gravity corrections appear as the effective polarizations and magnetizations in both the homogeneous and inhomogeneous parts of Maxwell equations. △ Less

Submitted 6 May, 2023; v1 submitted 13 March, 2023; originally announced March 2023.

Comments: 6 pages, no figure, published version in Annals of Physics

Predicting Density of States via Multi-modal Transformer

Authors: Namkyeong Lee, Heewoong Noh, Sungwon Kim, Dongmin Hyun, Gyoung S. Na, Chanyoung Park

Abstract: The density of states (DOS) is a spectral property of materials, which provides fundamental insights on various characteristics of materials. In this paper, we propose a model to predict the DOS by reflecting the nature of DOS: DOS determines the general distribution of states as a function of energy. Specifically, we integrate the heterogeneous information obtained from the crystal structure and… ▽ More The density of states (DOS) is a spectral property of materials, which provides fundamental insights on various characteristics of materials. In this paper, we propose a model to predict the DOS by reflecting the nature of DOS: DOS determines the general distribution of states as a function of energy. Specifically, we integrate the heterogeneous information obtained from the crystal structure and the energies via multi-modal transformer, thereby modeling the complex relationships between the atoms in the crystal structure, and various energy levels. Extensive experiments on two types of DOS, i.e., Phonon DOS and Electron DOS, with various real-world scenarios demonstrate the superiority of DOSTransformer. The source code for DOSTransformer is available at https://github.com/HeewoongNoh/DOSTransformer. △ Less

Submitted 10 April, 2023; v1 submitted 13 March, 2023; originally announced March 2023.

Comments: ICLR 2023 Workshop on Machine Learning for Materials (ML4Materials)

Tetrahedral triple-Q magnetic ordering and large spontaneous Hall conductivity in the metallic triangular antiferromagnet Co1/3TaS2

Authors: Pyeongjae Park, Woonghee Cho, Chaebin Kim, Yeochan An, Yoon-Gu Kang, Maxim Avdeev, Romain Sibille, Kazuki Iida, Ryoichi Kajimoto, Ki Hoon Lee, Woori Ju, En-Jin Cho, Han-Jin Noh, Myung Joon Han, Shang-Shun Zhang, Cristian D. Batista, Je-Geun Park

Abstract: The triangular lattice antiferromagnet (TLAF) has been the standard paradigm of frustrated magnetism for several decades. The most common magnetic ordering in insulating TLAFs is the 120 structure. However, a new triple-Q chiral ordering can emerge in metallic TLAFs, representing the short wavelength limit of magnetic skyrmion crystals. We report the metallic TLAF Co1/3TaS2 as the first example of… ▽ More The triangular lattice antiferromagnet (TLAF) has been the standard paradigm of frustrated magnetism for several decades. The most common magnetic ordering in insulating TLAFs is the 120 structure. However, a new triple-Q chiral ordering can emerge in metallic TLAFs, representing the short wavelength limit of magnetic skyrmion crystals. We report the metallic TLAF Co1/3TaS2 as the first example of tetrahedral triple-Q magnetic ordering with the associated topological Hall effect (non-zero σ_{xy}(H=0)). We also present a theoretical framework that describes the emergence of this magnetic ground state, which is further supported by the electronic structure measured by angle-resolved photoemission spectroscopy. Additionally, our measurements of the inelastic neutron scattering cross section are consistent with the calculated dynamical structure factor of the tetrahedral triple-Q state. △ Less

Submitted 12 November, 2023; v1 submitted 7 March, 2023; originally announced March 2023.

Comments: 23 pages, 4 figures, SI not included. Accepted for publication in Nature Communications

Journal ref: Nature Communications 14, 8346 (2023)

Can Current Task-oriented Dialogue Models Automate Real-world Scenarios in the Wild?

Authors: Sang-Woo Lee, Sungdong Kim, Donghyeon Ko, Donghoon Ham, Youngki Hong, Shin Ah Oh, Hyunhoon Jung, Wangkyo Jung, Kyunghyun Cho, Donghyun Kwak, Hyungsuk Noh, Woomyoung Park

Abstract: Task-oriented dialogue (TOD) systems are mainly based on the slot-filling-based TOD (SF-TOD) framework, in which dialogues are broken down into smaller, controllable units (i.e., slots) to fulfill a specific task. A series of approaches based on this framework achieved remarkable success on various TOD benchmarks. However, we argue that the current TOD benchmarks are limited to surrogate real-worl… ▽ More Task-oriented dialogue (TOD) systems are mainly based on the slot-filling-based TOD (SF-TOD) framework, in which dialogues are broken down into smaller, controllable units (i.e., slots) to fulfill a specific task. A series of approaches based on this framework achieved remarkable success on various TOD benchmarks. However, we argue that the current TOD benchmarks are limited to surrogate real-world scenarios and that the current TOD models are still a long way to cover the scenarios. In this position paper, we first identify current status and limitations of SF-TOD systems. After that, we explore the WebTOD framework, the alternative direction for building a scalable TOD system when a web/mobile interface is available. In WebTOD, the dialogue system learns how to understand the web/mobile interface that the human agent interacts with, powered by a large-scale language model. △ Less

Submitted 24 May, 2023; v1 submitted 20 December, 2022; originally announced December 2022.

RWEN-TTS: Relation-aware Word Encoding Network for Natural Text-to-Speech Synthesis

Authors: Shinhyeok Oh, HyeongRae Noh, Yoonseok Hong, Insoo Oh

Abstract: With the advent of deep learning, a huge number of text-to-speech (TTS) models which produce human-like speech have emerged. Recently, by introducing syntactic and semantic information w.r.t the input text, various approaches have been proposed to enrich the naturalness and expressiveness of TTS models. Although these strategies showed impressive results, they still have some limitations in utiliz… ▽ More With the advent of deep learning, a huge number of text-to-speech (TTS) models which produce human-like speech have emerged. Recently, by introducing syntactic and semantic information w.r.t the input text, various approaches have been proposed to enrich the naturalness and expressiveness of TTS models. Although these strategies showed impressive results, they still have some limitations in utilizing language information. First, most approaches only use graph networks to utilize syntactic and semantic information without considering linguistic features. Second, most previous works do not explicitly consider adjacent words when encoding syntactic and semantic information, even though it is obvious that adjacent words are usually meaningful when encoding the current word. To address these issues, we propose Relation-aware Word Encoding Network (RWEN), which effectively allows syntactic and semantic information based on two modules (i.e., Semantic-level Relation Encoding and Adjacent Word Relation Encoding). Experimental results show substantial improvements compared to previous works. △ Less

Submitted 15 December, 2022; originally announced December 2022.

Comments: Accepted to AAAI 2023

Spatial Deep Deconvolution U-Net for Traffic Analyses with Distributed Acoustic Sensing

Authors: Siyuan Yuan, Martijn van den Ende, Jingxiao Liu, Hae Young Noh, Robert Clapp, Cédric Richard, Biondo Biondi

Abstract: Distributed Acoustic Sensing (DAS) that transforms city-wide fiber-optic cables into a large-scale strain sensing array has shown the potential to revolutionize urban traffic monitoring by providing a fine-grained, scalable, and low-maintenance monitoring solution. However, the real-world application of DAS is hindered by challenges such as noise contamination and interference among closely travel… ▽ More Distributed Acoustic Sensing (DAS) that transforms city-wide fiber-optic cables into a large-scale strain sensing array has shown the potential to revolutionize urban traffic monitoring by providing a fine-grained, scalable, and low-maintenance monitoring solution. However, the real-world application of DAS is hindered by challenges such as noise contamination and interference among closely traveling cars. In response, we introduce a self-supervised U-Net model that can suppress background noise and compress car-induced DAS signals into high-resolution pulses through spatial deconvolution. Our work extends recent research by introducing three key advancements. Firstly, we perform a comprehensive resolution analysis of DAS-recorded traffic signals, laying a theoretical foundation for our approach. Secondly, we incorporate space-domain vehicle wavelets into our U-Net model, enabling consistent high-resolution outputs regardless of vehicle speed variations. Finally, we employ L-2 norm regularization in the loss function, enhancing our model's sensitivity to weaker signals from vehicles in remote traffic lanes. We evaluate the effectiveness and robustness of our method through field recordings under different traffic conditions and various driving speeds. Our results show that our method can enhance the spatial-temporal resolution and better resolve closely traveling cars. The spatial deconvolution U-Net model also enables the characterization of large-size vehicles to identify axle numbers and estimate the vehicle length. Monitoring large-size vehicles also benefits imaging deep earth by leveraging the surface waves induced by the dynamic vehicle-road interaction. △ Less

Submitted 27 June, 2023; v1 submitted 7 December, 2022; originally announced December 2022.

Comments: This preprint was re-submitted as a revised version to the IEEE Transactions on Intelligent Transportation Systems on June 27, 2023

PigV$^2$: Monitoring Pig Vital Signs through Ground Vibrations Induced by Heartbeat and Respiration

Authors: Yiwen Dong, Jesse R Codling, Gary Rohrer, Jeremy Miles, Sudhendu Sharma, Tami Brown-Brandl, Pei Zhang, Hae Young Noh

Abstract: Pig vital sign monitoring (e.g., estimating the heart rate (HR) and respiratory rate (RR)) is essential to understand the stress level of the sow and detect the onset of parturition. It helps to maximize peri-natal survival and improve animal well-being in swine production. The existing approach mainly relies on manual measurement, which is labor-intensive and only provides a few points of informa… ▽ More Pig vital sign monitoring (e.g., estimating the heart rate (HR) and respiratory rate (RR)) is essential to understand the stress level of the sow and detect the onset of parturition. It helps to maximize peri-natal survival and improve animal well-being in swine production. The existing approach mainly relies on manual measurement, which is labor-intensive and only provides a few points of information. Other sensing modalities such as wearables and cameras are developed to enable more continuous measurement, but are still limited due to animal discomfort, data transfer, and storage challenges. In this paper, we introduce PigV$^2$, the first system to monitor pig heart rate and respiratory rate through ground vibrations. Our approach leverages the insight that both heartbeat and respiration generate ground vibrations when the sow is lying on the floor. We infer vital information by sensing and analyzing these vibrations. The main challenge in developing PigV$^2$ is the overlap of vital- and non-vital-related information in the vibration signals, including pig movements, pig postures, pig-to-sensor distances, and so on. To address this issue, we first characterize their effects, extract their current status, and then reduce their impact by adaptively interpolating vital rates over multiple sensors. PigV$^2$ is evaluated through a real-world deployment with 30 pigs. It has 3.4% and 8.3% average errors in monitoring the HR and RR of the sows, respectively. △ Less

Submitted 6 December, 2022; originally announced December 2022.

Comments: 7 pages, 9 figures

GaitVibe+: Enhancing Structural Vibration-based Footstep Localization Using Temporary Cameras for In-home Gait Analysis

Authors: Yiwen Dong, Jingxiao Liu, Hae Young Noh

Abstract: In-home gait analysis is important for providing early diagnosis and adaptive treatments for individuals with gait disorders. Existing systems include wearables and pressure mats, but they have limited scalability. Recent studies have developed vision-based systems to enable scalable, accurate in-home gait analysis, but it faces privacy concerns due to the exposure of people's appearances. Our pri… ▽ More In-home gait analysis is important for providing early diagnosis and adaptive treatments for individuals with gait disorders. Existing systems include wearables and pressure mats, but they have limited scalability. Recent studies have developed vision-based systems to enable scalable, accurate in-home gait analysis, but it faces privacy concerns due to the exposure of people's appearances. Our prior work developed footstep-induced structural vibration sensing for gait monitoring, which is device-free, wide-ranged, and perceived as more privacy-friendly. Although it has succeeded in temporal gait event extraction, it shows limited performance for spatial gait parameter estimation due to imprecise footstep localization. In particular, the localization error mainly comes from the estimation error of the wave arrival time at the vibration sensors and its error propagation to wave velocity estimations. Therefore, we present GaitVibe+, a vibration-based footstep localization method fused with temporarily installed cameras for in-home gait analysis. Our method has two stages: fusion and operating. In the fusion stage, both cameras and vibration sensors are installed to record only a few trials of the subject's footstep data, through which we characterize the uncertainty in wave arrival time and model the wave velocity profiles for the given structure. In the operating stage, we remove the camera to preserve privacy at home. The footstep localization is conducted by estimating the time difference of arrival (TDoA) over multiple vibration sensors, whose accuracy is improved through the reduced uncertainty and velocity modeling during the fusion stage. We evaluate GaitVibe+ through a real-world experiment with 50 walking trials. With only 3 trials of multi-modal fusion, our approach has an average localization error of 0.22 meters, which reduces the spatial gait parameter error from 111% to 27%. △ Less

Submitted 6 December, 2022; originally announced December 2022.

Comments: 7 pages, 7 figures

ACM Class: J.3

HaRiM$^+$: Evaluating Summary Quality with Hallucination Risk

Authors: Seonil Son, Junsoo Park, Jeong-in Hwang, Junghwa Lee, Hyungjong Noh, Yeonsoo Lee

Abstract: One of the challenges of developing a summarization model arises from the difficulty in measuring the factual inconsistency of the generated text. In this study, we reinterpret the decoder overconfidence-regularizing objective suggested in (Miao et al., 2021) as a hallucination risk measurement to better estimate the quality of generated summaries. We propose a reference-free metric, HaRiM+, which… ▽ More One of the challenges of developing a summarization model arises from the difficulty in measuring the factual inconsistency of the generated text. In this study, we reinterpret the decoder overconfidence-regularizing objective suggested in (Miao et al., 2021) as a hallucination risk measurement to better estimate the quality of generated summaries. We propose a reference-free metric, HaRiM+, which only requires an off-the-shelf summarization model to compute the hallucination risk based on token likelihoods. Deploying it requires no additional training of models or ad-hoc modules, which usually need alignment to human judgments. For summary-quality estimation, HaRiM+ records state-of-the-art correlation to human judgment on three summary-quality annotation sets: FRANK, QAGS, and SummEval. We hope that our work, which merits the use of summarization models, facilitates the progress of both automated evaluation and generation of summary. △ Less

Submitted 24 November, 2022; v1 submitted 22 November, 2022; originally announced November 2022.

Comments: 9 pages (+ 21 pages of Appendix), AACL 2022

Journal ref: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (AACL-IJCNLP 2022), pages 895-924

Exact formulations of relativistic electrodynamics and magnetohydrodynamics with helically coupled scalar field

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: We present the general relativistic electrodynamics and magnetohydrodynamics with a helically coupled scalar field. We consider three component system with the fluid, scalar field and electromagnetic fields with the helical coupling. We derive three exact formulations: the covariant formulation, the ADM formulation, and the fully nonlinear and exact perturbation formulation. We also derive the wea… ▽ More We present the general relativistic electrodynamics and magnetohydrodynamics with a helically coupled scalar field. We consider three component system with the fluid, scalar field and electromagnetic fields with the helical coupling. We derive three exact formulations: the covariant formulation, the ADM formulation, and the fully nonlinear and exact perturbation formulation. We also derive the weak-gravity limit with fully relativistic fluid and fields. The latter two formulations are presented in the cosmological context. △ Less

Submitted 20 April, 2023; v1 submitted 7 November, 2022; originally announced November 2022.

Comments: 30 pages, no figure. Published in Physical Review D

Axion cosmology with post-Newtonian corrections

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: We present first-order post-Newtonian (1PN) approximations of a general imperfect fluid and of an axion as a coherently oscillating massive scalar field, both in the cosmological context. For the axion, using the Klein transformation and Madelung transformation we derive the Schrödinger and Madelung hydrodynamic formulations, respectively, in exact covariant way and to 1PN order. Complete sets of… ▽ More We present first-order post-Newtonian (1PN) approximations of a general imperfect fluid and of an axion as a coherently oscillating massive scalar field, both in the cosmological context. For the axion, using the Klein transformation and Madelung transformation we derive the Schrödinger and Madelung hydrodynamic formulations, respectively, in exact covariant way and to 1PN order. Complete sets of equations for the 1PN formulations are derived without fixing the temporal gauge condition. We study the linear instability in cosmology and a static limit for both fluid and axion; these are presented independently of the gauge condition to 1PN order, thus are naturally gauge-invariant. △ Less

Submitted 6 November, 2022; v1 submitted 3 November, 2022; originally announced November 2022.

Comments: 18 pages, no figure

Vibration-Based Bridge Health Monitoring using Telecommunication Cables

Authors: Jingxiao Liu, Siyuan Yuan, Bin Luo, Biondo Biondi, Hae Young Noh

Abstract: Bridge Health Monitoring (BHM) enables early damage detection of bridges and is thus critical for avoiding more severe damages that might result in major financial and human losses. However, conventional BHM systems require dedicated sensors on bridges, which is costly to install and maintain and hard to scale up. To overcome this challenge, we introduce a new system that uses existing telecommuni… ▽ More Bridge Health Monitoring (BHM) enables early damage detection of bridges and is thus critical for avoiding more severe damages that might result in major financial and human losses. However, conventional BHM systems require dedicated sensors on bridges, which is costly to install and maintain and hard to scale up. To overcome this challenge, we introduce a new system that uses existing telecommunication cables for Distributed Acoustic Sensing (DAS) to collect bridge dynamic strain responses. In addition, we develop a two-module physics-guided system identification method to extract bridge damage-sensitive information (e.g., natural frequencies and mode shapes) from noisy DAS data by constraining strain and displacement mode shapes by bridge dynamics. This approach does not require installation and maintenance of dedicated sensors on bridges. We evaluate our system with field experiments on a concrete bridge with fiber cable running in a conduit under the deck. Our system successfully identified modal frequencies and reconstructed meter-scale mode shapes. △ Less

Submitted 10 May, 2022; originally announced May 2022.

Bayesian Updating of Seismic Ground Failure Estimates via Causal Graphical Models and Satellite Imagery

Authors: Susu Xu, Joshua Dimasaka, David J. Wald, Hae Young Noh

Abstract: Earthquake-induced secondary ground failure hazards, such as liquefaction and landslides, result in catastrophic building and infrastructure damage as well as human fatalities. To facilitate emergency responses and mitigate losses, the U.S. Geological Survey provides a rapid hazard estimation system for earthquake-triggered landslides and liquefaction using geospatial susceptibility proxies and Sh… ▽ More Earthquake-induced secondary ground failure hazards, such as liquefaction and landslides, result in catastrophic building and infrastructure damage as well as human fatalities. To facilitate emergency responses and mitigate losses, the U.S. Geological Survey provides a rapid hazard estimation system for earthquake-triggered landslides and liquefaction using geospatial susceptibility proxies and ShakeMap ground motion estimates. In this study, we develop a generalized causal graph-based Bayesian network that models the physical interdependencies between geospatial features, seismic ground failures, and building damage, as well as DPMs. Geospatial features provide physical insights for estimating ground failure occurrence while DPMs contain event-specific surface change observations. This physics-informed causal graph incorporates these variables with complex physical relationships in one holistic Bayesian updating scheme to effectively fuse information from both geospatial models and remote sensing data. This framework is scalable and flexible enough to deal with highly complex multi-hazard combinations. We then develop a stochastic variational inference algorithm to jointly update the intractable posterior probabilities of unobserved landslides, liquefaction, and building damage at different locations efficiently. In addition, a local graphical model pruning algorithm is presented to reduce the computational cost of large-scale seismic ground failure estimation. We apply this framework to the September 2018 Hokkaido Iburi-Tobu, Japan (M6.6) earthquake and January 2020 Southwest Puerto Rico (M6.4) earthquake to evaluate the performance of our algorithm. △ Less

Submitted 15 April, 2022; originally announced April 2022.

Comments: The 17th World Conference on Earthquake Engineering, Sendai, Japan, Sep. 2021

Unsupervised Change Detection Based on Image Reconstruction Loss

Authors: Hyeoncheol Noh, Jingi Ju, Minseok Seo, Jongchan Park, Dong-Geol Choi

Abstract: To train the change detector, bi-temporal images taken at different times in the same area are used. However, collecting labeled bi-temporal images is expensive and time consuming. To solve this problem, various unsupervised change detection methods have been proposed, but they still require unlabeled bi-temporal images. In this paper, we propose unsupervised change detection based on image recons… ▽ More To train the change detector, bi-temporal images taken at different times in the same area are used. However, collecting labeled bi-temporal images is expensive and time consuming. To solve this problem, various unsupervised change detection methods have been proposed, but they still require unlabeled bi-temporal images. In this paper, we propose unsupervised change detection based on image reconstruction loss using only unlabeled single temporal single image. The image reconstruction model is trained to reconstruct the original source image by receiving the source image and the photometrically transformed source image as a pair. During inference, the model receives bi-temporal images as the input, and tries to reconstruct one of the inputs. The changed region between bi-temporal images shows high reconstruction loss. Our change detector showed significant performance in various change detection benchmark datasets even though only a single temporal single source image was used. The code and trained models will be publicly available for reproducibility. △ Less

Submitted 4 April, 2022; v1 submitted 3 April, 2022; originally announced April 2022.

Comments: 10 pages, 7 figures

Field-tunable toroidal moment and anomalous Hall effect in noncollinear antiferromagnetic Weyl semimetal Co1/3TaS2

Authors: Pyeongjae Park, Yoon-Gu Kang, Junghyun Kim, Ki Hoon Lee, Han-Jin Noh, Myung Joon Han, Je-Geun Park

Abstract: Combining magnetism with band topology provides various novel phases that are otherwise impossible. Among several cases, noncollinear metallic antiferromagnets can reveal particularly rich topological physics due to their diverse magnetic ground states. However, there are only a few experimental studies due to the lack of suitable materials, especially with triangular lattice antiferromagnets. Her… ▽ More Combining magnetism with band topology provides various novel phases that are otherwise impossible. Among several cases, noncollinear metallic antiferromagnets can reveal particularly rich topological physics due to their diverse magnetic ground states. However, there are only a few experimental studies due to the lack of suitable materials, especially with triangular lattice antiferromagnets. Here, we report that metallic triangular antiferromagnet Co1/3TaS2 exhibits a substantial anomalous Hall effect (AHE) related to its noncollinear magnetic order. Our first-principles calculations found that hourglass Weyl fermions from the non-symmorphic symmetry trigger AHE. We further show that AHE in Co1/3TaS2 can be characterized by the toroidal moment, a vortex-like multipole component that arises from a combination of chiral lattice and geometrical frustration. Finally, the unusual field-tunability of the toroidal moment puts Co1/3TaS2 as a rare example of a noncollinear metallic antiferromagnet filled with interesting magnetic and topological properties. △ Less

Submitted 7 March, 2022; originally announced March 2022.

Comments: 20 pages, 4 figures, Accepted for publication in npj Quantum Materials

Journal ref: npj Quantum Mater. 7, 42 (2022)

Axion electrodynamics and magnetohydrodynamics

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: We formulate axion-electrodynamics and magnetohydrodynamics (MHD) in the cosmological context assuming weak gravity. The two formulations are made for a general scalar field with general $f(φ)$-coupling, and an axion as a massive scalar field with $φ^2$-coupling, with the helical electromagnetic field. The $α$-dynamo term appears naturally from the helical coupling in the MHD formulation. In the p… ▽ More We formulate axion-electrodynamics and magnetohydrodynamics (MHD) in the cosmological context assuming weak gravity. The two formulations are made for a general scalar field with general $f(φ)$-coupling, and an axion as a massive scalar field with $φ^2$-coupling, with the helical electromagnetic field. The $α$-dynamo term appears naturally from the helical coupling in the MHD formulation. In the presence of the electromagnetic coupling, however, the Schrödinger and hydrodynamic formulations of the coherently oscillating axion are {\it not} available for the conventional $φ$ coupling; instead, $φ^2$ coupling allows successful formulations preserving the dark matter nature of the axion to nonlinear order. In the MHD formulation, direct couplings between the scalar and electromagnetic fields appear only for non-ideal MHD. We study gravitational and magnetic instabilities of the scalar field and axion MHDs. △ Less

Submitted 5 July, 2022; v1 submitted 6 March, 2022; originally announced March 2022.

Comments: 7 pages, no figure

Predicting Peak Stresses In Microstructured Materials Using Convolutional Encoder-Decoder Learning

Authors: Ankit Shrivastava, Jingxiao Liu, Kaushik Dayal, Hae Young Noh

Abstract: This work presents a machine learning approach to predict peak-stress clusters in heterogeneous polycrystalline materials. Prior work on using machine learning in the context of mechanics has largely focused on predicting the effective response and overall structure of stress fields. However, their ability to predict peak stresses -- which are of critical importance to failure -- is unexplored, be… ▽ More This work presents a machine learning approach to predict peak-stress clusters in heterogeneous polycrystalline materials. Prior work on using machine learning in the context of mechanics has largely focused on predicting the effective response and overall structure of stress fields. However, their ability to predict peak stresses -- which are of critical importance to failure -- is unexplored, because the peak-stress clusters occupy a small spatial volume relative to the entire domain, and hence requires computationally expensive training. This work develops a deep-learning based Convolutional Encoder-Decoder method that focuses on predicting peak-stress clusters, specifically on the size and other characteristics of the clusters in the framework of heterogeneous linear elasticity. This method is based on convolutional filters that model local spatial relations between microstructures and stress fields using spatially weighted averaging operations. The model is first trained against linear elastic calculations of stress under applied macroscopic strain in synthetically-generated microstructures, which serves as the ground truth. The trained model is then applied to predict the stress field given a (synthetically-generated) microstructure and then to detect peak-stress clusters within the predicted stress field. The accuracy of the peak-stress predictions is analyzed using the cosine similarity metric and by comparing the geometric characteristics of the peak-stress clusters against the ground-truth calculations. It is observed that the model is able to learn and predict the geometric details of the peak-stress clusters and, in particular, performed better for higher (normalized) values of the peak stress as compared to lower values of the peak stress. These comparisons showed that the proposed method is well-suited to predict the characteristics of peak-stress clusters. △ Less

Submitted 3 January, 2022; originally announced January 2022.

Comments: To appear in Mathematics and Mechanics of Solids

May the Force Be with Your Copy Mechanism: Enhanced Supervised-Copy Method for Natural Language Generation

Authors: Sanghyuk Choi, Jeong-in Hwang, Hyungjong Noh, Yeonsoo Lee

Abstract: Recent neural sequence-to-sequence models with a copy mechanism have achieved remarkable progress in various text generation tasks. These models addressed out-of-vocabulary problems and facilitated the generation of rare words. However, the identification of the word which needs to be copied is difficult, as observed by prior copy models, which suffer from incorrect generation and lacking abstract… ▽ More Recent neural sequence-to-sequence models with a copy mechanism have achieved remarkable progress in various text generation tasks. These models addressed out-of-vocabulary problems and facilitated the generation of rare words. However, the identification of the word which needs to be copied is difficult, as observed by prior copy models, which suffer from incorrect generation and lacking abstractness. In this paper, we propose a novel supervised approach of a copy network that helps the model decide which words need to be copied and which need to be generated. Specifically, we re-define the objective function, which leverages source sequences and target vocabularies as guidance for copying. The experimental results on data-to-text generation and abstractive summarization tasks verify that our approach enhances the copying quality and improves the degree of abstractness. △ Less

Submitted 20 December, 2021; originally announced December 2021.

Comments: 8 pages, 3 figures, 8 tables and 4 pages of appendices

CMASS galaxy sample and the ontological status of the cosmological principle

Authors: Yigon Kim, Chan-Gyung Park, Hyerim Noh, Jai-chan Hwang

Abstract: The cosmological principle (CP), assuming spatially homogeneous and isotropic background geometry in the cosmological scale, is a fundamental assumption in modern cosmology. Recent observations of the galaxy redshift survey provide relevant data to confront the principle with observation. We present a homogeneity test for the matter distribution using the BOSS DR12 CMASS galaxy sample and clarify… ▽ More The cosmological principle (CP), assuming spatially homogeneous and isotropic background geometry in the cosmological scale, is a fundamental assumption in modern cosmology. Recent observations of the galaxy redshift survey provide relevant data to confront the principle with observation. We present a homogeneity test for the matter distribution using the BOSS DR12 CMASS galaxy sample and clarify the ontological status of the CP. As a homogeneity criterion, we compare the observed data with similarly constructed random distributions using the number count in the truncated cones method. Comparisons are also made with three theoretical results using the same method: (i) the dark matter halo mock catalogs from the N-body simulation, (ii) the log-normal distributions derived from the theoretical matter power spectrum, and (iii) direct estimation from the theoretical power spectrum. We show that the observed distribution is statistically impossible as a random distribution up to 300 Mpc/h in radius, which is around the largest statistically available scale. However, comparisons with the three theoretical results show that the observed distribution is consistent with these theoretically derived results based on the CP. We show that the observed galaxy distribution (light) and the simulated dark matter distribution (matter) are quite inhomogeneous even on a large scale. Here, we clarify that there is no inconsistency surrounding the ontological status of the CP in cosmology. In practice, the CP is applied to the metric and the metric fluctuation is extremely small in all cosmological scales. This allows the CP to be valid as the averaged background in metric. The matter fluctuation, however, is decoupled from the small nature of metric fluctuation in the subhorizon scale. What is directly related to the matter in Einstein's gravity is the curvature, a quadratic derivative of the metric. △ Less

Submitted 8 December, 2021; originally announced December 2021.

Comments: 12 pages, 13 figures, 1 table

Journal ref: A&A 660, A139 (2022)

Oscillating gravitational potential due to ultralight axion: linear theory

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: We derive oscillating gravitational potential caused by an ultralight axion as the cosmic dark matter, assuming the Compton wavelength smaller than the horizon scale. A new oscillatory term is found which dominates the previously known one on scales larger than the quantum Jeans-scale. In the context of linear perturbations in cosmology this new term might be more relevant in future observation. B… ▽ More We derive oscillating gravitational potential caused by an ultralight axion as the cosmic dark matter, assuming the Compton wavelength smaller than the horizon scale. A new oscillatory term is found which dominates the previously known one on scales larger than the quantum Jeans-scale. In the context of linear perturbations in cosmology this new term might be more relevant in future observation. Both the quantum stress in density perturbation and the quantum oscillation of the gravitational potential are derived in the zero-shear gauge. We show that the axion fluid in relativistic analysis is quite different from the relativistic and Newtonian zero-pressure fluids, corresponding to Newtonian fluid only in the density perturbation. The consistency demands the relativistic analysis valid on scales larger than the Compton wavelength. △ Less

Submitted 7 December, 2021; v1 submitted 14 November, 2021; originally announced November 2021.

Comments: 6 pages, no figure, substantial revisions made, including title

Axion as a fuzzy-dark-matter candidate: Proofs in different gauges

Authors: Jai-chan Hwang, Hyerim Noh

Abstract: Axion as a coherently oscillating massive scalar field is known to behave as a zero-pressure irrotational fluid with characteristic quantum stress on a small scale. In relativistic perturbation theory, the case was proved in the axion-comoving gauge up to fully nonlinear and exact order. Our basic assumption is that the field is oscillating with Compton frequency and the Compton wavelength is smal… ▽ More Axion as a coherently oscillating massive scalar field is known to behave as a zero-pressure irrotational fluid with characteristic quantum stress on a small scale. In relativistic perturbation theory, the case was proved in the axion-comoving gauge up to fully nonlinear and exact order. Our basic assumption is that the field is oscillating with Compton frequency and the Compton wavelength is smaller than the horizon scale. Here, we revisit the relativistic proof to the linear order in the other gauge conditions. We show that the same equation for density perturbation known in the non-relativistic treatment can be derived in two additional gauge conditions: the zero-shear gauge and the uniform-curvature gauge. The uniform-expansion gauge fails to get the aimed equation, and the quantum stress term is missing in the synchronous gauge. For comparison, we present the relativistic density perturbation equations in the zero-pressure fluid in these gauge conditions. Except for the comoving and the synchronous gauge, the equations strikingly differ from the axion case. We clarify that the relativistic analysis based on time averaging is valid for scales larger than the Compton wavelength. Below the Compton wavelength, the field is not oscillating, and our oscillatory ansatz does not apply. We suggest an equation valid in all scales in the comoving gauge. For comparison, we review the non-relativistic quantum hydrodynamics and present the Schrödinger equation to first-order post-Newtonian expansion in the cosmological context. △ Less

Submitted 23 February, 2022; v1 submitted 12 September, 2021; originally announced September 2021.

Comments: 11 pages, no figure; Published version

HierMUD: Hierarchical Multi-task Unsupervised Domain Adaptation between Bridges for Drive-by Damage Diagnosis

Authors: Jingxiao Liu, Susu Xu, Mario Bergés, Hae Young Noh

Abstract: Monitoring bridge health using vibrations of drive-by vehicles has various benefits, such as no need for directly installing and maintaining sensors on the bridge. However, many of the existing drive-by monitoring approaches are based on supervised learning models that require labeled data from every bridge of interest, which is expensive and time-consuming, if not impossible, to obtain. To this e… ▽ More Monitoring bridge health using vibrations of drive-by vehicles has various benefits, such as no need for directly installing and maintaining sensors on the bridge. However, many of the existing drive-by monitoring approaches are based on supervised learning models that require labeled data from every bridge of interest, which is expensive and time-consuming, if not impossible, to obtain. To this end, we introduce a new framework that transfers the model learned from one bridge to diagnose damage in another bridge without any labels from the target bridge. Our framework trains a hierarchical neural network model in an adversarial way to extract task-shared and task-specific features that are informative to multiple diagnostic tasks and invariant across multiple bridges. We evaluate our framework on experimental data collected from 2 bridges and 3 vehicles. We achieve accuracies of 95% for damage detection, 93% for localization, and up to 72% for quantification, which are ~2 times improvements from baseline methods. △ Less

Submitted 23 July, 2021; originally announced July 2021.

Journal ref: Structural Health Monitoring 22(3):1941-1968, 2023

Gauge-Invariant Tensor Perturbations Induced from Baryon-CDM Relative Velocity and the B-mode Polarization of the CMB

Authors: James Gurian, Donghui Jeong, Jai-chan Hwang, Hyerim Noh

Abstract: At second-order, scalar perturbations can source traceless and transverse perturbations to the metric, called induced gravitational waves (IGW). The apparent gauge-dependence of the IGW obscures the interpretation of the stochastic gravitational-wave signal. To elucidate the gauge dependence, we study the IGW from manifestly gauge-invariant scalar perturbations, namely, the relative velocity betwe… ▽ More At second-order, scalar perturbations can source traceless and transverse perturbations to the metric, called induced gravitational waves (IGW). The apparent gauge-dependence of the IGW obscures the interpretation of the stochastic gravitational-wave signal. To elucidate the gauge dependence, we study the IGW from manifestly gauge-invariant scalar perturbations, namely, the relative velocity between the baryon and cold dark matter. From this relative velocity perturbation, we compute the dimensionless gravitational wave power spectrum and the corresponding expected angular power spectrum of the B-mode polarization of the cosmic microwave background. Although the effect turns out to be unobservably small, the calculation demonstrates both the importance of using observable quantities to remove the gauge ambiguity and the observable consequences of tensor perturbations which are not propagating gravitational waves. △ Less

Submitted 8 November, 2021; v1 submitted 7 April, 2021; originally announced April 2021.

Comments: 12 pages, 3 figures; Published version: appendix expanded and typos corrected

Journal ref: Phys. Rev. D 104, 083534 (2021)

Asymmetric self-play for automatic goal discovery in robotic manipulation

Authors: OpenAI OpenAI, Matthias Plappert, Raul Sampedro, Tao Xu, Ilge Akkaya, Vineet Kosaraju, Peter Welinder, Ruben D'Sa, Arthur Petron, Henrique P. d. O. Pinto, Alex Paino, Hyeonwoo Noh, Lilian Weng, Qiming Yuan, Casey Chu, Wojciech Zaremba

Abstract: We train a single, goal-conditioned policy that can solve many robotic manipulation tasks, including tasks with previously unseen goals and objects. We rely on asymmetric self-play for goal discovery, where two agents, Alice and Bob, play a game. Alice is asked to propose challenging goals and Bob aims to solve them. We show that this method can discover highly diverse and complex goals without an… ▽ More We train a single, goal-conditioned policy that can solve many robotic manipulation tasks, including tasks with previously unseen goals and objects. We rely on asymmetric self-play for goal discovery, where two agents, Alice and Bob, play a game. Alice is asked to propose challenging goals and Bob aims to solve them. We show that this method can discover highly diverse and complex goals without any human priors. Bob can be trained with only sparse rewards, because the interaction between Alice and Bob results in a natural curriculum and Bob can learn from Alice's trajectory when relabeled as a goal-conditioned demonstration. Finally, our method scales, resulting in a single policy that can generalize to many unseen tasks such as setting a table, stacking blocks, and solving simple puzzles. Videos of a learned policy is available at https://robotics-self-play.github.io. △ Less

Submitted 13 January, 2021; originally announced January 2021.

Comments: Videos are shown at https://robotics-self-play.github.io

Multi-SpectroGAN: High-Diversity and High-Fidelity Spectrogram Generation with Adversarial Style Combination for Speech Synthesis

Authors: Sang-Hoon Lee, Hyun-Wook Yoon, Hyeong-Rae Noh, Ji-Hoon Kim, Seong-Whan Lee

Abstract: While generative adversarial networks (GANs) based neural text-to-speech (TTS) systems have shown significant improvement in neural speech synthesis, there is no TTS system to learn to synthesize speech from text sequences with only adversarial feedback. Because adversarial feedback alone is not sufficient to train the generator, current models still require the reconstruction loss compared with t… ▽ More While generative adversarial networks (GANs) based neural text-to-speech (TTS) systems have shown significant improvement in neural speech synthesis, there is no TTS system to learn to synthesize speech from text sequences with only adversarial feedback. Because adversarial feedback alone is not sufficient to train the generator, current models still require the reconstruction loss compared with the ground-truth and the generated mel-spectrogram directly. In this paper, we present Multi-SpectroGAN (MSG), which can train the multi-speaker model with only the adversarial feedback by conditioning a self-supervised hidden representation of the generator to a conditional discriminator. This leads to better guidance for generator training. Moreover, we also propose adversarial style combination (ASC) for better generalization in the unseen speaking style and transcript, which can learn latent representations of the combined style embedding from multiple mel-spectrograms. Trained with ASC and feature matching, the MSG synthesizes a high-diversity mel-spectrogram by controlling and mixing the individual speaking styles (e.g., duration, pitch, and energy). The result shows that the MSG synthesizes a high-fidelity mel-spectrogram, which has almost the same naturalness MOS score as the ground-truth mel-spectrogram. △ Less

Submitted 14 December, 2020; originally announced December 2020.

Comments: 9 pages, 3 figures, Accepted paper in AAAI Conference on Artificial Intelligence (AAAI), 2021

Behavior Priors for Efficient Reinforcement Learning

Authors: Dhruva Tirumala, Alexandre Galashov, Hyeonwoo Noh, Leonard Hasenclever, Razvan Pascanu, Jonathan Schwarz, Guillaume Desjardins, Wojciech Marian Czarnecki, Arun Ahuja, Yee Whye Teh, Nicolas Heess

Abstract: As we deploy reinforcement learning agents to solve increasingly challenging problems, methods that allow us to inject prior knowledge about the structure of the world and effective solution strategies becomes increasingly important. In this work we consider how information and architectural constraints can be combined with ideas from the probabilistic modeling literature to learn behavior priors… ▽ More As we deploy reinforcement learning agents to solve increasingly challenging problems, methods that allow us to inject prior knowledge about the structure of the world and effective solution strategies becomes increasingly important. In this work we consider how information and architectural constraints can be combined with ideas from the probabilistic modeling literature to learn behavior priors that capture the common movement and interaction patterns that are shared across a set of related tasks or contexts. For example the day-to day behavior of humans comprises distinctive locomotion and manipulation patterns that recur across many different situations and goals. We discuss how such behavior patterns can be captured using probabilistic trajectory models and how these can be integrated effectively into reinforcement learning schemes, e.g.\ to facilitate multi-task and transfer learning. We then extend these ideas to latent variable models and consider a formulation to learn hierarchical priors that capture different aspects of the behavior in reusable modules. We discuss how such latent variable formulations connect to related work on hierarchical reinforcement learning (HRL) and mutual information and curiosity based objectives, thereby offering an alternative perspective on existing ideas. We demonstrate the effectiveness of our framework by applying it to a range of simulated continuous control domains. △ Less

Submitted 27 October, 2020; originally announced October 2020.

Comments: Submitted to Journal of Machine Learning Research (JMLR)

Gravito-magnetic instabilities of Relativistic Magnetohydrodynamics

Authors: Hyerim Noh, Jai-chan Hwang

Abstract: We study gravito-magnetic instabilities of a static homogeneous medium with an aligned magnetic field in the two contexts of relativistic magnetohydrodynamics (MHD): first, MHD with post-Newtonian (PN) corrections, and second, special relativistic (SR) MHD with weak gravity. The analysis in the PN MHD is made without taking the temporal gauge condition, thus results are gauge-invariant. The PN cor… ▽ More We study gravito-magnetic instabilities of a static homogeneous medium with an aligned magnetic field in the two contexts of relativistic magnetohydrodynamics (MHD): first, MHD with post-Newtonian (PN) corrections, and second, special relativistic (SR) MHD with weak gravity. The analysis in the PN MHD is made without taking the temporal gauge condition, thus results are gauge-invariant. The PN corrections of the internal energy, pressure, sound velocity and the Alfvén velocity lower the critical (Jeans) wavelength. {All relativistic effects tend to destabilize the system.} Although the SR MHD with weak gravity is presented in the harmonic gauge, in the presence of gravity the stability analysis is strictly valid to Newtonian order. In the absence of gravity, the SR MHD is independent of the gauge condition. We present the plane wave velocities and the stability criteria in both cases. △ Less

Submitted 4 October, 2020; originally announced October 2020.

Comments: 10 pages, 4 figures

Audio Dequantization for High Fidelity Audio Generation in Flow-based Neural Vocoder

Authors: Hyun-Wook Yoon, Sang-Hoon Lee, Hyeong-Rae Noh, Seong-Whan Lee

Abstract: In recent works, a flow-based neural vocoder has shown significant improvement in real-time speech generation task. The sequence of invertible flow operations allows the model to convert samples from simple distribution to audio samples. However, training a continuous density model on discrete audio data can degrade model performance due to the topological difference between latent and actual dist… ▽ More In recent works, a flow-based neural vocoder has shown significant improvement in real-time speech generation task. The sequence of invertible flow operations allows the model to convert samples from simple distribution to audio samples. However, training a continuous density model on discrete audio data can degrade model performance due to the topological difference between latent and actual distribution. To resolve this problem, we propose audio dequantization methods in flow-based neural vocoder for high fidelity audio generation. Data dequantization is a well-known method in image generation but has not yet been studied in the audio domain. For this reason, we implement various audio dequantization methods in flow-based neural vocoder and investigate the effect on the generated audio. We conduct various objective performance assessments and subjective evaluation to show that audio dequantization can improve audio generation quality. From our experiments, using audio dequantization produces waveform audio with better harmonic structure and fewer digital artifacts. △ Less

Submitted 16 August, 2020; originally announced August 2020.

Comments: Accepted in INTERSPEECH2020

Knowledge transfer between bridges for drive-by monitoring using adversarial and multi-task learning

Authors: Jingxiao Liu, Mario Bergés, Jacobo Bielak, Hae Young Noh

Abstract: Monitoring bridge health using the vibrations of drive-by vehicles has various benefits, such as low cost and no need for direct installation or on-site maintenance of equipment on the bridge. However, many such approaches require labeled data from every bridge, which is expensive and time-consuming, if not impossible, to obtain. This is further exacerbated by having multiple diagnostic tasks, suc… ▽ More Monitoring bridge health using the vibrations of drive-by vehicles has various benefits, such as low cost and no need for direct installation or on-site maintenance of equipment on the bridge. However, many such approaches require labeled data from every bridge, which is expensive and time-consuming, if not impossible, to obtain. This is further exacerbated by having multiple diagnostic tasks, such as damage quantification and localization. One way to address this issue is to directly apply the supervised model trained for one bridge to other bridges, although this may significantly reduce the accuracy because of distribution mismatch between different bridges'data. To alleviate these problems, we introduce a transfer learning framework using domain-adversarial training and multi-task learning to detect, localize and quantify damage. Specifically, we train a deep network in an adversarial way to learn features that are 1) sensitive to damage and 2) invariant to different bridges. In addition, to improve the error propagation from one task to the next, our framework learns shared features for all the tasks using multi-task learning. We evaluate our framework using lab-scale experiments with two different bridges. On average, our framework achieves 94%, 97% and 84% accuracy for damage detection, localization and quantification, respectively. within one damage severity level. △ Less

Submitted 5 June, 2020; originally announced June 2020.