Showing 1–50 of 60 results for author: Mou, S

Deep Koopman Learning using the Noisy Data

Authors: Wenjian Hao, Devesh Upadhyay, Shaoshuai Mou

Abstract: This paper proposes a data-driven framework to learn a finite-dimensional approximation of a Koopman operator for approximating the state evolution of a dynamical system under noisy observations. To this end, our proposed solution has two main advantages. First, the proposed method only requires the measurement noise to be bounded. Second, the proposed method modifies the existing deep Koopman ope… ▽ More This paper proposes a data-driven framework to learn a finite-dimensional approximation of a Koopman operator for approximating the state evolution of a dynamical system under noisy observations. To this end, our proposed solution has two main advantages. First, the proposed method only requires the measurement noise to be bounded. Second, the proposed method modifies the existing deep Koopman operator formulations by characterizing the effect of the measurement noise on the Koopman operator learning and then mitigating it by updating the tunable parameter of the observable functions of the Koopman operator, making it easy to implement. The performance of the proposed method is demonstrated on several standard benchmarks. We further compare the presented method with similar methods proposed in the latest literature on Koopman learning. △ Less

Submitted 2 June, 2024; v1 submitted 26 May, 2024; originally announced May 2024.

Integrated Optimal Control for Fast Charging and Active Thermal Management of Lithium-Ion Batteries in Extreme Ambient Temperatures

Authors: Zehui Lu, Hao Tu, Huazhen Fang, Yebin Wang, Shaoshuai Mou

Abstract: This paper presents an integrated control strategy for fast charging and active thermal management of Lithium-ion batteries in extreme ambient temperatures. A control-oriented thermal-NDC (nonlinear double-capacitor) battery model is proposed to describe the electrical and thermal dynamics, accounting for the impact from both an active thermal source and ambient temperature. A state-feedback model… ▽ More This paper presents an integrated control strategy for fast charging and active thermal management of Lithium-ion batteries in extreme ambient temperatures. A control-oriented thermal-NDC (nonlinear double-capacitor) battery model is proposed to describe the electrical and thermal dynamics, accounting for the impact from both an active thermal source and ambient temperature. A state-feedback model predictive control algorithm is then developed for integrated fast charging and active thermal management. Numerical experiments validate the algorithm under extreme temperatures, showing that the proposed algorithm can energy-efficiently adjust the battery temperature to enhance fast charging. Additionally, an output-feedback model predictive control algorithm with an extended Kalman filter is proposed for battery charging when states are partially measurable. Numerical experiments validate the effectiveness under extreme temperatures. △ Less

Submitted 5 April, 2024; originally announced April 2024.

Comparative Raman Scattering Study of Crystal Field Excitations in Co-based Quantum Magnets

Authors: Banasree S. Mou, Xinshu Zhang, Li Xiang, Yuanyuan Xu, Ruidan Zhong, Robert J. Cava, Haidong Zhou, Zhigang Jiang, Dmitry Smirnov, Natalia Drichko, Stephen M. Winter

Abstract: Co-based materials have recently been explored due to potential to realise complex bond-dependent anisotropic magnetism. Prominent examples include Na$_2$Co$_2$TeO$_6$, BaCo$_2$(AsO$_4$)$_2$, Na$_2$BaCo(PO$_4$)$_2$, and CoX$_2$ (X = Cl, Br, I). In order to provide insight into the magnetic interactions in these compounds, we make a comparative analysis of their local crystal electric field excitat… ▽ More Co-based materials have recently been explored due to potential to realise complex bond-dependent anisotropic magnetism. Prominent examples include Na$_2$Co$_2$TeO$_6$, BaCo$_2$(AsO$_4$)$_2$, Na$_2$BaCo(PO$_4$)$_2$, and CoX$_2$ (X = Cl, Br, I). In order to provide insight into the magnetic interactions in these compounds, we make a comparative analysis of their local crystal electric field excitations spectra via Raman scattering measurements. Combining these measurements with theoretical analysis confirms the validity of $j_{\rm eff} = 1/2$ single-ion ground states for all compounds, and provides accurate experimental estimates of the local crystal distortions, which play a prominent role in the magnetic couplings between spin-orbital coupled Co moments. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Comments: 11 pages, 7 figures

C3D: Cascade Control with Change Point Detection and Deep Koopman Learning for Autonomous Surface Vehicles

Authors: Jianwen Li, Hyunsang Park, Wenjian Hao, Lei Xin, Jalil Chavez-Galaviz, Ajinkya Chaudhary, Meredith Bloss, Kyle Pattison, Christopher Vo, Devesh Upadhyay, Shreyas Sundaram, Shaoshuai Mou, Nina Mahmoudian

Abstract: In this paper, we discuss the development and deployment of a robust autonomous system capable of performing various tasks in the maritime domain under unknown dynamic conditions. We investigate a data-driven approach based on modular design for ease of transfer of autonomy across different maritime surface vessel platforms. The data-driven approach alleviates issues related to a priori identifica… ▽ More In this paper, we discuss the development and deployment of a robust autonomous system capable of performing various tasks in the maritime domain under unknown dynamic conditions. We investigate a data-driven approach based on modular design for ease of transfer of autonomy across different maritime surface vessel platforms. The data-driven approach alleviates issues related to a priori identification of system models that may become deficient under evolving system behaviors or shifting, unanticipated, environmental influences. Our proposed learning-based platform comprises a deep Koopman system model and a change point detector that provides guidance on domain shifts prompting relearning under severe exogenous and endogenous perturbations. Motion control of the autonomous system is achieved via an optimal controller design. The Koopman linearized model naturally lends itself to a linear-quadratic regulator (LQR) control design. We propose the C3D control architecture Cascade Control with Change Point Detection and Deep Koopman Learning. The framework is verified in station keeping task on an ASV in both simulation and real experiments. The approach achieved at least 13.9 percent improvement in mean distance error in all test cases compared to the methods that do not consider system changes. △ Less

Submitted 25 March, 2024; v1 submitted 9 March, 2024; originally announced March 2024.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Neighboring Extremal Optimal Control Theory for Parameter-Dependent Closed-loop Laws

Authors: Ayush Rai, Shaoshuai Mou, Brian D. O. Anderson

Abstract: This study introduces an approach to obtain a neighboring extremal optimal control (NEOC) solution for a closed-loop optimal control problem, applicable to a wide array of nonlinear systems and not necessarily quadratic performance indices. The approach involves investigating the variation incurred in the functional form of a known closed-loop optimal control law due to small, known parameter vari… ▽ More This study introduces an approach to obtain a neighboring extremal optimal control (NEOC) solution for a closed-loop optimal control problem, applicable to a wide array of nonlinear systems and not necessarily quadratic performance indices. The approach involves investigating the variation incurred in the functional form of a known closed-loop optimal control law due to small, known parameter variations in the system equations or the performance index. The NEOC solution can formally be obtained by solving a linear partial differential equation, akin to those encountered in the iterative solution of a nonlinear Hamilton-Jacobi equation. Motivated by numerical procedures for solving these latter equations, we also propose a numerical algorithm based on the Galerkin algorithm, leveraging the use of basis functions to solve the underlying Hamilton-Jacobi equation of the original optimal control problem. The proposed approach simplifies the NEOC problem by reducing it to the solution of a simple set of linear equations, thereby eliminating the need for a full re-solution of the adjusted optimal control problem. Furthermore, the variation to the optimal performance index can be obtained as a function of both the system state and small changes in parameters, allowing the determination of the adjustment to an optimal control law given a small adjustment of parameters in the system or the performance index. Moreover, in order to handle large known parameter perturbations, we propose a homotopic approach that breaks down the single calculation of NEOC into a finite set of multiple steps. Finally, the validity of the claims and theory is supported by theoretical analysis and numerical simulations. △ Less

Submitted 7 December, 2023; originally announced December 2023.

Distributed Optimization via Kernelized Multi-armed Bandits

Authors: Ayush Rai, Shaoshuai Mou

Abstract: Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed bandit problem with a heterogeneous reward setting. In this setup, the agents collaboratively aim to maximize a global objective function which is an average o… ▽ More Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed bandit problem with a heterogeneous reward setting. In this setup, the agents collaboratively aim to maximize a global objective function which is an average of local objective functions. The agents can access only bandit feedback (noisy reward) obtained from the associated unknown local function with a small norm in reproducing kernel Hilbert space (RKHS). We present a fully decentralized algorithm, Multi-agent IGP-UCB (MA-IGP-UCB), which achieves a sub-linear regret bound for popular classes for kernels while preserving privacy. It does not necessitate the agents to share their actions, rewards, or estimates of their local function. In the proposed approach, the agents sample their individual local functions in a way that benefits the whole network by utilizing a running consensus to estimate the upper confidence bound on the global function. Furthermore, we propose an extension, Multi-agent Delayed IGP-UCB (MAD-IGP-UCB) algorithm, which reduces the dependence of the regret bound on the number of agents in the network. It provides improved performance by utilizing a delay in the estimation update step at the cost of more communication. △ Less

Submitted 7 December, 2023; originally announced December 2023.

Safe Region Multi-Agent Formation Control With Velocity Tracking

Authors: Ayush Rai, Shaoshuai Mou

Abstract: This paper provides a solution to the problem of safe region formation control with reference velocity tracking for a second-order multi-agent system without velocity measurements. Safe region formation control is a control problem where the agents are expected to attain the desired formation while reaching the target region and simultaneously ensuring collision and obstacle avoidance. To tackle t… ▽ More This paper provides a solution to the problem of safe region formation control with reference velocity tracking for a second-order multi-agent system without velocity measurements. Safe region formation control is a control problem where the agents are expected to attain the desired formation while reaching the target region and simultaneously ensuring collision and obstacle avoidance. To tackle this control problem, we break it down into two distinct objectives: safety and region formation control, to provide a completely distributed algorithm. Region formation control is modeled as a high-level abstract objective, whereas safety and actuator saturation are modeled as a low-level objective designed independently, without any knowledge of the former, and being minimally invasive. Our approach incorporates connectivity preservation, actuator saturation, safety considerations, and lack of velocity measurement from other agents with second-order system dynamics which are important constraints in practical applications. Both internal safety for collision avoidance among agents and external safety for avoiding unsafe regions are ensured using exponential control barrier functions. We provide theoretical results for asymptotic convergence and numerical simulation to show the approach's effectiveness. △ Less

Submitted 14 October, 2023; originally announced October 2023.

VISION Datasets: A Benchmark for Vision-based InduStrial InspectiON

Authors: Haoping Bai, Shancong Mou, Tatiana Likhomanenko, Ramazan Gokberk Cinbis, Oncel Tuzel, Ping Huang, Jiulong Shan, Jianjun Shi, Meng Cao

Abstract: Despite progress in vision-based inspection algorithms, real-world industrial challenges -- specifically in data availability, quality, and complex production requirements -- often remain under-addressed. We introduce the VISION Datasets, a diverse collection of 14 industrial inspection datasets, uniquely poised to meet these challenges. Unlike previous datasets, VISION brings versatility to defec… ▽ More Despite progress in vision-based inspection algorithms, real-world industrial challenges -- specifically in data availability, quality, and complex production requirements -- often remain under-addressed. We introduce the VISION Datasets, a diverse collection of 14 industrial inspection datasets, uniquely poised to meet these challenges. Unlike previous datasets, VISION brings versatility to defect detection, offering annotation masks across all splits and catering to various detection methodologies. Our datasets also feature instance-segmentation annotation, enabling precise defect identification. With a total of 18k images encompassing 44 defect types, VISION strives to mirror a wide range of real-world production scenarios. By supporting two ongoing challenge competitions on the VISION Datasets, we hope to foster further advancements in vision-based industrial inspection. △ Less

Submitted 17 June, 2023; v1 submitted 13 June, 2023; originally announced June 2023.

Distributed Optimization under Edge Agreements: A Continuous-Time Algorithm

Authors: Zehui Lu, Shaoshuai Mou

Abstract: Generalized from the concept of consensus, this paper considers a group of edge agreements, i.e. constraints defined for neighboring agents, in which each pair of neighboring agents is required to satisfy one edge agreement constraint. Edge agreements are defined locally to allow more flexibility than a global consensus. This work formulates a multi-agent optimization problem under edge agreements… ▽ More Generalized from the concept of consensus, this paper considers a group of edge agreements, i.e. constraints defined for neighboring agents, in which each pair of neighboring agents is required to satisfy one edge agreement constraint. Edge agreements are defined locally to allow more flexibility than a global consensus. This work formulates a multi-agent optimization problem under edge agreements and proposes a continuous-time distributed algorithm to solve it. Both analytical proof and numerical examples are provided to validate the effectiveness of the proposed algorithm. △ Less

Submitted 30 November, 2023; v1 submitted 26 May, 2023; originally announced May 2023.

Adaptive Policy Learning to Additional Tasks

Authors: Wenjian Hao, Zehui Lu, Zihao Liang, Tianyu Zhou, Shaoshuai Mou

Abstract: This paper develops a policy learning method for tuning a pre-trained policy to adapt to additional tasks without altering the original task. A method named Adaptive Policy Gradient (APG) is proposed in this paper, which combines Bellman's principle of optimality with the policy gradient approach to improve the convergence rate. This paper provides theoretical analysis which guarantees the converg… ▽ More This paper develops a policy learning method for tuning a pre-trained policy to adapt to additional tasks without altering the original task. A method named Adaptive Policy Gradient (APG) is proposed in this paper, which combines Bellman's principle of optimality with the policy gradient approach to improve the convergence rate. This paper provides theoretical analysis which guarantees the convergence rate and sample complexity of $\mathcal{O}(1/T)$ and $\mathcal{O}(1/ε)$, respectively, where $T$ denotes the number of iterations and $ε$ denotes the accuracy of the resulting stationary policy. Furthermore, several challenging numerical simulations, including cartpole, lunar lander, and robot arm, are provided to show that APG obtains similar performance compared to existing deterministic policy gradient methods while utilizing much less data and converging at a faster rate. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Policy Learning based on Deep Koopman Representation

Authors: Wenjian Hao, Paulo C. Heredia, Bowen Huang, Zehui Lu, Zihao Liang, Shaoshuai Mou

Abstract: This paper proposes a policy learning algorithm based on the Koopman operator theory and policy gradient approach, which seeks to approximate an unknown dynamical system and search for optimal policy simultaneously, using the observations gathered through interaction with the environment. The proposed algorithm has two innovations: first, it introduces the so-called deep Koopman representation int… ▽ More This paper proposes a policy learning algorithm based on the Koopman operator theory and policy gradient approach, which seeks to approximate an unknown dynamical system and search for optimal policy simultaneously, using the observations gathered through interaction with the environment. The proposed algorithm has two innovations: first, it introduces the so-called deep Koopman representation into the policy gradient to achieve a linear approximation of the unknown dynamical system, all with the purpose of improving data efficiency; second, the accumulated errors for long-term tasks induced by approximating system dynamics are avoided by applying Bellman's principle of optimality. Furthermore, a theoretical analysis is provided to prove the asymptotic convergence of the proposed algorithm and characterize the corresponding sampling complexity. These conclusions are also supported by simulations on several challenging benchmark environments. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Disorder-enriched magnetic excitations in the Kitaev quantum spin liquid candidate Na$_2$Co$_2$TeO$_6$

Authors: Li Xiang, Ramesh Dhakal, Mykhaylo Ozerov, Yuxuan Jiang, Banasree S. Mou, Andrzej Ozarowski, Qing Huang, Haidong Zhou, Jiyuan Fang, Stephen M. Winter, Zhigang Jiang, Dmitry Smirnov

Abstract: Using optical magneto-spectroscopy, we investigate the magnetic excitations of Na$_2$Co$_2$TeO$_6$ in a broad magnetic field range ($0\ \rm{T}\leq B\leq 17.5\ \rm{T}$) at low temperature. Our measurements reveal rich spectra of in-plane magnetic excitations with a surprisingly large number of modes, even in the high-field spin-polarized state. Theoretical calculations find that the Na-occupation d… ▽ More Using optical magneto-spectroscopy, we investigate the magnetic excitations of Na$_2$Co$_2$TeO$_6$ in a broad magnetic field range ($0\ \rm{T}\leq B\leq 17.5\ \rm{T}$) at low temperature. Our measurements reveal rich spectra of in-plane magnetic excitations with a surprisingly large number of modes, even in the high-field spin-polarized state. Theoretical calculations find that the Na-occupation disorder in \NCTO plays a crucial role in generating these modes. Our work demonstrates the necessity to consider disorder in the spin environment in the search for Kitaev quantum spin liquid states in practicable materials. △ Less

Submitted 12 May, 2023; originally announced May 2023.

A Data-Driven Approach for Inverse Optimal Control

Authors: Zihao Liang, Wenjian Hao, Shaoshuai Mou

Abstract: This paper proposes a data-driven, iterative approach for inverse optimal control (IOC), which aims to learn the objective function of a nonlinear optimal control system given its states and inputs. The approach solves the IOC problem in a challenging situation when the system dynamics is unknown. The key idea of the proposed approach comes from the deep Koopman representation of the unknown syste… ▽ More This paper proposes a data-driven, iterative approach for inverse optimal control (IOC), which aims to learn the objective function of a nonlinear optimal control system given its states and inputs. The approach solves the IOC problem in a challenging situation when the system dynamics is unknown. The key idea of the proposed approach comes from the deep Koopman representation of the unknown system, which employs a deep neural network to represent observables for the Koopman operator. By assuming the objective function to be learned is parameterized as a linear combination of features with unknown weights, the proposed approach for IOC is able to achieve a Koopman representation of the unknown dynamics and the unknown weights in objective function together. Simulation is provided to verify the proposed approach. △ Less

Submitted 31 March, 2023; originally announced April 2023.

DrMaMP: Distributed Real-time Multi-agent Mission Planning in Cluttered Environment

Authors: Zehui Lu, Tianyu Zhou, Shaoshuai Mou

Abstract: Solving a collision-aware multi-agent mission planning (task allocation and path finding) problem is challenging due to the requirement of real-time computational performance, scalability, and capability of handling static/dynamic obstacles and tasks in a cluttered environment. This paper proposes a distributed real-time (on the order of millisecond) algorithm DrMaMP, which partitions the entire u… ▽ More Solving a collision-aware multi-agent mission planning (task allocation and path finding) problem is challenging due to the requirement of real-time computational performance, scalability, and capability of handling static/dynamic obstacles and tasks in a cluttered environment. This paper proposes a distributed real-time (on the order of millisecond) algorithm DrMaMP, which partitions the entire unassigned task set into subsets via approximation and decomposes the original problem into several single-agent mission planning problems. This paper presents experiments with dynamic obstacles and tasks and conducts optimality and scalability comparisons with an existing method, where DrMaMP outperforms the existing method in both indices. Finally, this paper analyzes the computational burden of DrMaMP which is consistent with the observations from comparisons, and presents the optimality gap in small-size problems. △ Less

Submitted 27 February, 2023; originally announced February 2023.

RGI: robust GAN-inversion for mask-free image inpainting and unsupervised pixel-wise anomaly detection

Authors: Shancong Mou, Xiaoyi Gu, Meng Cao, Haoping Bai, Ping Huang, Jiulong Shan, Jianjun Shi

Abstract: Generative adversarial networks (GANs), trained on a large-scale image dataset, can be a good approximator of the natural image manifold. GAN-inversion, using a pre-trained generator as a deep generative prior, is a promising tool for image restoration under corruptions. However, the performance of GAN-inversion can be limited by a lack of robustness to unknown gross corruptions, i.e., the restore… ▽ More Generative adversarial networks (GANs), trained on a large-scale image dataset, can be a good approximator of the natural image manifold. GAN-inversion, using a pre-trained generator as a deep generative prior, is a promising tool for image restoration under corruptions. However, the performance of GAN-inversion can be limited by a lack of robustness to unknown gross corruptions, i.e., the restored image might easily deviate from the ground truth. In this paper, we propose a Robust GAN-inversion (RGI) method with a provable robustness guarantee to achieve image restoration under unknown \textit{gross} corruptions, where a small fraction of pixels are completely corrupted. Under mild assumptions, we show that the restored image and the identified corrupted region mask converge asymptotically to the ground truth. Moreover, we extend RGI to Relaxed-RGI (R-RGI) for generator fine-tuning to mitigate the gap between the GAN learned manifold and the true image manifold while avoiding trivial overfitting to the corrupted input image, which further improves the image restoration and corrupted region mask identification performance. The proposed RGI/R-RGI method unifies two important applications with state-of-the-art (SOTA) performance: (i) mask-free semantic inpainting, where the corruptions are unknown missing regions, the restored background can be used to restore the missing content; (ii) unsupervised pixel-wise anomaly detection, where the corruptions are unknown anomalous regions, the retrieved mask can be used as the anomalous region's segmentation mask. △ Less

Submitted 24 February, 2023; originally announced February 2023.

Variable Sampling MPC via Differentiable Time-Warping Function

Authors: Zehui Lu, Shaoshuai Mou

Abstract: Designing control inputs for a system that involves dynamical responses in multiple timescales is nontrivial. This paper proposes a parameterized time-warping function to enable a non-uniformly sampling along a prediction horizon given some parameters. The horizon should capture the responses under faster dynamics in the near future and preview the impact from slower dynamics in the distant future… ▽ More Designing control inputs for a system that involves dynamical responses in multiple timescales is nontrivial. This paper proposes a parameterized time-warping function to enable a non-uniformly sampling along a prediction horizon given some parameters. The horizon should capture the responses under faster dynamics in the near future and preview the impact from slower dynamics in the distant future. Then a variable sampling MPC (VS-MPC) strategy is proposed to jointly determine optimal control and sampling parameters at each timestamp. VS-MPC adapts how it samples along the horizon and determines optimal control accordingly at each timestamp without offline tuning or trial and error. A numerical example of a wind farm battery energy storage system is also provided to demonstrate that VS-MPC outperforms the uniform sampling MPC. △ Less

Submitted 20 March, 2023; v1 submitted 19 January, 2023; originally announced January 2023.

Silicon-doped $β$-Ga$_2$O$_3$ films grown at 1 $μ$m/h by suboxide molecular-beam epitaxy

Authors: Kathy Azizie, Felix V. E. Hensling, Cameron A. Gorsak, Yunjo Kim, Daniel M. Dryden, M. K. Indika Senevirathna, Selena Coye, Shun-Li Shang, Jacob Steele, Patrick Vogt, Nicholas A. Parker, Yorick A. Birkhölzer, Jonathan P. McCandless, Debdeep Jena, Huili G. Xing, Zi-Kui Liu, Michael D. Williams, Andrew J. Green, Kelson Chabak, Adam T. Neal, Shin Mou, Michael O. Thompson, Hari P. Nair, Darrell G. Schlom

Abstract: We report the use of suboxide molecular-beam epitaxy (S-MBE) to grow $β$-Ga$_2$O$_3$ at a growth rate of ~1 $μ$m/h with control of the silicon doping concentration from 5x10$^{16}$ to 10$^{19}$ cm$^{-3}$. In S-MBE, pre-oxidized gallium in the form of a molecular beam that is 99.98\% Ga$_2$O, i.e., gallium suboxide, is supplied. Directly supplying Ga2O to the growth surface bypasses the rate-limiti… ▽ More We report the use of suboxide molecular-beam epitaxy (S-MBE) to grow $β$-Ga$_2$O$_3$ at a growth rate of ~1 $μ$m/h with control of the silicon doping concentration from 5x10$^{16}$ to 10$^{19}$ cm$^{-3}$. In S-MBE, pre-oxidized gallium in the form of a molecular beam that is 99.98\% Ga$_2$O, i.e., gallium suboxide, is supplied. Directly supplying Ga2O to the growth surface bypasses the rate-limiting first step of the two-step reaction mechanism involved in the growth of $β$-Ga$_2$O$_3$ by conventional MBE. As a result, a growth rate of ~1 $μ$m/h is readily achieved at a relatively low growth temperature (T$_{sub}$ = 525 $^\circ$C), resulting in films with high structural perfection and smooth surfaces (rms roughness of < 2 nm on ~1 $μ$m thick films). Silicon-containing oxide sources (SiO and SiO$_2$) producing an SiO suboxide molecular beam are used to dope the $β$-Ga$_2$O$_3$ layers. Temperature-dependent Hall effect measurements on a 1 $μ$m thick film with a mobile carrier concentration of 2.7x10$^{17}$ cm$^{-3}$ reveal a room-temperature mobility of 124 cm$^2$ V$^{-1}$ s$^{-1}$ that increases to 627 cm$^2$ V$^{-1}$ s$^{-1}$ at 76 K; the silicon dopants are found to exhibit an activation energy of 27 meV. We also demonstrate working MESFETs made from these silicon-doped $β$-Ga$_2$O$_3$ films grown by S-MBE at growth rates of ~1 $μ$m/h. △ Less

Submitted 22 December, 2022; originally announced December 2022.

Comments: 19 pages, 7 figures, 2 tables, 2 pages supplementary materials

Land Cover and Land Use Detection using Semi-Supervised Learning

Authors: Fahmida Tasnim Lisa, Md. Zarif Hossain, Sharmin Naj Mou, Shahriar Ivan, Md. Hasanul Kabir

Abstract: Semi-supervised learning (SSL) has made significant strides in the field of remote sensing. Finding a large number of labeled datasets for SSL methods is uncommon, and manually labeling datasets is expensive and time-consuming. Furthermore, accurately identifying remote sensing satellite images is more complicated than it is for conventional images. Class-imbalanced datasets are another prevalent… ▽ More Semi-supervised learning (SSL) has made significant strides in the field of remote sensing. Finding a large number of labeled datasets for SSL methods is uncommon, and manually labeling datasets is expensive and time-consuming. Furthermore, accurately identifying remote sensing satellite images is more complicated than it is for conventional images. Class-imbalanced datasets are another prevalent phenomenon, and models trained on these become biased towards the majority classes. This becomes a critical issue with an SSL model's subpar performance. We aim to address the issue of labeling unlabeled data and also solve the model bias problem due to imbalanced datasets while achieving better accuracy. To accomplish this, we create "artificial" labels and train a model to have reasonable accuracy. We iteratively redistribute the classes through resampling using a distribution alignment technique. We use a variety of class imbalanced satellite image datasets: EuroSAT, UCM, and WHU-RS19. On UCM balanced dataset, our method outperforms previous methods MSMatch and FixMatch by 1.21% and 0.6%, respectively. For imbalanced EuroSAT, our method outperforms MSMatch and FixMatch by 1.08% and 1%, respectively. Our approach significantly lessens the requirement for labeled data, consistently outperforms alternative approaches, and resolves the issue of model bias caused by class imbalance in datasets. △ Less

Submitted 21 December, 2022; originally announced December 2022.

Deep Koopman Learning of Nonlinear Time-Varying Systems

Authors: Wenjian Hao, Bowen Huang, Wei Pan, Di Wu, Shaoshuai Mou

Abstract: This paper presents a data-driven approach to approximate the dynamics of a nonlinear time-varying system (NTVS) by a linear time-varying system (LTVS), which is resulted from the Koopman operator and deep neural networks. Analysis of the approximation error between states of the NTVS and the resulting LTVS is presented. Simulations on a representative NTVS show that the proposed method achieves s… ▽ More This paper presents a data-driven approach to approximate the dynamics of a nonlinear time-varying system (NTVS) by a linear time-varying system (LTVS), which is resulted from the Koopman operator and deep neural networks. Analysis of the approximation error between states of the NTVS and the resulting LTVS is presented. Simulations on a representative NTVS show that the proposed method achieves small approximation errors, even when the system changes rapidly. Furthermore, simulations in an example of quadcopters demonstrate the computational efficiency of the proposed approach. △ Less

Submitted 21 June, 2023; v1 submitted 12 October, 2022; originally announced October 2022.

Cooperative Tuning of Multi-Agent Optimal Control Systems

Authors: Zehui Lu, Wanxin Jin, Shaoshuai Mou, Brian D. O. Anderson

Abstract: This paper investigates the problem of cooperative tuning of multi-agent optimal control systems, where a network of agents (i.e. multiple coupled optimal control systems) adjusts parameters in their dynamics, objective functions, or controllers in a coordinated way to minimize the sum of their loss functions. Different from classical techniques for tuning parameters in a controller, we allow tuna… ▽ More This paper investigates the problem of cooperative tuning of multi-agent optimal control systems, where a network of agents (i.e. multiple coupled optimal control systems) adjusts parameters in their dynamics, objective functions, or controllers in a coordinated way to minimize the sum of their loss functions. Different from classical techniques for tuning parameters in a controller, we allow tunable parameters appearing in both the system dynamics and the objective functions of each agent. A framework is developed to allow all agents to reach a consensus on the tunable parameter, which minimizes team loss. The key idea of the proposed algorithm rests on the integration of consensus-based distributed optimization for a multi-agent system and a gradient generator capturing the optimal performance as a function of the parameter in the feedback loop tuning the parameter for each agent. Both theoretical results and simulations for a synchronous multi-agent rendezvous problem are provided to validate the proposed method for cooperative tuning of multi-agent optimal control. △ Less

Submitted 24 September, 2022; originally announced September 2022.

Resilience for Distributed Consensus with Constraints

Authors: Xuan Wang, Shaoshuai Mou, Shreyas Sundaram

Abstract: This paper proposes a new approach that enables multi-agent systems to achieve resilient \textit{constrained} consensus in the presence of Byzantine attacks, in contrast to existing literature that is only applicable to \textit{unconstrained} resilient consensus problems. The key enabler for our approach is a new device called a \textit{$(γ_i,α_i)$-resilient convex combination}, which allows norma… ▽ More This paper proposes a new approach that enables multi-agent systems to achieve resilient \textit{constrained} consensus in the presence of Byzantine attacks, in contrast to existing literature that is only applicable to \textit{unconstrained} resilient consensus problems. The key enabler for our approach is a new device called a \textit{$(γ_i,α_i)$-resilient convex combination}, which allows normal agents in the network to utilize their locally available information to automatically isolate the impact of the Byzantine agents. Such a resilient convex combination is computable through linear programming, whose complexity scales well with the size of the overall system. By applying this new device to multi-agent systems, we introduce network and constraint redundancy conditions under which resilient constrained consensus can be achieved with an exponential convergence rate. We also provide insights on the design of a network such that the redundancy conditions are satisfied. Finally, numerical simulations and an example of safe multi-agent learning are provided to demonstrate the effectiveness of the proposed results. △ Less

Submitted 17 December, 2023; v1 submitted 12 June, 2022; originally announced June 2022.

Comments: 15 pages

Convex Relaxation for Optimal Fixture Layout Design

Authors: Zhen Zhong, Shancong Mou, Jeffrey H. Hunt, Jianjun Shi

Abstract: This paper proposes a general fixture layout design framework that directly integrates the system equation with the convex relaxation method. Note that the optimal fixture design problem is a large-scale combinatorial optimization problem, we relax it to a convex semidefinite programming (SDP) problem by adopting sparse learning and SDP relaxation techniques. It can be solved efficiently by existi… ▽ More This paper proposes a general fixture layout design framework that directly integrates the system equation with the convex relaxation method. Note that the optimal fixture design problem is a large-scale combinatorial optimization problem, we relax it to a convex semidefinite programming (SDP) problem by adopting sparse learning and SDP relaxation techniques. It can be solved efficiently by existing convex optimization algorithms and thus generates a near-optimal fixture layout. A real case study in the half-to-half fuselage assembly process indicates the superiority of our proposed algorithm compared to the current industry practice and state-of-art methods. △ Less

Submitted 6 June, 2022; originally announced June 2022.

Reconfigurable Robots for Scaling Reef Restoration

Authors: Serena Mou, Dorian Tsai, Matthew Dunbabin

Abstract: Coral reefs are under increasing threat from the impacts of climate change. Whilst current restoration approaches are effective, they require significant human involvement and equipment, and have limited deployment scale. Harvesting wild coral spawn from mass spawning events, rearing them to the larval stage and releasing the larvae onto degraded reefs is an emerging solution for reef restoration… ▽ More Coral reefs are under increasing threat from the impacts of climate change. Whilst current restoration approaches are effective, they require significant human involvement and equipment, and have limited deployment scale. Harvesting wild coral spawn from mass spawning events, rearing them to the larval stage and releasing the larvae onto degraded reefs is an emerging solution for reef restoration known as coral reseeding. This paper presents a reconfigurable autonomous surface vehicle system that can eliminate risky diving, cover greater areas with coral larvae, has a sensory suite for additional data measurement, and requires minimal non-technical expert training. A key feature is an on-board real-time benthic substrate classification model that predicts when to release larvae to increase settlement rate and ultimately, survivability. The presented robot design is reconfigurable, light weight, scalable, and easy to transport. Results from restoration deployments at Lizard Island demonstrate improved coral larvae release onto appropriate coral substrate, while also achieving 21.8 times more area coverage compared to manual methods. △ Less

Submitted 9 May, 2022; originally announced May 2022.

PAEDID: Patch Autoencoder Based Deep Image Decomposition For Pixel-level Defective Region Segmentation

Authors: Shancong Mou, Meng Cao, Haoping Bai, Ping Huang, Jianjun Shi, Jiulong Shan

Abstract: Unsupervised pixel-level defective region segmentation is an important task in image-based anomaly detection for various industrial applications. The state-of-the-art methods have their own advantages and limitations: matrix-decomposition-based methods are robust to noise but lack complex background image modeling capability; representation-based methods are good at defective region localization b… ▽ More Unsupervised pixel-level defective region segmentation is an important task in image-based anomaly detection for various industrial applications. The state-of-the-art methods have their own advantages and limitations: matrix-decomposition-based methods are robust to noise but lack complex background image modeling capability; representation-based methods are good at defective region localization but lack accuracy in defective region shape contour extraction; reconstruction-based methods detected defective region match well with the ground truth defective region shape contour but are noisy. To combine the best of both worlds, we present an unsupervised patch autoencoder based deep image decomposition (PAEDID) method for defective region segmentation. In the training stage, we learn the common background as a deep image prior by a patch autoencoder (PAE) network. In the inference stage, we formulate anomaly detection as an image decomposition problem with the deep image prior and domain-specific regularizations. By adopting the proposed approach, the defective regions in the image can be accurately extracted in an unsupervised fashion. We demonstrate the effectiveness of the PAEDID method in simulation studies and an industrial dataset in the case study. △ Less

Submitted 7 November, 2022; v1 submitted 27 March, 2022; originally announced March 2022.

Synthetic Defect Generation for Display Front-of-Screen Quality Inspection: A Survey

Authors: Shancong Mou, Meng Cao, Zhendong Hong, Ping Huang, Jiulong Shan, Jianjun Shi

Abstract: Display front-of-screen (FOS) quality inspection is essential for the mass production of displays in the manufacturing process. However, the severe imbalanced data, especially the limited number of defect samples, has been a long-standing problem that hinders the successful application of deep learning algorithms. Synthetic defect data generation can help address this issue. This paper reviews the… ▽ More Display front-of-screen (FOS) quality inspection is essential for the mass production of displays in the manufacturing process. However, the severe imbalanced data, especially the limited number of defect samples, has been a long-standing problem that hinders the successful application of deep learning algorithms. Synthetic defect data generation can help address this issue. This paper reviews the state-of-the-art synthetic data generation methods and the evaluation metrics that can potentially be applied to display FOS quality inspection tasks. △ Less

Submitted 3 March, 2022; originally announced March 2022.

Compressed Smooth Sparse Decomposition

Authors: Shancong Mou, Jianjun Shi

Abstract: Image-based anomaly detection systems are of vital importance in various manufacturing applications. The resolution and acquisition rate of such systems is increasing significantly in recent years under the fast development of image sensing technology. This enables the detection of tiny defects in real-time. However, such a high resolution and acquisition rate of image data not only slows down the… ▽ More Image-based anomaly detection systems are of vital importance in various manufacturing applications. The resolution and acquisition rate of such systems is increasing significantly in recent years under the fast development of image sensing technology. This enables the detection of tiny defects in real-time. However, such a high resolution and acquisition rate of image data not only slows down the speed of image processing algorithms but also increases data storage and transmission cost. To tackle this problem, we propose a fast and data-efficient method with theoretical performance guarantee that is suitable for sparse anomaly detection in images with a smooth background (smooth plus sparse signal). The proposed method, named Compressed Smooth Sparse Decomposition (CSSD), is a one-step method that unifies the compressive image acquisition and decomposition-based image processing techniques. To further enhance its performance in a high-dimensional scenario, a Kronecker Compressed Smooth Sparse Decomposition (KronCSSD) method is proposed. Compared to traditional smooth and sparse decomposition algorithms, significant transmission cost reduction and computational speed boost can be achieved with negligible performance loss. Simulation examples and several case studies in various applications illustrate the effectiveness of the proposed framework. △ Less

Submitted 15 July, 2022; v1 submitted 18 January, 2022; originally announced January 2022.

Consensus-based Distributed Optimization Enhanced by Integral Feedback

Authors: Xuan Wang, Shaoshuai Mou, Brian. D. O. Anderson

Abstract: Inspired and underpinned by the idea of integral feedback, a distributed constant gain algorithm is proposed for multi-agent networks to solve convex optimization problems with local linear constraints. Assuming agent interactions are modeled by an undirected graph, the algorithm is capable of achieving the optimum solution with an exponential convergence rate. Furthermore, inherited from the bene… ▽ More Inspired and underpinned by the idea of integral feedback, a distributed constant gain algorithm is proposed for multi-agent networks to solve convex optimization problems with local linear constraints. Assuming agent interactions are modeled by an undirected graph, the algorithm is capable of achieving the optimum solution with an exponential convergence rate. Furthermore, inherited from the beneficial integral feedback, the proposed algorithm has attractive requirements on communication bandwidth and good robustness against disturbance. Both analytical proof and numerical simulations are provided to validate the effectiveness of the proposed distributed algorithms in solving constrained optimization problems. △ Less

Submitted 17 November, 2021; originally announced November 2021.

Comments: 12 pages

Stationary Behavior of Constant Stepsize SGD Type Algorithms: An Asymptotic Characterization

Authors: Zaiwei Chen, Shancong Mou, Siva Theja Maguluri

Abstract: Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferred in practice due to fast convergence behavior. However, constant step stochastic iterative algorithms do not converge asymptotically to the optimal solution, but instead have a stationary distribution, which in general… ▽ More Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferred in practice due to fast convergence behavior. However, constant step stochastic iterative algorithms do not converge asymptotically to the optimal solution, but instead have a stationary distribution, which in general cannot be analytically characterized. In this work, we study the asymptotic behavior of the appropriately scaled stationary distribution, in the limit when the constant stepsize goes to zero. Specifically, we consider the following three settings: (1) SGD algorithms with smooth and strongly convex objective, (2) linear SA algorithms involving a Hurwitz matrix, and (3) nonlinear SA algorithms involving a contractive operator. When the iterate is scaled by $1/\sqrtα$, where $α$ is the constant stepsize, we show that the limiting scaled stationary distribution is a solution of an integral equation. Under a uniqueness assumption (which can be removed in certain settings) on this equation, we further characterize the limiting distribution as a Gaussian distribution whose covariance matrix is the unique solution of a suitable Lyapunov equation. For SA algorithms beyond these cases, our numerical experiments suggest that unlike central limit theorem type results: (1) the scaling factor need not be $1/\sqrtα$, and (2) the limiting distribution need not be Gaussian. Based on the numerical study, we come up with a formula to determine the right scaling factor, and make insightful connection to the Euler-Maruyama discretization scheme for approximating stochastic differential equations. △ Less

Submitted 11 November, 2021; originally announced November 2021.

Safe Pontryagin Differentiable Programming

Authors: Wanxin Jin, Shaoshuai Mou, George J. Pappas

Abstract: We propose a Safe Pontryagin Differentiable Programming (Safe PDP) methodology, which establishes a theoretical and algorithmic framework to solve a broad class of safety-critical learning and control tasks -- problems that require the guarantee of safety constraint satisfaction at any stage of the learning and control progress. In the spirit of interior-point methods, Safe PDP handles different t… ▽ More We propose a Safe Pontryagin Differentiable Programming (Safe PDP) methodology, which establishes a theoretical and algorithmic framework to solve a broad class of safety-critical learning and control tasks -- problems that require the guarantee of safety constraint satisfaction at any stage of the learning and control progress. In the spirit of interior-point methods, Safe PDP handles different types of system constraints on states and inputs by incorporating them into the cost or loss through barrier functions. We prove three fundamentals of the proposed Safe PDP: first, both the solution and its gradient in the backward pass can be approximated by solving their more efficient unconstrained counterparts; second, the approximation for both the solution and its gradient can be controlled for arbitrary accuracy by a barrier parameter; and third, importantly, all intermediate results throughout the approximation and optimization strictly respect the constraints, thus guaranteeing safety throughout the entire learning and control process. We demonstrate the capabilities of Safe PDP in solving various safety-critical tasks, including safe policy optimization, safe motion planning, and learning MPCs from demonstrations, on different challenging systems such as 6-DoF maneuvering quadrotor and 6-DoF rocket powered landing. △ Less

Submitted 25 October, 2021; v1 submitted 31 May, 2021; originally announced May 2021.

Comments: This paper has been accepted by NeurIPS 2021

Dynamic Texture Synthesis by Incorporating Long-range Spatial and Temporal Correlations

Authors: Kaitai Zhang, Bin Wang, Hong-Shuo Chen, Ye Wang, Shiyu Mou, C. -C. Jay Kuo

Abstract: The main challenge of dynamic texture synthesis lies in how to maintain spatial and temporal consistency in synthesized videos. The major drawback of existing dynamic texture synthesis models comes from poor treatment of the long-range texture correlation and motion information. To address this problem, we incorporate a new loss term, called the Shifted Gram loss, to capture the structural and lon… ▽ More The main challenge of dynamic texture synthesis lies in how to maintain spatial and temporal consistency in synthesized videos. The major drawback of existing dynamic texture synthesis models comes from poor treatment of the long-range texture correlation and motion information. To address this problem, we incorporate a new loss term, called the Shifted Gram loss, to capture the structural and long-range correlation of the reference texture video. Furthermore, we introduce a frame sampling strategy to exploit long-period motion across multiple frames. With these two new techniques, the application scope of existing texture synthesis models can be extended. That is, they can synthesize not only homogeneous but also structured dynamic texture patterns. Thorough experimental results are provided to demonstrate that our proposed dynamic texture synthesis model offers state-of-the-art visual performance. △ Less

Submitted 14 April, 2021; v1 submitted 13 April, 2021; originally announced April 2021.

Comments: 7 pages, 6 figures

Towards Resilience for Multi-Agent $QD$-Learning

Authors: Yijing Xie, Shaoshuai Mou, Shreyas Sundaram

Abstract: This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in the network to behave in an arbitrary and adversarial manner (as captured by the Byzantine attack model). Under the proposed algorithm, if the network topology is… ▽ More This paper considers the multi-agent reinforcement learning (MARL) problem for a networked (peer-to-peer) system in the presence of Byzantine agents. We build on an existing distributed $Q$-learning algorithm, and allow certain agents in the network to behave in an arbitrary and adversarial manner (as captured by the Byzantine attack model). Under the proposed algorithm, if the network topology is $(2F+1)$-robust and up to $F$ Byzantine agents exist in the neighborhood of each regular agent, we establish the almost sure convergence of all regular agents' value functions to the neighborhood of the optimal value function of all regular agents. For each state, if the optimal $Q$-values of all regular agents corresponding to different actions are sufficiently separated, our approach allows each regular agent to learn the optimal policy for all regular agents. △ Less

Submitted 7 April, 2021; originally announced April 2021.

$γ$-phase Inclusions as Common Defects in Alloyed $β$-(Al$_x$Ga$_{1\text{-}x}$)$_2$O$_3$ and Doped $β$-Ga$_2$O$_3$ Films

Authors: Celesta S. Chang, Nicholas Tanen, Vladimir Protasenko, Thaddeus J. Asel, Shin Mou, Huili Grace Xing, Debdeep Jena, David A. Muller

Abstract: $β$-Ga$_2$O$_3$ is a promising ultra-wide bandgap semiconductor whose properties can be further enhanced by alloying with Al. Here, using atomic-resolution scanning transmission electron microscopy (STEM), we find the thermodynamically-unstable $γ$-phase is a ubiquitous defect in both $β$-(Al$_x$Ga$_{1\text{-}x}$)$_2$O$_3$ films and doped $β$-Ga$_2$O$_3… ▽ More $β$-Ga$_2$O$_3$ is a promising ultra-wide bandgap semiconductor whose properties can be further enhanced by alloying with Al. Here, using atomic-resolution scanning transmission electron microscopy (STEM), we find the thermodynamically-unstable $γ$-phase is a ubiquitous defect in both $β$-(Al$_x$Ga$_{1\text{-}x}$)$_2$O$_3$ films and doped $β$-Ga$_2$O$_3$ films grown by molecular beam epitaxy. For undoped $β$-(Al$_x$Ga$_{1\text{-}x}$)$_2$O$_3$ films we observe $γ$-phase inclusions between nucleating islands of the $β$-phase at lower growth temperatures (~400-600 $^{\circ}$C). In doped $β$-Ga$_2$O$_3$, a thin layer of the $γ$-phase is observed on the surfaces of films grown with a wide range of n-type dopants and dopant concentrations. The thickness of the $γ$-phase layer was most strongly correlated with the growth temperature, peaking at about 600 $^{\circ}$C. Ga interstitials are observed in $β$-phase, especially near the interface with the $γ$-phase. By imaging the same region of the surface of a Sn-doped $β$-(Al$_x$Ga$_{1\text{-}x}$)$_2$O$_3$ after ex-situ heating up to 400 $^{\circ}$C, a $γ$-phase region is observed to grow above the initial surface, accompanied by a decrease in Ga interstitials in the $β$-phase. This suggests that the diffusion of Ga interstitials towards the surface is likely the mechanism for growth of the surface $γ$-phase, and more generally that the more-open $γ$-phase may offer diffusion pathways to be a kinetically-favored and early-forming phase in the growth of Ga$_2$O$_3$. △ Less

Submitted 30 November, 2020; originally announced December 2020.

Learning from Human Directional Corrections

Authors: Wanxin Jin, Todd D. Murphey, Zehui Lu, Shaoshuai Mou

Abstract: This paper proposes a novel approach that enables a robot to learn an objective function incrementally from human directional corrections. Existing methods learn from human magnitude corrections; since a human needs to carefully choose the magnitude of each correction, those methods can easily lead to over-corrections and learning inefficiency. The proposed method only requires human directional c… ▽ More This paper proposes a novel approach that enables a robot to learn an objective function incrementally from human directional corrections. Existing methods learn from human magnitude corrections; since a human needs to carefully choose the magnitude of each correction, those methods can easily lead to over-corrections and learning inefficiency. The proposed method only requires human directional corrections -- corrections that only indicate the direction of an input change without indicating its magnitude. We only assume that each correction, regardless of its magnitude, points in a direction that improves the robot's current motion relative to an unknown objective function. The allowable corrections satisfying this assumption account for half of the input space, as opposed to the magnitude corrections which have to lie in a shrinking level set. For each directional correction, the proposed method updates the estimate of the objective function based on a cutting plane method, which has a geometric interpretation. We have established theoretical results to show the convergence of the learning process. The proposed method has been tested in numerical examples, a user study on two human-robot games, and a real-world quadrotor experiment. The results confirm the convergence of the proposed method and further show that the method is significantly more effective (higher success rate), efficient/effortless (less human corrections needed), and potentially more accessible (fewer early wasted trials) than the state-of-the-art robot learning frameworks. △ Less

Submitted 5 August, 2022; v1 submitted 30 November, 2020; originally announced November 2020.

Comments: This is a preprint. The published version can be accessed at IEEE Transactions on Robotics

Adsorption-Controlled Growth of Ga2O3 by Suboxide Molecular-Beam Epitaxy

Authors: Patrick Vogt, Felix V. E. Hensling, Kathy Azizie, Celesta S. Chang, David Turner, Jisung Park, Jonathan P. McCandless, Hanjong Paik, Brandon J. Bocklund, Georg Hoffman, Oliver Bierwagen, Debdeep Jena, Huili G. Xing, Shin Mou, David A. Muller, Shun-Li Shang, Zi-Kui Liu, Darrell G. Schlom

Abstract: This paper introduces a growth method---suboxide molecular-beam epitaxy (S-MBE)---which enables the growth of Ga2O3 and related materials at growth rates exceeding 1 micrometer per hours with excellent crystallinity in an adsorptioncontrolled regime. Using a Ga + Ga2O3 mixture with an oxygen mole fraction of x(O) = 0.4 as an MBE source, we overcome kinetic limits that had previously hampered the a… ▽ More This paper introduces a growth method---suboxide molecular-beam epitaxy (S-MBE)---which enables the growth of Ga2O3 and related materials at growth rates exceeding 1 micrometer per hours with excellent crystallinity in an adsorptioncontrolled regime. Using a Ga + Ga2O3 mixture with an oxygen mole fraction of x(O) = 0.4 as an MBE source, we overcome kinetic limits that had previously hampered the adsorption-controlled growth of Ga2O3 by MBE. We present growth rates up to 1.6 micrometer per hour for Ga2O3--Al2O3 heterostructures with unprecedented crystalline quality and also at unparalleled low growth temperature for this level of perfection. We combine thermodynamic knowledge of how to create molecular-beams of targeted suboxides with a kinetic model developed for the S-MBE of III-VI compounds to identify appropriate growth conditions. Using S-MBE we demonstrate the growth of phase-pure, smooth, and high-purity homoepitaxial Ga2O3 films that are thicker than 4 micrometer. With the high growth rate of S-MBE we anticipate a significant improvement to vertical Ga2O3-based devices. We describe and demonstrate how this growth method can be applied to a wide-range of oxides. S-MBE rivals leading synthesis methods currently used for the production of Ga2O3-based devices. △ Less

Submitted 30 October, 2020; originally announced November 2020.

Comments: 15 pages, 12 figures

Learning Objective Functions Incrementally by Inverse Optimal Control

Authors: Zihao Liang, Wanxin Jin, Shaoshuai Mou

Abstract: This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory segments is enlarged because additional segments are provided as time evolves. The unknown objective function is parameterized as a weighted sum of features with… ▽ More This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory segments is enlarged because additional segments are provided as time evolves. The unknown objective function is parameterized as a weighted sum of features with unknown weights. Each trajectory segment is a small snippet of optimal trajectory. The proposed method shows that each trajectory segment, if informative, can pose a linear constraint to the unknown weights, thus, the objective function can be learned by incrementally incorporating all informative segments. Effectiveness of the method is shown on a simulated 2-link robot arm and a 6-DoF maneuvering quadrotor system, in each of which only small demonstration segments are available. △ Less

Submitted 1 February, 2022; v1 submitted 28 October, 2020; originally announced October 2020.

Learning from Sparse Demonstrations

Authors: Wanxin Jin, Todd D. Murphey, Dana Kulić, Neta Ezer, Shaoshuai Mou

Abstract: This paper develops the method of Continuous Pontryagin Differentiable Programming (Continuous PDP), which enables a robot to learn an objective function from a few sparsely demonstrated keyframes. The keyframes, labeled with some time stamps, are the desired task-space outputs, which a robot is expected to follow sequentially. The time stamps of the keyframes can be different from the time of the… ▽ More This paper develops the method of Continuous Pontryagin Differentiable Programming (Continuous PDP), which enables a robot to learn an objective function from a few sparsely demonstrated keyframes. The keyframes, labeled with some time stamps, are the desired task-space outputs, which a robot is expected to follow sequentially. The time stamps of the keyframes can be different from the time of the robot's actual execution. The method jointly finds an objective function and a time-warping function such that the robot's resulting trajectory sequentially follows the keyframes with minimal discrepancy loss. The Continuous PDP minimizes the discrepancy loss using projected gradient descent, by efficiently solving the gradient of the robot trajectory with respect to the unknown parameters. The method is first evaluated on a simulated robot arm and then applied to a 6-DoF quadrotor to learn an objective function for motion planning in unmodeled environments. The results show the efficiency of the method, its ability to handle time misalignment between keyframes and robot execution, and the generalization of objective learning into unseen motion conditions. △ Less

Submitted 8 August, 2022; v1 submitted 5 August, 2020; originally announced August 2020.

Comments: This is a preprint. The published version can be accessed at IEEE Transactions on Robotics

Additive Tensor Decomposition Considering Structural Data Information

Authors: Shancong Mou, Andi Wang, Chuck Zhang, Jianjun Shi

Abstract: Tensor data with rich structural information becomes increasingly important in process modeling, monitoring, and diagnosis. Here structural information is referred to structural properties such as sparsity, smoothness, low-rank, and piecewise constancy. To reveal useful information from tensor data, we propose to decompose the tensor into the summation of multiple components based on different str… ▽ More Tensor data with rich structural information becomes increasingly important in process modeling, monitoring, and diagnosis. Here structural information is referred to structural properties such as sparsity, smoothness, low-rank, and piecewise constancy. To reveal useful information from tensor data, we propose to decompose the tensor into the summation of multiple components based on different structural information of them. In this paper, we provide a new definition of structural information in tensor data. Based on it, we propose an additive tensor decomposition (ATD) framework to extract useful information from tensor data. This framework specifies a high dimensional optimization problem to obtain the components with distinct structural information. An alternating direction method of multipliers (ADMM) algorithm is proposed to solve it, which is highly parallelable and thus suitable for the proposed optimization problem. Two simulation examples and a real case study in medical image analysis illustrate the versatility and effectiveness of the ATD framework. △ Less

Submitted 27 July, 2020; originally announced July 2020.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Neural Certificates for Safe Control Policies

Authors: Wanxin Jin, Zhaoran Wang, Zhuoran Yang, Shaoshuai Mou

Abstract: This paper develops an approach to learn a policy of a dynamical system that is guaranteed to be both provably safe and goal-reaching. Here, the safety means that a policy must not drive the state of the system to any unsafe region, while the goal-reaching requires the trajectory of the controlled system asymptotically converges to a goal region (a generalization of stability). We obtain the safe… ▽ More This paper develops an approach to learn a policy of a dynamical system that is guaranteed to be both provably safe and goal-reaching. Here, the safety means that a policy must not drive the state of the system to any unsafe region, while the goal-reaching requires the trajectory of the controlled system asymptotically converges to a goal region (a generalization of stability). We obtain the safe and goal-reaching policy by jointly learning two additional certificate functions: a barrier function that guarantees the safety and a developed Lyapunov-like function to fulfill the goal-reaching requirement, both of which are represented by neural networks. We show the effectiveness of the method to learn both safe and goal-reaching policies on various systems, including pendulums, cart-poles, and UAVs. △ Less

Submitted 15 June, 2020; originally announced June 2020.

Heavy Traffic Queue Length Behaviour in a Switch under Markovian Arrivals

Authors: Shancong Mou, Siva Theja Maguluri

Abstract: This paper studies the input queued switch operating under the MaxWeight algorithm when the arrivals are according to a Markovian process. We exactly characterize the heavy-traffic scaled mean sum queue length in the heavy-traffic limit, and shows that it is within a factor of less than $2$ from a universal lower bound. Moreover, we obtain lower and upper bounds, that are applicable in all traffic… ▽ More This paper studies the input queued switch operating under the MaxWeight algorithm when the arrivals are according to a Markovian process. We exactly characterize the heavy-traffic scaled mean sum queue length in the heavy-traffic limit, and shows that it is within a factor of less than $2$ from a universal lower bound. Moreover, we obtain lower and upper bounds, that are applicable in all traffic regimes, and they become tight in the heavy-traffic regime. The paper obtains these results by generalizing the drift method recently developed for the case of i.i.d. arrivals, to the case of Markovian arrivals. The paper illustrates this generalization by first obtaining the heavy-traffic mean queue length and its distribution in a single server queue under Markovian arrivals and then applying it to the case of input queued switch. The key idea is to exploit the geometric mixing of finite-state Markov chains, and to work with a time horizon that is picked so that the error due to mixing depends on the heavy-traffic parameter. △ Less

Submitted 6 December, 2023; v1 submitted 10 June, 2020; originally announced June 2020.

Distributed traffic control for a large-scale urban network

Authors: Viet Hoang Pham, Kazunori Sakurama, Shaoshuai Mou, Hyo-Sung Ahn

Abstract: Motivated by the fact that intelligent traffic control systems have become inevitable demand to cope with the risk of traffic congestion in urban areas, this paper develops a distributed control strategy for urban traffic networks. Since these networks contain a large number of roads having different directions, each of them can be described as a multi-agent system. Thus, a coordination among traf… ▽ More Motivated by the fact that intelligent traffic control systems have become inevitable demand to cope with the risk of traffic congestion in urban areas, this paper develops a distributed control strategy for urban traffic networks. Since these networks contain a large number of roads having different directions, each of them can be described as a multi-agent system. Thus, a coordination among traffic flows is required to optimize the operation of the overall network. In order to determine control decisions, we describe the objective of improving traffic conditions as a constrained optimization problem with respect to downstream traffic flows. By applying the gradient projection method and the minimal polynomial of a matrix pair, we propose algorithms that allow each road cell to determine its control decision corresponding to the optimal solution while using only its local information. The effectiveness of our proposed algorithms is validated by numerical simulations. △ Less

Submitted 5 May, 2020; originally announced May 2020.

Zeeman Spin-Splitting in the (010) $β$-Ga2O3 Two-Dimensional Electron Gas

Authors: Adam T. Neal, Yuewei Zhang, Said Elhamri, Siddharth Rajan, Shin Mou

Abstract: Through magneto-transport measurements and analysis of the observed Shubnikov de Haas oscillations in (010) (AlxGa1-x)2O3/Ga2O3 heterostructures, spin-splitting of the Landau levels in the (010) Ga2O3 two-dimensional electron gas (2DEG) has been studied. Analysis indicates that the spin-splitting results from the Zeeman effect. By fitting the both the first and second harmonic of the oscillations… ▽ More Through magneto-transport measurements and analysis of the observed Shubnikov de Haas oscillations in (010) (AlxGa1-x)2O3/Ga2O3 heterostructures, spin-splitting of the Landau levels in the (010) Ga2O3 two-dimensional electron gas (2DEG) has been studied. Analysis indicates that the spin-splitting results from the Zeeman effect. By fitting the both the first and second harmonic of the oscillations as a function of magnetic field, we determine the magnitude of the Zeeman splitting to be 0.4$\hbarω_c$, with a corresponding effective g-factor of 2.7, for magnetic field perpendicular to the 2DEG. △ Less

Submitted 6 January, 2020; originally announced January 2020.

Comments: 7 pages, 5 figures

Journal ref: Appl. Phys. Lett. 115, 262103 (2019)

Resilient Cyberphysical Systems and their Application Drivers: A Technology Roadmap

Authors: Somali Chaterji, Parinaz Naghizadeh, Muhammad Ashraful Alam, Saurabh Bagchi, Mung Chiang, David Corman, Brian Henz, Suman Jana, Na Li, Shaoshuai Mou, Meeko Oishi, Chunyi Peng, Tiark Rompf, Ashutosh Sabharwal, Shreyas Sundaram, James Weimer, Jennifer Weller

Abstract: Cyberphysical systems (CPS) are ubiquitous in our personal and professional lives, and they promise to dramatically improve micro-communities (e.g., urban farms, hospitals), macro-communities (e.g., cities and metropolises), urban structures (e.g., smart homes and cars), and living structures (e.g., human bodies, synthetic genomes). The question that we address in this article pertains to designin… ▽ More Cyberphysical systems (CPS) are ubiquitous in our personal and professional lives, and they promise to dramatically improve micro-communities (e.g., urban farms, hospitals), macro-communities (e.g., cities and metropolises), urban structures (e.g., smart homes and cars), and living structures (e.g., human bodies, synthetic genomes). The question that we address in this article pertains to designing these CPS systems to be resilient-from-the-ground-up, and through progressive learning, resilient-by-reaction. An optimally designed system is resilient to both unique attacks and recurrent attacks, the latter with a lower overhead. Overall, the notion of resilience can be thought of in the light of three main sources of lack of resilience, as follows: exogenous factors, such as natural variations and attack scenarios; mismatch between engineered designs and exogenous factors ranging from DDoS (distributed denial-of-service) attacks or other cybersecurity nightmares, so called "black swan" events, disabling critical services of the municipal electrical grids and other connected infrastructures, data breaches, and network failures; and the fragility of engineered designs themselves encompassing bugs, human-computer interactions (HCI), and the overall complexity of real-world systems. In the paper, our focus is on design and deployment innovations that are broadly applicable across a range of CPS application areas. △ Less

Submitted 19 December, 2019; originally announced January 2020.

Comments: 36 pages, 2 figures, NSF-supported workshop on Grand Challenges in Resilience, held at Purdue, March 20-21, 2019

MSC Class: C.5.3; D.4.5; H.4.0 ACM Class: C.5.3; D.4.5; H.4.0

Pontryagin Differentiable Programming: An End-to-End Learning and Control Framework

Authors: Wanxin Jin, Zhaoran Wang, Zhuoran Yang, Shaoshuai Mou

Abstract: This paper develops a Pontryagin Differentiable Programming (PDP) methodology, which establishes a unified framework to solve a broad class of learning and control tasks. The PDP distinguishes from existing methods by two novel techniques: first, we differentiate through Pontryagin's Maximum Principle, and this allows to obtain the analytical derivative of a trajectory with respect to tunable para… ▽ More This paper develops a Pontryagin Differentiable Programming (PDP) methodology, which establishes a unified framework to solve a broad class of learning and control tasks. The PDP distinguishes from existing methods by two novel techniques: first, we differentiate through Pontryagin's Maximum Principle, and this allows to obtain the analytical derivative of a trajectory with respect to tunable parameters within an optimal control system, enabling end-to-end learning of dynamics, policies, or/and control objective functions; and second, we propose an auxiliary control system in the backward pass of the PDP framework, and the output of this auxiliary control system is the analytical derivative of the original system's trajectory with respect to the parameters, which can be iteratively solved using standard control tools. We investigate three learning modes of the PDP: inverse reinforcement learning, system identification, and control/planning. We demonstrate the capability of the PDP in each learning mode on different high-dimensional systems, including multi-link robot arm, 6-DoF maneuvering quadrotor, and 6-DoF rocket powered landing. △ Less

Submitted 12 January, 2021; v1 submitted 30 December, 2019; originally announced December 2019.

Comments: Published in NeurIPS 2020, Codes are at https://github.com/wanxinjin/Pontryagin-Differentiable-Programming

Grand Challenges in Resilience: Autonomous System Resilience through Design and Runtime Measures

Authors: Saurabh Bagchi, Vaneet Aggarwal, Somali Chaterji, Fred Douglis, Aly El Gamal, Jiawei Han, Brian J. Henz, Hank Hoffmann, Suman Jana, Milind Kulkarni, Felix Xiaozhu Lin, Karen Marais, Prateek Mittal, Shaoshuai Mou, Xiaokang Qiu, Gesualdo Scutari

Abstract: A set of about 80 researchers, practitioners, and federal agency program managers participated in the NSF-sponsored Grand Challenges in Resilience Workshop held on Purdue campus on March 19-21, 2019. The workshop was divided into three themes: resilience in cyber, cyber-physical, and socio-technical systems. About 30 attendees in all participated in the discussions of cyber resilience. This articl… ▽ More A set of about 80 researchers, practitioners, and federal agency program managers participated in the NSF-sponsored Grand Challenges in Resilience Workshop held on Purdue campus on March 19-21, 2019. The workshop was divided into three themes: resilience in cyber, cyber-physical, and socio-technical systems. About 30 attendees in all participated in the discussions of cyber resilience. This article brings out the substantive parts of the challenges and solution approaches that were identified in the cyber resilience theme. In this article, we put forward the substantial challenges in cyber resilience in a few representative application domains and outline foundational solutions to address these challenges. These solutions fall into two broad themes: resilience-by-design and resilience-by-reaction. We use examples of autonomous systems as the application drivers motivating cyber resilience. We focus on some autonomous systems in the near horizon (autonomous ground and aerial vehicles) and also a little more distant (autonomous rescue and relief). For resilience-by-design, we focus on design methods in software that are needed for our cyber systems to be resilient. In contrast, for resilience-by-reaction, we discuss how to make systems resilient by responding, reconfiguring, or recovering at runtime when failures happen. We also discuss the notion of adaptive execution to improve resilience, execution transparently and adaptively among available execution platforms (mobile/embedded, edge, and cloud). For each of the two themes, we survey the current state, and the desired state and ways to get there. We conclude the paper by looking at the research challenges we will have to solve in the short and the mid-term to make the vision of resilient autonomous systems a reality. △ Less

Submitted 9 May, 2020; v1 submitted 25 December, 2019; originally announced December 2019.

ACM Class: C.4; D.4.5

Journal ref: IEEE Open Journal of the Computer Society, 2020

Sim-to-Real Transfer of Robot Learning with Variable Length Inputs

Authors: Vibhavari Dasagi, Robert Lee, Serena Mou, Jake Bruce, Niko Sünderhauf, Jürgen Leitner

Abstract: Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating prior knowledge. This results in prohibitively long training times for use on real-world robotic tasks. Existing algorithms capable of extracting task-level repr… ▽ More Current end-to-end deep Reinforcement Learning (RL) approaches require jointly learning perception, decision-making and low-level control from very sparse reward signals and high-dimensional inputs, with little capability of incorporating prior knowledge. This results in prohibitively long training times for use on real-world robotic tasks. Existing algorithms capable of extracting task-level representations from high-dimensional inputs, e.g. object detection, often produce outputs of varying lengths, restricting their use in RL methods due to the need for neural networks to have fixed length inputs. In this work, we propose a framework that combines deep sets encoding, which allows for variable-length abstract representations, with modular RL that utilizes these representations, decoupling high-level decision making from low-level control. We successfully demonstrate our approach on the robot manipulation task of object sorting, showing that this method can learn effective policies within mere minutes of highly simplified simulation. The learned policies can be directly deployed on a robot without further training, and generalize to variations of the task unseen during training. △ Less

Submitted 8 October, 2019; v1 submitted 20 September, 2018; originally announced September 2018.

Donors and Deep Acceptors in $β$-Ga2O3

Authors: Adam T. Neal, Shin Mou, Subrina Rafique, Hongping Zhao, Elaheh Ahmadi, James S. Speck, Kevin T. Stevens, John D. Blevins, Darren B. Thomson, Neil Moser, Kelson D. Chabak, Gregg H. Jessen

Abstract: We have studied the properties of Si, Ge shallow donors and Fe, Mg deep acceptors in $β$-Ga2O3 through temperature dependent van der Pauw and Hall effect measurements of samples grown by a variety of methods, including edge-defined film-fed (EFG), Czochralski (CZ), molecular beam epitaxy (MBE), and low pressure chemical vapor deposition (LPCVD). Through simultaneous, self-consistent fitting of the… ▽ More We have studied the properties of Si, Ge shallow donors and Fe, Mg deep acceptors in $β$-Ga2O3 through temperature dependent van der Pauw and Hall effect measurements of samples grown by a variety of methods, including edge-defined film-fed (EFG), Czochralski (CZ), molecular beam epitaxy (MBE), and low pressure chemical vapor deposition (LPCVD). Through simultaneous, self-consistent fitting of the temperature dependent carrier density and mobility, we are able to accurately estimate the donor energy of Si and Ge to be 30 meV in $β$-Ga2O3. Additionally, we show that our measured Hall effect data are consistent with Si and Ge acting as typical shallow donors, rather than shallow DX centers. High temperature Hall effect measurement of Fe doped $β$-Ga2O3 indicates that the material remains weakly n-type even with the Fe doping, with an acceptor energy of 860 meV relative to the conduction band for the Fe deep acceptor. Van der Pauw measurements of Mg doped Ga2O3 indicate an activation energy of 1.1 eV, as determined from the temperature dependent conductivity. △ Less

Submitted 4 September, 2018; originally announced September 2018.

Comments: 19 pages, 6 figures

Journal ref: Appl. Phys. Lett. 113, 062101 (2018)

On the stability and applications of distance-based flexible formations

Authors: Hector Garcia de Marina, Zhiyong Sun, Shaoshuai Mou

Abstract: This paper investigates the stability of distance-based \textit{flexible} undirected formations in the plane. Without rigidity, there exists a set of connected shapes for given distance constraints, which is called the ambit. We show that a flexible formation can lose its flexibility, or equivalently may reduce the degrees of freedom of its ambit, if a small disturbance is introduced in the range… ▽ More This paper investigates the stability of distance-based \textit{flexible} undirected formations in the plane. Without rigidity, there exists a set of connected shapes for given distance constraints, which is called the ambit. We show that a flexible formation can lose its flexibility, or equivalently may reduce the degrees of freedom of its ambit, if a small disturbance is introduced in the range sensor of the agents. The stability of the disturbed equilibrium can be characterized by analyzing the eigenvalues of the linearized augmented error system. Unlike infinitesimally rigid formations, the disturbed desired equilibrium can be turned unstable regardless of how small the disturbance is. We finally present two examples of how to exploit these disturbances as design parameters. The first example shows how to combine rigid and flexible formations such that some of the agents can move freely in the desired and locally stable ambit. The second example shows how to achieve a specific shape with fewer edges than the necessary for the standard controller in rigid formations. △ Less

Submitted 14 August, 2018; originally announced August 2018.

Comments: To appear CDC 2018, 6 pages

A Resilient Convex Combination for consensus-based distributed algorithms

Authors: Xuan Wang, Shaoshuai Mou, Shreyas Sundaram

Abstract: Consider a set of vectors in $\mathbb{R}^n$, partitioned into two classes: normal vectors and malicious vectors. The number of malicious vectors is bounded but their identities are unknown. The paper provides a way for achieving a resilient convex combination, which is a convex combination of only normal vectors. Compared with existing approaches based on Tverberg points, the proposed method based… ▽ More Consider a set of vectors in $\mathbb{R}^n$, partitioned into two classes: normal vectors and malicious vectors. The number of malicious vectors is bounded but their identities are unknown. The paper provides a way for achieving a resilient convex combination, which is a convex combination of only normal vectors. Compared with existing approaches based on Tverberg points, the proposed method based on the intersection of convex hulls has lower computational complexity. Simulations suggest that the proposed method can be applied to resilience for consensus-based distributed algorithms against Byzantine attacks. △ Less

Submitted 10 July, 2018; v1 submitted 26 June, 2018; originally announced June 2018.

Comments: Version 2

An Optimal LiDAR Configuration Approach for Self-Driving Cars

Authors: Shenyu Mou, Yan Chang, Wenshuo Wang, Ding Zhao

Abstract: LiDARs plays an important role in self-driving cars and its configuration such as the location placement for each LiDAR can influence object detection performance. This paper aims to investigate an optimal configuration that maximizes the utility of on-hand LiDARs. First, a perception model of LiDAR is built based on its physical attributes. Then a generalized optimization model is developed to fi… ▽ More LiDARs plays an important role in self-driving cars and its configuration such as the location placement for each LiDAR can influence object detection performance. This paper aims to investigate an optimal configuration that maximizes the utility of on-hand LiDARs. First, a perception model of LiDAR is built based on its physical attributes. Then a generalized optimization model is developed to find the optimal configuration, including the pitch angle, roll angle, and position of LiDARs. In order to fix the optimization issue with off-the-shelf solvers, we proposed a lattice-based approach by segmenting the LiDAR's range of interest into finite subspaces, thus turning the optimal configuration into a nonlinear optimization problem. A cylinder-based method is also proposed to approximate the objective function, thereby making the nonlinear optimization problem solvable. A series of simulations are conducted to validate our proposed method. This proposed approach to optimal LiDAR configuration can provide a guideline to researchers to maximize the utility of LiDARs. △ Less

Submitted 20 May, 2018; originally announced May 2018.

Comments: Conference

Inverse Optimal Control from Incomplete Trajectory Observations

Authors: Wanxin Jin, Dana Kulić, Shaoshuai Mou, Sandra Hirche

Abstract: This article develops a methodology that enables learning an objective function of an optimal control system from incomplete trajectory observations. The objective function is assumed to be a weighted sum of features (or basis functions) with unknown weights, and the observed data is a segment of a trajectory of system states and inputs. The proposed technique introduces the concept of the recover… ▽ More This article develops a methodology that enables learning an objective function of an optimal control system from incomplete trajectory observations. The objective function is assumed to be a weighted sum of features (or basis functions) with unknown weights, and the observed data is a segment of a trajectory of system states and inputs. The proposed technique introduces the concept of the recovery matrix to establish the relationship between any available segment of the trajectory and the weights of given candidate features. The rank of the recovery matrix indicates whether a subset of relevant features can be found among the candidate features and the corresponding weights can be learned from the segment data. The recovery matrix can be obtained iteratively and its rank non-decreasing property shows that additional observations may contribute to the objective learning. Based on the recovery matrix, a method for using incomplete trajectory observations to learn the weights of selected features is established, and an incremental inverse optimal control algorithm is developed by automatically finding the minimal required observation. The effectiveness of the proposed method is demonstrated on a linear quadratic regulator system and a simulated robot manipulator. △ Less

Submitted 21 January, 2021; v1 submitted 20 March, 2018; originally announced March 2018.

Comments: Codes: https://github.com/wanxinjin/IOC-from-Incomplete-Trajectory-Observations

Journal ref: The International Journal of Robotics Research. 2021;40(6-7):848-865