Showing 51–100 of 313 results for author: Lou, Y

Ren-integrable and ren-symmetric integrable systems

Authors: S. Y. Lou

Abstract: A new type of symmetry, ren-symmetry describing anyon physics and the corresponding topological physics, is proposed. Ren-symmetry is a generalization of super-symmetry which is widely applied in super-symmetric physics such as the super-symmetric quantum mechanics, super-symmetric gravity, super-symmetric string theory, super-symmetric integrable systems and so on. The super-symmetry and Grassman… ▽ More A new type of symmetry, ren-symmetry describing anyon physics and the corresponding topological physics, is proposed. Ren-symmetry is a generalization of super-symmetry which is widely applied in super-symmetric physics such as the super-symmetric quantum mechanics, super-symmetric gravity, super-symmetric string theory, super-symmetric integrable systems and so on. The super-symmetry and Grassmann-number are, in some sense, the dual conceptions, which turns out that these conceptions coincide for the ren situation, that is, a similar conception of ren-number is devised to ren-symmetry. In particular, some basic results of the ren-number and ren-symmetry are exposed which allow one to derive, in principle, some new types of integrable systems including ren-integrable models and ren-symmetric integrable systems. Training examples of ren-integrable KdV type systems and ren-symmetric KdV equations are explicitly given. △ Less

Submitted 21 May, 2023; originally announced May 2023.

Comments: 20 pages

Journal ref: Commun. Theor. Phys. 76 (2024) 035006

SPP-CNN: An Efficient Framework for Network Robustness Prediction

Authors: Chengpei Wu, Yang Lou, Lin Wang, Junli Li, Xiang Li, Guanrong Chen

Abstract: This paper addresses the robustness of a network to sustain its connectivity and controllability against malicious attacks. This kind of network robustness is typically measured by the time-consuming attack simulation, which returns a sequence of values that record the remaining connectivity and controllability after a sequence of node- or edge-removal attacks. For improvement, this paper develops… ▽ More This paper addresses the robustness of a network to sustain its connectivity and controllability against malicious attacks. This kind of network robustness is typically measured by the time-consuming attack simulation, which returns a sequence of values that record the remaining connectivity and controllability after a sequence of node- or edge-removal attacks. For improvement, this paper develops an efficient framework for network robustness prediction, the spatial pyramid pooling convolutional neural network (SPP-CNN). The new framework installs a spatial pyramid pooling layer between the convolutional and fully-connected layers, overcoming the common mismatch issue in the CNN-based prediction approaches and extending its generalizability. Extensive experiments are carried out by comparing SPP-CNN with three state-of-the-art robustness predictors, namely a CNN-based and two graph neural networks-based frameworks. Synthetic and real-world networks, both directed and undirected, are investigated. Experimental results demonstrate that the proposed SPP-CNN achieves better prediction performances and better generalizability to unknown datasets, with significantly lower time-consumption, than its counterparts. △ Less

Submitted 13 May, 2023; originally announced May 2023.

Comments: 10 pages, 7 figures, 14 pages Supplementary Information

Journal ref: IEEE Transactions on Circuits and Systems I: Regular Papers. 2023, 70 (10), 4067-4079

Private Experimentation, Data Truncation, and Verifiable Disclosure

Authors: Yichuan Lou

Abstract: A sender seeks to persuade a receiver by presenting evidence obtained through a sequence of private experiments. The sender has complete flexibility in his choice of experiments, contingent on the private experimentation history. The sender can disclose each experiment outcome credibly, but cannot prove whether he has disclosed everything. By requiring `continuous disclosure', I first show that th… ▽ More A sender seeks to persuade a receiver by presenting evidence obtained through a sequence of private experiments. The sender has complete flexibility in his choice of experiments, contingent on the private experimentation history. The sender can disclose each experiment outcome credibly, but cannot prove whether he has disclosed everything. By requiring `continuous disclosure', I first show that the private sequential experimentation problem can be reformulated into a static one, in which the sender chooses a single signal to learn about the state. Using this observation, I derive necessary conditions for a signal to be chosen in equilibrium, and then identify the set of beliefs induced by such signals. Finally, I characterize sender-optimal signals from the concavification of his value function constrained to this set. △ Less

Submitted 7 May, 2023; originally announced May 2023.

No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation

Authors: Zhiqiang Yuan, Yiling Lou, Mingwei Liu, Shiji Ding, Kaixin Wang, Yixuan Chen, Xin Peng

Abstract: Unit testing is essential in detecting bugs in functionally-discrete program units. Manually writing high-quality unit tests is time-consuming and laborious. Although traditional techniques can generate tests with reasonable coverage, they exhibit low readability and cannot be directly adopted by developers. Recent work has shown the large potential of large language models (LLMs) in unit test gen… ▽ More Unit testing is essential in detecting bugs in functionally-discrete program units. Manually writing high-quality unit tests is time-consuming and laborious. Although traditional techniques can generate tests with reasonable coverage, they exhibit low readability and cannot be directly adopted by developers. Recent work has shown the large potential of large language models (LLMs) in unit test generation, which can generate more human-like and meaningful test code. ChatGPT, the latest LLM incorporating instruction tuning and reinforcement learning, has performed well in various domains. However, It remains unclear how effective ChatGPT is in unit test generation. In this work, we perform the first empirical study to evaluate ChatGPT's capability of unit test generation. Specifically, we conduct a quantitative analysis and a user study to systematically investigate the quality of its generated tests regarding the correctness, sufficiency, readability, and usability. The tests generated by ChatGPT still suffer from correctness issues, including diverse compilation errors and execution failures. Still, the passing tests generated by ChatGPT resemble manually-written tests by achieving comparable coverage, readability, and even sometimes developers' preference. Our findings indicate that generating unit tests with ChatGPT could be very promising if the correctness of its generated tests could be further improved. Inspired by our findings above, we propose ChatTESTER, a novel ChatGPT-based unit test generation approach, which leverages ChatGPT itself to improve the quality of its generated tests. ChatTESTER incorporates an initial test generator and an iterative test refiner. Our evaluation demonstrates the effectiveness of ChatTESTER by generating 34.3% more compilable tests and 18.7% more tests with correct assertions than the default ChatGPT. △ Less

Submitted 19 May, 2024; v1 submitted 7 May, 2023; originally announced May 2023.

S2abEL: A Dataset for Entity Linking from Scientific Tables

Authors: Yuze Lou, Bailey Kuehl, Erin Bransom, Sergey Feldman, Aakanksha Naik, Doug Downey

Abstract: Entity linking (EL) is the task of linking a textual mention to its corresponding entry in a knowledge base, and is critical for many knowledge-intensive NLP applications. When applied to tables in scientific papers, EL is a step toward large-scale scientific knowledge bases that could enable advanced scientific question answering and analytics. We present the first dataset for EL in scientific ta… ▽ More Entity linking (EL) is the task of linking a textual mention to its corresponding entry in a knowledge base, and is critical for many knowledge-intensive NLP applications. When applied to tables in scientific papers, EL is a step toward large-scale scientific knowledge bases that could enable advanced scientific question answering and analytics. We present the first dataset for EL in scientific tables. EL for scientific tables is especially challenging because scientific knowledge bases can be very incomplete, and disambiguating table mentions typically requires understanding the papers's tet in addition to the table. Our dataset, S2abEL, focuses on EL in machine learning results tables and includes hand-labeled cell types, attributed sources, and entity links from the PaperswithCode taxonomy for 8,429 cells from 732 tables. We introduce a neural baseline method designed for EL on scientific tables containing many out-of-knowledge-base mentions, and show that it significantly outperforms a state-of-the-art generic table EL method. The best baselines fall below human performance, and our analysis highlights avenues for improvement. △ Less

Submitted 29 April, 2023; originally announced May 2023.

Multi-kernel Correntropy Regression: Robustness, Optimality, and Application on Magnetometer Calibration

Authors: Shilei Li, Yunjiang Lou, Dawei Shi, Lijing Li, Ling Shi

Abstract: This paper investigates the robustness and optimality of the multi-kernel correntropy (MKC) on linear regression. We first derive an upper error bound for a scalar regression problem in the presence of arbitrarily large outliers and reveal that the kernel bandwidth should be neither too small nor too big in the sense of the lowest upper error bound. Meanwhile, we find that the proposed MKC is rela… ▽ More This paper investigates the robustness and optimality of the multi-kernel correntropy (MKC) on linear regression. We first derive an upper error bound for a scalar regression problem in the presence of arbitrarily large outliers and reveal that the kernel bandwidth should be neither too small nor too big in the sense of the lowest upper error bound. Meanwhile, we find that the proposed MKC is related to a specific heavy-tail distribution, and the level of the heavy tail is controlled by the kernel bandwidth solely. Interestingly, this distribution becomes the Gaussian distribution when the bandwidth is set to be infinite, which allows one to tackle both Gaussian and non-Gaussian problems. We propose an expectation-maximization (EM) algorithm to estimate the parameter vectors and explore the kernel bandwidths alternatively. The results show that our algorithm is equivalent to the traditional linear regression under Gaussian noise and outperforms the conventional method under heavy-tailed noise. Both numerical simulations and experiments on a magnetometer calibration application verify the effectiveness of the proposed method. △ Less

Submitted 11 October, 2023; v1 submitted 13 April, 2023; originally announced April 2023.

Multi-kernel Correntropy-based Orientation Estimation of IMUs: Gradient Descent Methods

Authors: Shilei Li, Lijing Li, Dawei Shi, Yunjiang Lou, Ling Shi

Abstract: This paper presents two computationally efficient algorithms for the orientation estimation of inertial measurement units (IMUs): the correntropy-based gradient descent (CGD) and the correntropy-based decoupled orientation estimation (CDOE). Traditional methods, such as gradient descent (GD) and decoupled orientation estimation (DOE), rely on the mean squared error (MSE) criterion, making them vul… ▽ More This paper presents two computationally efficient algorithms for the orientation estimation of inertial measurement units (IMUs): the correntropy-based gradient descent (CGD) and the correntropy-based decoupled orientation estimation (CDOE). Traditional methods, such as gradient descent (GD) and decoupled orientation estimation (DOE), rely on the mean squared error (MSE) criterion, making them vulnerable to external acceleration and magnetic interference. To address this issue, we demonstrate that the multi-kernel correntropy loss (MKCL) is an optimal objective function for maximum likelihood estimation (MLE) when the noise follows a type of heavy-tailed distribution. In certain situations, the estimation error of the MKCL is bounded even in the presence of arbitrarily large outliers. By replacing the standard MSE cost function with MKCL, we develop the CGD and CDOE algorithms. We evaluate the effectiveness of our proposed methods by comparing them with existing algorithms in various situations. Experimental results indicate that our proposed methods (CGD and CDOE) outperform their conventional counterparts (GD and DOE), especially when faced with external acceleration and magnetic disturbances. Furthermore, the new algorithms demonstrate significantly lower computational complexity than Kalman filter-based approaches, making them suitable for applications with low-cost microprocessors. △ Less

Submitted 11 October, 2023; v1 submitted 13 April, 2023; originally announced April 2023.

Comments: 16 pages

$\text{DC}^2$: Dual-Camera Defocus Control by Learning to Refocus

Authors: Hadi Alzayer, Abdullah Abuolaim, Leung Chun Chan, Yang Yang, Ying Chen Lou, Jia-Bin Huang, Abhishek Kar

Abstract: Smartphone cameras today are increasingly approaching the versatility and quality of professional cameras through a combination of hardware and software advancements. However, fixed aperture remains a key limitation, preventing users from controlling the depth of field (DoF) of captured images. At the same time, many smartphones now have multiple cameras with different fixed apertures -- specifica… ▽ More Smartphone cameras today are increasingly approaching the versatility and quality of professional cameras through a combination of hardware and software advancements. However, fixed aperture remains a key limitation, preventing users from controlling the depth of field (DoF) of captured images. At the same time, many smartphones now have multiple cameras with different fixed apertures -- specifically, an ultra-wide camera with wider field of view and deeper DoF and a higher resolution primary camera with shallower DoF. In this work, we propose $\text{DC}^2$, a system for defocus control for synthetically varying camera aperture, focus distance and arbitrary defocus effects by fusing information from such a dual-camera system. Our key insight is to leverage real-world smartphone camera dataset by using image refocus as a proxy task for learning to control defocus. Quantitative and qualitative evaluations on real-world data demonstrate our system's efficacy where we outperform state-of-the-art on defocus deblurring, bokeh rendering, and image refocus. Finally, we demonstrate creative post-capture defocus control enabled by our method, including tilt-shift and content-based defocus effects. △ Less

Submitted 6 April, 2023; originally announced April 2023.

Comments: CVPR 2023. See the project page at https://defocus-control.github.io

Non-convex approaches for low-rank tensor completion under tubal sampling

Authors: Zheng Tan, Longxiu Huang, HanQin Cai, Yifei Lou

Abstract: Tensor completion is an important problem in modern data analysis. In this work, we investigate a specific sampling strategy, referred to as tubal sampling. We propose two novel non-convex tensor completion frameworks that are easy to implement, named tensor $L_1$-$L_2$ (TL12) and tensor completion via CUR (TCCUR). We test the efficiency of both methods on synthetic data and a color image inpainti… ▽ More Tensor completion is an important problem in modern data analysis. In this work, we investigate a specific sampling strategy, referred to as tubal sampling. We propose two novel non-convex tensor completion frameworks that are easy to implement, named tensor $L_1$-$L_2$ (TL12) and tensor completion via CUR (TCCUR). We test the efficiency of both methods on synthetic data and a color image inpainting problem. Empirical results reveal a trade-off between the accuracy and time efficiency of these two methods in a low sampling ratio. Each of them outperforms some classical completion methods in at least one aspect. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Journal ref: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1-5. IEEE, 2023

CRIN: Rotation-Invariant Point Cloud Analysis and Rotation Estimation via Centrifugal Reference Frame

Authors: Yujing Lou, Zelin Ye, Yang You, Nianjuan Jiang, Jiangbo Lu, Weiming Wang, Lizhuang Ma, Cewu Lu

Abstract: Various recent methods attempt to implement rotation-invariant 3D deep learning by replacing the input coordinates of points with relative distances and angles. Due to the incompleteness of these low-level features, they have to undertake the expense of losing global information. In this paper, we propose the CRIN, namely Centrifugal Rotation-Invariant Network. CRIN directly takes the coordinates… ▽ More Various recent methods attempt to implement rotation-invariant 3D deep learning by replacing the input coordinates of points with relative distances and angles. Due to the incompleteness of these low-level features, they have to undertake the expense of losing global information. In this paper, we propose the CRIN, namely Centrifugal Rotation-Invariant Network. CRIN directly takes the coordinates of points as input and transforms local points into rotation-invariant representations via centrifugal reference frames. Aided by centrifugal reference frames, each point corresponds to a discrete rotation so that the information of rotations can be implicitly stored in point features. Unfortunately, discrete points are far from describing the whole rotation space. We further introduce a continuous distribution for 3D rotations based on points. Furthermore, we propose an attention-based down-sampling strategy to sample points invariant to rotations. A relation module is adopted at last for reinforcing the long-range dependencies between sampled points and predicts the anchor point for unsupervised rotation estimation. Extensive experiments show that our method achieves rotation invariance, accurately estimates the object rotation, and obtains state-of-the-art results on rotation-augmented classification and part segmentation. Ablation studies validate the effectiveness of the network design. △ Less

Submitted 6 March, 2023; originally announced March 2023.

Comments: AAAI 2023

Globally Solving Concave Quadratic Program via Doubly Nonnegative Relaxation

Authors: Zheng Qu, Tianyou Zeng, Yuchen Lou

Abstract: We consider the problem of maximizing a convex quadratic function over a bounded polyhedral set. We design a new framework based on SDP relaxation and cutting plane method for solving the associated reference value problem. The major novelty is a new way to generate valid cut through the doubly nonnegative (DNN) relaxation. We establish various theoretical properties of the DNN relaxation. This in… ▽ More We consider the problem of maximizing a convex quadratic function over a bounded polyhedral set. We design a new framework based on SDP relaxation and cutting plane method for solving the associated reference value problem. The major novelty is a new way to generate valid cut through the doubly nonnegative (DNN) relaxation. We establish various theoretical properties of the DNN relaxation. This includes its equivalence with the Shor relaxation of the equivalent quadratically constrained problem, the strong duality and generation of valid cut from an approximate solution of the DNN relaxation returned by an arbitrary SDP solver. Computational results on both real and synthetic data demonstrate the efficiency of the proposed new method and its ability to solve high dimensional problems with dense data. In particular, our new algorithm successfully solved in 3 days the reference value problem arising from computational biology for a dataset containing more than 300,000 instances of dimension 100. In contrast, CPLEX or Gurobi is estimated to need years of computational time for the same dataset on the same computing platform. △ Less

Submitted 12 February, 2023; originally announced February 2023.

Comments: 45 pages, 4 figures, 6 tables

MSC Class: 90C20; 90C22; 90C26; 90C59

Higher dimensional integrable deformations of the modified KdV equation

Authors: Xiazhi Hao, S. Y. Lou

Abstract: The derivation of nonlinear integrable evolution partial differential equations in higher dimensions has always been the holy grail in the field of integrability. The well-known modified KdV equation is a prototypical example of integrable evolution equations in one spatial dimension. Do there exist integrable analogs of modified KdV equation in higher spatial dimensions? In what follows, we prese… ▽ More The derivation of nonlinear integrable evolution partial differential equations in higher dimensions has always been the holy grail in the field of integrability. The well-known modified KdV equation is a prototypical example of integrable evolution equations in one spatial dimension. Do there exist integrable analogs of modified KdV equation in higher spatial dimensions? In what follows, we present a positive answer to this question. In particular, rewriting the (1+1)-dimensional integrable modified KdV equation in conservation forms and adding deformation mappings during the process allow one to construct higher dimensional integrable equations. Further, we illustrate this idea with examples from the modified KdV hierarchy, also present the Lax pairs of these higher dimensional integrable evolution equations. △ Less

Submitted 12 February, 2023; originally announced February 2023.

Comments: 7 pages, 3 figures

Structural Robustness of Complex Networks: A Survey of A Posteriori Measures

Authors: Yang Lou, Lin Wang, Guanrong Chen

Abstract: Network robustness is critical for various industrial and social networks against malicious attacks, which has various meanings in different research contexts and here it refers to the ability of a network to sustain its functionality when a fraction of the network fail to work due to attacks. The rapid development of complex networks research indicates special interest and great concern about the… ▽ More Network robustness is critical for various industrial and social networks against malicious attacks, which has various meanings in different research contexts and here it refers to the ability of a network to sustain its functionality when a fraction of the network fail to work due to attacks. The rapid development of complex networks research indicates special interest and great concern about the network robustness, which is essential for further analyzing and optimizing network structures towards engineering applications. This comprehensive survey distills the important findings and developments of network robustness research, focusing on the a posteriori structural robustness measures for single-layer static networks. Specifically, the a posteriori robustness measures are reviewed from four perspectives: 1) network functionality, including connectivity, controllability and communication ability, as well as their extensions; 2) malicious attacks, including conventional and computation-based attack strategies; 3) robustness estimation methods using either analytical approximation or machine learning-based prediction; 4) network robustness optimization. Based on the existing measures, a practical threshold of network destruction is introduced, with the suggestion that network robustness should be measured only before reaching the threshold of destruction. Then, a posteriori and a priori measures are compared experimentally, revealing the advantages of the a posteriori measures. Finally, prospective research directions with respect to a posteriori robustness measures are recommended. △ Less

Submitted 3 February, 2023; originally announced February 2023.

Journal ref: IEEE Circuits and Systems Magazine, Volume 23, Issue 1, 2023

KNOD: Domain Knowledge Distilled Tree Decoder for Automated Program Repair

Authors: Nan Jiang, Thibaud Lutellier, Yiling Lou, Lin Tan, Dan Goldwasser, Xiangyu Zhang

Abstract: Automated Program Repair (APR) improves software reliability by generating patches for a buggy program automatically. Recent APR techniques leverage deep learning (DL) to build models to learn to generate patches from existing patches and code corpora. While promising, DL-based APR techniques suffer from the abundant syntactically or semantically incorrect patches in the patch space. These patches… ▽ More Automated Program Repair (APR) improves software reliability by generating patches for a buggy program automatically. Recent APR techniques leverage deep learning (DL) to build models to learn to generate patches from existing patches and code corpora. While promising, DL-based APR techniques suffer from the abundant syntactically or semantically incorrect patches in the patch space. These patches often disobey the syntactic and semantic domain knowledge of source code and thus cannot be the correct patches to fix a bug. We propose a DL-based APR approach KNOD, which incorporates domain knowledge to guide patch generation in a direct and comprehensive way. KNOD has two major novelties, including (1) a novel three-stage tree decoder, which directly generates Abstract Syntax Trees of patched code according to the inherent tree structure, and (2) a novel domain-rule distillation, which leverages syntactic and semantic rules and teacher-student distributions to explicitly inject the domain knowledge into the decoding procedure during both the training and inference phases. We evaluate KNOD on three widely-used benchmarks. KNOD fixes 72 bugs on the Defects4J v1.2, 25 bugs on the QuixBugs, and 50 bugs on the additional Defects4J v2.0 benchmarks, outperforming all existing APR tools. △ Less

Submitted 16 April, 2023; v1 submitted 3 February, 2023; originally announced February 2023.

Comments: This paper is accepted by 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE)

Difference of Anisotropic and Isotropic TV for Segmentation under Blur and Poisson Noise

Authors: Kevin Bui, Yifei Lou, Fredrick Park, Jack Xin

Abstract: In this paper, we aim to segment an image degraded by blur and Poisson noise. We adopt a smoothing-and-thresholding (SaT) segmentation framework that finds a piecewise-smooth solution, followed by $k$-means clustering to segment the image. Specifically for the image smoothing step, we replace the least-squares fidelity for Gaussian noise in the Mumford-Shah model with a maximum posterior (MAP) ter… ▽ More In this paper, we aim to segment an image degraded by blur and Poisson noise. We adopt a smoothing-and-thresholding (SaT) segmentation framework that finds a piecewise-smooth solution, followed by $k$-means clustering to segment the image. Specifically for the image smoothing step, we replace the least-squares fidelity for Gaussian noise in the Mumford-Shah model with a maximum posterior (MAP) term to deal with Poisson noise and we incorporate the weighted difference of anisotropic and isotropic total variation (AITV) as a regularization to promote the sparsity of image gradients. For such a nonconvex model, we develop a specific splitting scheme and utilize a proximal operator to apply the alternating direction method of multipliers (ADMM). Convergence analysis is provided to validate the efficacy of the ADMM scheme. Numerical experiments on various segmentation scenarios (grayscale/color and multiphase) showcase that our proposed method outperforms a number of segmentation methods, including the original SaT. △ Less

Submitted 16 June, 2023; v1 submitted 5 January, 2023; originally announced January 2023.

Comments: Accepted to Frontiers in Computer Science: https://www.frontiersin.org/articles/10.3389/fcomp.2023.1131317/abstract; Arxiv version has clearer images best for zooming in

Decorate the Newcomers: Visual Domain Prompt for Continual Test Time Adaptation

Authors: Yulu Gan, Yan Bai, Yihang Lou, Xianzheng Ma, Renrui Zhang, Nian Shi, Lin Luo

Abstract: Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such as predicting pseudo labels for new domain datasets. Since pseudo labels are noisy and unreliable, these methods suffer from catastrophic forgetting and error… ▽ More Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such as predicting pseudo labels for new domain datasets. Since pseudo labels are noisy and unreliable, these methods suffer from catastrophic forgetting and error accumulation when dealing with dynamic data distributions. Motivated by the prompt learning in NLP, in this paper, we propose to learn an image-level visual domain prompt for target domains while having the source model parameters frozen. During testing, the changing target datasets can be adapted to the source model by reformulating the input data with the learned visual prompts. Specifically, we devise two types of prompts, i.e., domains-specific prompts and domains-agnostic prompts, to extract current domain knowledge and maintain the domain-shared knowledge in the continual adaptation. Furthermore, we design a homeostasis-based prompt adaptation strategy to suppress domain-sensitive parameters in domain-invariant prompts to learn domain-shared knowledge more effectively. This transition from the model-dependent paradigm to the model-free one enables us to bypass the catastrophic forgetting and error accumulation problems. Experiments show that our proposed method achieves significant performance gains over state-of-the-art methods on four widely-used benchmarks, including CIFAR-10C, CIFAR-100C, ImageNet-C, and VLCS datasets. △ Less

Submitted 11 February, 2023; v1 submitted 8 December, 2022; originally announced December 2022.

Comments: AAAI2023 Outstanding Student Paper Award

Hong-Ou-Mandel Interference between Two Hyper-Entangled Photons Enables Observation of Symmetric and Anti-Symmetric Particle Exchange Phases

Authors: Zhi-Feng Liu, Chao Chen, Jia-Min Xu, Zi-Mo Cheng, Zhi-Cheng Ren, Bo-Wen Dong, Yan-Chao Lou, Yu-Xiang Yang, Shu-Tian Xue, Zhi-Hong Liu, Wen-Zheng Zhu, Xi-Lin Wang, Hui-Tian Wang

Abstract: Two-photon Hong-Ou-Mandel (HOM) interference is a fundamental quantum effect with no classical counterpart. The exiting researches on two-photon interference were mainly limited in one degree of freedom (DoF), hence it is still a challenge to realize the quantum interference in multiple DoFs. Here we demonstrate the HOM interference between two hyper-entangled photons in two DoFs of polarization a… ▽ More Two-photon Hong-Ou-Mandel (HOM) interference is a fundamental quantum effect with no classical counterpart. The exiting researches on two-photon interference were mainly limited in one degree of freedom (DoF), hence it is still a challenge to realize the quantum interference in multiple DoFs. Here we demonstrate the HOM interference between two hyper-entangled photons in two DoFs of polarization and orbital angular momentum (OAM) for all the sixteen hyper-entangled Bell states. We observe hyper-entangled two-photon interference with bunching effect for ten symmetric states (nine Boson-Boson states, one Fermion-Fermion state) and anti-bunching effect for six anti-symmetric states (three Boson-Fermion states, three Fermion-Boson states). More interestingly, expanding the Hilbert space by introducing an extra DoF for two photons enables to transfer the unmeasurable external phase in the initial DoF to a measurable internal phase in the expanded two DoFs. We directly measured the symmetric exchange phases being $0.012 \pm 0.002$, $0.025 \pm 0.002$ and $0.027 \pm 0.002$ in radian for the three Boson states in OAM and the anti-symmetric exchange phase being $0.991 π\pm 0.002$ in radian for the other Fermion state, as theoretical predictions. Our work may not only pave the way for more wide applications of quantum interference, but also develop new technologies by expanding Hilbert space in more DoFs. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Comments: Accepted by Physical Review Letters

PC-SNN: Supervised Learning with Local Hebbian Synaptic Plasticity based on Predictive Coding in Spiking Neural Networks

Authors: Mengting Lan, Xiaogang Xiong, Zixuan Jiang, Yunjiang Lou

Abstract: Deemed as the third generation of neural networks, the event-driven Spiking Neural Networks(SNNs) combined with bio-plausible local learning rules make it promising to build low-power, neuromorphic hardware for SNNs. However, because of the non-linearity and discrete property of spiking neural networks, the training of SNN remains difficult and is still under discussion. Originating from gradient… ▽ More Deemed as the third generation of neural networks, the event-driven Spiking Neural Networks(SNNs) combined with bio-plausible local learning rules make it promising to build low-power, neuromorphic hardware for SNNs. However, because of the non-linearity and discrete property of spiking neural networks, the training of SNN remains difficult and is still under discussion. Originating from gradient descent, backprop has achieved stunning success in multi-layer SNNs. Nevertheless, it is assumed to lack biological plausibility, while consuming relatively high computational resources. In this paper, we propose a novel learning algorithm inspired by predictive coding theory and show that it can perform supervised learning fully autonomously and successfully as the backprop, utilizing only local Hebbian plasticity. Furthermore, this method achieves a favorable performance compared to the state-of-the-art multi-layer SNNs: test accuracy of 99.25% for the Caltech Face/Motorbike dataset, 84.25% for the ETH-80 dataset, 98.1% for the MNIST dataset and 98.5% for the neuromorphic dataset: N-MNIST. Furthermore, our work provides a new perspective on how supervised learning algorithms are directly implemented in spiking neural circuitry, which may give some new insights into neuromorphological calculation in neuroscience. △ Less

Submitted 24 November, 2022; originally announced November 2022.

Comments: 15 pages, 11figs

ACM Class: I.2.3; I.2.10

Deformation Conjecture: Deforming Lower Dimensional Integrable Systems to Higher Dimensional Ones by Using Conservation Laws

Authors: S. Y. Lou, Xia-zhi Hao, Man Jia

Abstract: Utilizing some conservation laws of (1+1)-dimensional integrable local evolution systems, it is conjectured that higher dimensional integrable equations may be regularly constructed by a deformation algorithm. The algorithm can be applied to Lax pairs and higher order flows. In other words, if the original lower dimensional model is Lax integrable (possesses Lax pairs) and symmetry integrable (pos… ▽ More Utilizing some conservation laws of (1+1)-dimensional integrable local evolution systems, it is conjectured that higher dimensional integrable equations may be regularly constructed by a deformation algorithm. The algorithm can be applied to Lax pairs and higher order flows. In other words, if the original lower dimensional model is Lax integrable (possesses Lax pairs) and symmetry integrable (possesses infinitely many higher order symmetries), then the deformed higher order systems are also Lax integrable and symmetry integrable. For concreteness, the deformation algorithm is applied to the usual (1+1)-dimensional KdV equation and the (1+1)-dimensional AKNS system (including nonlinear NLS equation as a special example). It is interesting that the deformed (3+1)-dimensional KdV equation is also an extension of the (1+1)-dimensional Harry-Dym (HD) type equations which are reciprocal links of the (1+1)-dimensional KdV equation. The Lax pairs of the (3+1)-dimensional KdV-HD system and the (2+1)-dimensional AKNS system are explicitly given. The higher order symmetries, i.e., the whole (3+1)-dimensional KdV-HD hierarchy, are also explicitly obtained via the deformation algorithm. The single soliton solution of the (3+1)-dimensional KdV-HD equation is implicitly given. Because of the effects of the deformation, the symmetric soliton shape of the usual KdV equation is no longer conserved and deformed to be asymmetric and/or multi-valued. The deformation conjecture is correct for almost all the known (1+1)-dimensional integrable local evolution systems and we have not yet found any counter-example so far. The introduction of a large number of (D+1)-dimensional integrable systems of this paper explores a serious challenge to all mathematicians and theoretical physicists because the traditional methods are no longer directly valid to solve these integrable equations. △ Less

Submitted 30 January, 2023; v1 submitted 13 November, 2022; originally announced November 2022.

Comments: 9 pages 3 figures

Active View Planning for Visual SLAM in Outdoor Environments Based on Continuous Information Modeling

Authors: Zhihao Wang, Haoyao Chen, Shiwu Zhang, Yunjiang Lou

Abstract: The visual simultaneous localization and mapping(vSLAM) is widely used in GPS-denied and open field environments for ground and surface robots. However, due to the frequent perception failures derived from lacking visual texture or the {swing} of robot view direction on rough terrains, the accuracy and robustness of vSLAM are still to be enhanced. The study develops a novel view planning approach… ▽ More The visual simultaneous localization and mapping(vSLAM) is widely used in GPS-denied and open field environments for ground and surface robots. However, due to the frequent perception failures derived from lacking visual texture or the {swing} of robot view direction on rough terrains, the accuracy and robustness of vSLAM are still to be enhanced. The study develops a novel view planning approach of actively perceiving areas with maximal information to address the mentioned problem; a gimbal camera is used as the main sensor. Firstly, a map representation based on feature distribution-weighted Fisher information is proposed to completely and effectively represent environmental information richness. With the map representation, a continuous environmental information model is further established to convert the discrete information space into a continuous one for numerical optimization in real-time. Subsequently, the receding horizon optimization is utilized to obtain the optimal informative viewpoints with simultaneously considering the robotic perception, exploration and motion cost based on the continuous environmental model. Finally, several simulations and outdoor experiments are performed to verify the improvement of localization robustness and accuracy by the proposed approach. △ Less

Submitted 22 May, 2023; v1 submitted 11 November, 2022; originally announced November 2022.

Comments: 11 pages, 14 figures, in IEEE/ASME Transactions on Mechatronics

Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddings

Authors: Tenglong Ao, Qingzhe Gao, Yuke Lou, Baoquan Chen, Libin Liu

Abstract: Automatic synthesis of realistic co-speech gestures is an increasingly important yet challenging task in artificial embodied agent creation. Previous systems mainly focus on generating gestures in an end-to-end manner, which leads to difficulties in mining the clear rhythm and semantics due to the complex yet subtle harmony between speech and gestures. We present a novel co-speech gesture synthesi… ▽ More Automatic synthesis of realistic co-speech gestures is an increasingly important yet challenging task in artificial embodied agent creation. Previous systems mainly focus on generating gestures in an end-to-end manner, which leads to difficulties in mining the clear rhythm and semantics due to the complex yet subtle harmony between speech and gestures. We present a novel co-speech gesture synthesis method that achieves convincing results both on the rhythm and semantics. For the rhythm, our system contains a robust rhythm-based segmentation pipeline to ensure the temporal coherence between the vocalization and gestures explicitly. For the gesture semantics, we devise a mechanism to effectively disentangle both low- and high-level neural embeddings of speech and motion based on linguistic theory. The high-level embedding corresponds to semantics, while the low-level embedding relates to subtle variations. Lastly, we build correspondence between the hierarchical embeddings of the speech and the motion, resulting in rhythm- and semantics-aware gesture synthesis. Evaluations with existing objective metrics, a newly proposed rhythmic metric, and human feedback show that our method outperforms state-of-the-art systems by a clear margin. △ Less

Submitted 4 May, 2023; v1 submitted 4 October, 2022; originally announced October 2022.

Comments: SIGGRAPH Asia 2022 (Journal Track); Project Page: https://pku-mocca.github.io/Rhythmic-Gesticulator-Page/

Decomposition solutions and Bäcklund transformations of the BKP and CKP equations

Authors: Xiazhi Hao, S. Y. Lou

Abstract: In this paper, we define the modified formal variable separation approach and show how it determines, in a remarkably simple manner, the decomposition solutions, the Bäcklund transformations, the Lax pair, and the linear superposition solution of the B-type Kadomtsev-Petviashvili equation. Also, the decomposition solutions, the Bäcklund transformation and the Lax pair relating to the C-type Kadomt… ▽ More In this paper, we define the modified formal variable separation approach and show how it determines, in a remarkably simple manner, the decomposition solutions, the Bäcklund transformations, the Lax pair, and the linear superposition solution of the B-type Kadomtsev-Petviashvili equation. Also, the decomposition solutions, the Bäcklund transformation and the Lax pair relating to the C-type Kadomtsev-Petviashvili equation is obtain by the same technique. This indicates that the decomposition may provide a description of integrable behavior in nonlinear systems, while, at the same time, establishing an efficient method for determining relationships between the particular systems. △ Less

Submitted 2 October, 2022; originally announced October 2022.

High-energy-density plasma in femtosecond-laser-irradiated nanowire array targets for nuclear reactions

Authors: Defeng Kong, Guoqiang Zhang, Yinren Shou, Shirui Xu, Zhusong Mei, Zhengxuan Cao, Zhuo Pan, Pengjie Wang, Guijun Qi, Jiarui Zhao, Yanying Zhao, Yao Lou, Zhiguo Ma, Haoyang Lan, Wenzhao Wang, Yunhui Li, Peter Rubovic, Martin Veselsky, Aldo Bonasera, Changbo Fu, Wen Luo, Yugang Ma, Xueqing Yan, Wenjun Ma

Abstract: In this work, the high-energy-density plasmas (HEDP) evolved from joule-class-femtosecond-laser-irradiated nanowire array (NWA) targets are numerically and experimentally studied. The particle-in-cell (PIC) simulations indicate that ions accelerated in the sheath field around the nanowires' surface were eventually confined in NWA plasma, contributing most to the high energy densities. The protons… ▽ More In this work, the high-energy-density plasmas (HEDP) evolved from joule-class-femtosecond-laser-irradiated nanowire array (NWA) targets are numerically and experimentally studied. The particle-in-cell (PIC) simulations indicate that ions accelerated in the sheath field around the nanowires' surface were eventually confined in NWA plasma, contributing most to the high energy densities. The protons emitted from the front surface of targets provide rich information about the interaction. The electron and ion energy densities in a broad target parameter range are given. Compared to planar targets, the ion energy density is one order of magnitude higher, and the volume of the HEDP is several-fold larger. At optimal target parameters, 8% of the laser energy can be converted to confined protons and results in ion energy densities of up to GJ/cm3 level. Experimental measurements of the emitted ions and neutrons from 2H(d, n)3He fusion from polyethylene and deuterated polyethylene NWA targets confirm the above results. △ Less

Submitted 11 September, 2022; originally announced September 2022.

Unsupervised Scene Sketch to Photo Synthesis

Authors: Jiayun Wang, Sangryul Jeon, Stella X. Yu, Xi Zhang, Himanshu Arora, Yu Lou

Abstract: Sketches make an intuitive and powerful visual expression as they are fast executed freehand drawings. We present a method for synthesizing realistic photos from scene sketches. Without the need for sketch and photo pairs, our framework directly learns from readily available large-scale photo datasets in an unsupervised manner. To this end, we introduce a standardization module that provides pseud… ▽ More Sketches make an intuitive and powerful visual expression as they are fast executed freehand drawings. We present a method for synthesizing realistic photos from scene sketches. Without the need for sketch and photo pairs, our framework directly learns from readily available large-scale photo datasets in an unsupervised manner. To this end, we introduce a standardization module that provides pseudo sketch-photo pairs during training by converting photos and sketches to a standardized domain, i.e. the edge map. The reduced domain gap between sketch and photo also allows us to disentangle them into two components: holistic scene structures and low-level visual styles such as color and texture. Taking this advantage, we synthesize a photo-realistic image by combining the structure of a sketch and the visual style of a reference photo. Extensive experimental results on perceptual similarity metrics and human perceptual studies show the proposed method could generate realistic photos with high fidelity from scene sketches and outperform state-of-the-art photo synthesis baselines. We also demonstrate that our framework facilitates a controllable manipulation of photo synthesis by editing strokes of corresponding sketches, delivering more fine-grained details than previous approaches that rely on region-level editing. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Journal ref: ECCVW 2022

Accelerated Sparse Recovery via Gradient Descent with Nonlinear Conjugate Gradient Momentum

Authors: Mengqi Hu, Yifei Lou, Bao Wang, Ming Yan, Xiu Yang, Qiang Ye

Abstract: This paper applies an idea of adaptive momentum for the nonlinear conjugate gradient to accelerate optimization problems in sparse recovery. Specifically, we consider two types of minimization problems: a (single) differentiable function and the sum of a non-smooth function and a differentiable function. In the first case, we adopt a fixed step size to avoid the traditional line search and establi… ▽ More This paper applies an idea of adaptive momentum for the nonlinear conjugate gradient to accelerate optimization problems in sparse recovery. Specifically, we consider two types of minimization problems: a (single) differentiable function and the sum of a non-smooth function and a differentiable function. In the first case, we adopt a fixed step size to avoid the traditional line search and establish the convergence analysis of the proposed algorithm for a quadratic problem. This acceleration is further incorporated with an operator splitting technique to deal with the non-smooth function in the second case. We use the convex $\ell_1$ and the nonconvex $\ell_1-\ell_2$ functionals as two case studies to demonstrate the efficiency of the proposed approaches over traditional methods. △ Less

Submitted 5 April, 2023; v1 submitted 25 August, 2022; originally announced August 2022.

CNN-based Prediction of Network Robustness With Missing Edges

Authors: Chengpei Wu, Yang Lou, Ruizi Wu, Wenwen Liu, Junli Li

Abstract: Connectivity and controllability of a complex network are two important issues that guarantee a networked system to function. Robustness of connectivity and controllability guarantees the system to function properly and stably under various malicious attacks. Evaluating network robustness using attack simulations is time consuming, while the convolutional neural network (CNN)-based prediction appr… ▽ More Connectivity and controllability of a complex network are two important issues that guarantee a networked system to function. Robustness of connectivity and controllability guarantees the system to function properly and stably under various malicious attacks. Evaluating network robustness using attack simulations is time consuming, while the convolutional neural network (CNN)-based prediction approach provides a cost-efficient method to approximate the network robustness. In this paper, we investigate the performance of CNN-based approaches for connectivity and controllability robustness prediction, when partial network information is missing, namely the adjacency matrix is incomplete. Extensive experimental studies are carried out. A threshold is explored that if a total amount of more than 7.29\% information is lost, the performance of CNN-based prediction will be significantly degenerated for all cases in the experiments. Two scenarios of missing edge representations are compared, 1) a missing edge is marked `no edge' in the input for prediction, and 2) a missing edge is denoted using a special marker of `unknown'. Experimental results reveal that the first representation is misleading to the CNN-based predictors. △ Less

Submitted 24 August, 2022; originally announced August 2022.

Comments: In Proceedings of the IEEE 2022 International Joint Conference on Neural Networks (IJCNN)

HybridGNN: Learning Hybrid Representation in Multiplex Heterogeneous Networks

Authors: Tiankai Gu, Chaokun Wang, Cheng Wu, Jingcao Xu, Yunkai Lou, Changping Wang, Kai Xu, Can Ye, Yang Song

Abstract: Recently, graph neural networks have shown the superiority of modeling the complex topological structures in heterogeneous network-based recommender systems. Due to the diverse interactions among nodes and abundant semantics emerging from diverse types of nodes and edges, there is a bursting research interest in learning expressive node representations in multiplex heterogeneous networks. One of t… ▽ More Recently, graph neural networks have shown the superiority of modeling the complex topological structures in heterogeneous network-based recommender systems. Due to the diverse interactions among nodes and abundant semantics emerging from diverse types of nodes and edges, there is a bursting research interest in learning expressive node representations in multiplex heterogeneous networks. One of the most important tasks in recommender systems is to predict the potential connection between two nodes under a specific edge type (i.e., relationship). Although existing studies utilize explicit metapaths to aggregate neighbors, practically they only consider intra-relationship metapaths and thus fail to leverage the potential uplift by inter-relationship information. Moreover, it is not always straightforward to exploit inter-relationship metapaths comprehensively under diverse relationships, especially with the increasing number of node and edge types. In addition, contributions of different relationships between two nodes are difficult to measure. To address the challenges, we propose HybridGNN, an end-to-end GNN model with hybrid aggregation flows and hierarchical attentions to fully utilize the heterogeneity in the multiplex scenarios. Specifically, HybridGNN applies a randomized inter-relationship exploration module to exploit the multiplexity property among different relationships. Then, our model leverages hybrid aggregation flows under intra-relationship metapaths and randomized exploration to learn the rich semantics. To explore the importance of different aggregation flow and take advantage of the multiplexity property, we bring forward a novel hierarchical attention module which leverages both metapath-level attention and relationship-level attention. Extensive experimental results suggest that HybridGNN achieves the best performance compared to several state-of-the-art baselines. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Comments: ICDE 2022

Bayesian Evidential Learning for Few-Shot Classification

Authors: Xiongkun Linghu, Yan Bai, Yihang Lou, Shengsen Wu, Jinze Li, Jianzhong He, Tao Bai

Abstract: Few-Shot Classification(FSC) aims to generalize from base classes to novel classes given very limited labeled samples, which is an important step on the path toward human-like machine learning. State-of-the-art solutions involve learning to find a good metric and representation space to compute the distance between samples. Despite the promising accuracy performance, how to model uncertainty for m… ▽ More Few-Shot Classification(FSC) aims to generalize from base classes to novel classes given very limited labeled samples, which is an important step on the path toward human-like machine learning. State-of-the-art solutions involve learning to find a good metric and representation space to compute the distance between samples. Despite the promising accuracy performance, how to model uncertainty for metric-based FSC methods effectively is still a challenge. To model uncertainty, We place a distribution over class probability based on the theory of evidence. As a result, uncertainty modeling and metric learning can be decoupled. To reduce the uncertainty of classification, we propose a Bayesian evidence fusion theorem. Given observed samples, the network learns to get posterior distribution parameters given the prior parameters produced by the pre-trained network. Detailed gradient analysis shows that our method provides a smooth optimization target and can capture the uncertainty. The proposed method is agnostic to metric learning strategies and can be implemented as a plug-and-play module. We integrate our method into several newest FSC methods and demonstrate the improved accuracy and uncertainty quantification on standard FSC benchmarks. △ Less

Submitted 18 July, 2022; originally announced July 2022.

Comments: arXiv admin note: text overlap with arXiv:2107.10161 by other authors

Attention: Not Just Another Dataset for Patch-Correctness Checking

Authors: Jun Yang, Yuehan Wang, Yiling Lou, Ming Wen, Lingming Zhang

Abstract: Automated Program Repair (APR) techniques have drawn wide attention from both academia and industry. Meanwhile, one main limitation with the current state-of-the-art APR tools is that patches passing all the original tests are not necessarily the correct ones wanted by developers, i.e., the plausible patch problem. To date, various Patch-Correctness Checking (PCC) techniques have been proposed to… ▽ More Automated Program Repair (APR) techniques have drawn wide attention from both academia and industry. Meanwhile, one main limitation with the current state-of-the-art APR tools is that patches passing all the original tests are not necessarily the correct ones wanted by developers, i.e., the plausible patch problem. To date, various Patch-Correctness Checking (PCC) techniques have been proposed to address this important issue. However, they are only evaluated on very limited datasets as the APR tools used for generating such patches can only explore a small subset of the search space of possible patches, posing serious threats to external validity to existing PCC studies. In this paper, we construct an extensive PCC dataset (the largest manually labeled PCC dataset to our knowledge) to revisit all state-of-the-art PCC techniques. More specifically, our PCC dataset includes 1,988 patches generated from the recent PraPR APR tool, which leverages highly-optimized bytecode-level patch executions and can exhaustively explore all possible plausible patches within its large predefined search space (including well-known fixing patterns from various prior APR tools). Our extensive study of representative PCC techniques on the new dataset has revealed various surprising findings and provided guidelines for future PCC research. △ Less

Submitted 8 February, 2023; v1 submitted 13 July, 2022; originally announced July 2022.

ACM Class: D.2.5

Memory-Based Label-Text Tuning for Few-Shot Class-Incremental Learning

Authors: Jinze Li, Yan Bai, Yihang Lou, Xiongkun Linghu, Jianzhong He, Shaoyun Xu, Tao Bai

Abstract: Few-shot class-incremental learning(FSCIL) focuses on designing learning algorithms that can continually learn a sequence of new tasks from a few samples without forgetting old ones. The difficulties are that training on a sequence of limited data from new tasks leads to severe overfitting issues and causes the well-known catastrophic forgetting problem. Existing researches mainly utilize the imag… ▽ More Few-shot class-incremental learning(FSCIL) focuses on designing learning algorithms that can continually learn a sequence of new tasks from a few samples without forgetting old ones. The difficulties are that training on a sequence of limited data from new tasks leads to severe overfitting issues and causes the well-known catastrophic forgetting problem. Existing researches mainly utilize the image information, such as storing the image knowledge of previous tasks or limiting classifiers updating. However, they ignore analyzing the informative and less noisy text information of class labels. In this work, we propose leveraging the label-text information by adopting the memory prompt. The memory prompt can learn new data sequentially, and meanwhile store the previous knowledge. Furthermore, to optimize the memory prompt without undermining the stored knowledge, we propose a stimulation-based training strategy. It optimizes the memory prompt depending on the image embedding stimulation, which is the distribution of the image embedding elements. Experiments show that our proposed method outperforms all prior state-of-the-art approaches, significantly mitigating the catastrophic forgetting and overfitting problems. △ Less

Submitted 3 July, 2022; originally announced July 2022.

Switchable Representation Learning Framework with Self-compatibility

Authors: Shengsen Wu, Yan Bai, Yihang Lou, Xiongkun Linghu, Jianzhong He, Ling-Yu Duan

Abstract: Real-world visual search systems involve deployments on multiple platforms with different computing and storage resources. Deploying a unified model that suits the minimal-constrain platforms leads to limited accuracy. It is expected to deploy models with different capacities adapting to the resource constraints, which requires features extracted by these models to be aligned in the metric space.… ▽ More Real-world visual search systems involve deployments on multiple platforms with different computing and storage resources. Deploying a unified model that suits the minimal-constrain platforms leads to limited accuracy. It is expected to deploy models with different capacities adapting to the resource constraints, which requires features extracted by these models to be aligned in the metric space. The method to achieve feature alignments is called ``compatible learning''. Existing research mainly focuses on the one-to-one compatible paradigm, which is limited in learning compatibility among multiple models. We propose a Switchable representation learning Framework with Self-Compatibility (SFSC). SFSC generates a series of compatible sub-models with different capacities through one training process. The optimization of sub-models faces gradients conflict, and we mitigate this problem from the perspective of the magnitude and direction. We adjust the priorities of sub-models dynamically through uncertainty estimation to co-optimize sub-models properly. Besides, the gradients with conflicting directions are projected to avoid mutual interference. SFSC achieves state-of-the-art performance on the evaluated datasets. △ Less

Submitted 23 March, 2023; v1 submitted 16 June, 2022; originally announced June 2022.

Comments: Accepted by CVPR 2023

Multi-component decompositions, linear superpositions, and new nonlinear integrable coupled KdV-type systems

Authors: Xiazhi Hao, S. Y. Lou

Abstract: The existence of decompositions of the nonlinear integrable systems not only permits us to establish so-called linear superposition solutions but also to derive new nonlinear integrable coupled systems. Restricting our attention to the single component decompositions of the potential BKP hierarchy, we obtain that suitable linear superpositions of some decomposition solutions still satisfy the same… ▽ More The existence of decompositions of the nonlinear integrable systems not only permits us to establish so-called linear superposition solutions but also to derive new nonlinear integrable coupled systems. Restricting our attention to the single component decompositions of the potential BKP hierarchy, we obtain that suitable linear superpositions of some decomposition solutions still satisfy the same equations. In parallel, successful attempts are made by multi-component decompositions of the potential BKP hierarchy to construct linear superposition solutions and new nonlinear integrable coupled KdV-type systems that a change of dependent variables cannot decouple. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Comments: 17 pages, 0 figures

A Hamilton-Jacobi Approach to Evolution of Dispersal

Authors: King-Yeung Lam, Yuan Lou, Benoit Perthame

Abstract: The evolution of dispersal is a classical question in evolutionary biology, and it has been studied in a wide range of mathematical models. A selection-mutation model, in which the population is structured by space and a phenotypic trait, with the trait acting directly on the dispersal (diffusion) rate, was formulated by Perthame and Souganidis [Math. Model. Nat. Phenom. 11 (2016), 154-166] to stu… ▽ More The evolution of dispersal is a classical question in evolutionary biology, and it has been studied in a wide range of mathematical models. A selection-mutation model, in which the population is structured by space and a phenotypic trait, with the trait acting directly on the dispersal (diffusion) rate, was formulated by Perthame and Souganidis [Math. Model. Nat. Phenom. 11 (2016), 154-166] to study the evolution of random dispersal towards the evolutionarily stable strategy. For the rare mutation limit, it was shown that the equilibrium population concentrates on a single trait associated to the smallest dispersal rate. In this paper, we consider the corresponding evolution equation and characterize the asymptotic behaviors of the time-dependent solutions in the rare mutation limit, under mild convexity assumptions on the underlying Hamiltonian function. △ Less

Submitted 11 May, 2022; originally announced May 2022.

MSC Class: 35B25; 35F21; 35K57; 92D15

Nonlinear manipulation of orbital angular momentum spectra with second- and third- harmonic generation in a quasi-periodically poled crystal

Authors: Yu-Xiang Yang, Bo-Wen Dong, Zhi-Cheng Ren, Hao Li, Yan-Chao Lou, Zi-Mo Cheng, Zhi-Feng Liu, Jianping Ding, Xi-Lin Wang, Hui-Tian Wang

Abstract: Optical orbital angular momentum (OAM), as an important degree of freedom of light, has been attracted extensive attention, due to its intrinsic feature of natural discrete infinite dimension. Manipulation of OAM spectra is crucial for many impressive applications from classical to quantum realms, in particular, nonlinear manipulation of OAM spectra. Here we realized the nonlinear manipulation of… ▽ More Optical orbital angular momentum (OAM), as an important degree of freedom of light, has been attracted extensive attention, due to its intrinsic feature of natural discrete infinite dimension. Manipulation of OAM spectra is crucial for many impressive applications from classical to quantum realms, in particular, nonlinear manipulation of OAM spectra. Here we realized the nonlinear manipulation of OAM spectra by using the simultaneous second- and third-harmonic generation in a single nonlinear crystal of quasi-periodically poled potassium titanyl phosphate, for fundamental waves with a variety of OAM spectra, especially for customized OAM spectra of the second and third harmonics. The experimental results confirmed the theoretical predictions. Our approach not only provides a novel way to manipulate OAM spectra at new shorter wavelengths that are hard to be directly generated, but also may find new applications towards multiplexing in classical optics and high-dimensional information processing in quantum optics. △ Less

Submitted 8 April, 2022; originally announced April 2022.

Comments: 5 pages, 4 figures

Third-harmonic generation of spatially structured light in a quasi-periodically poled crystal

Authors: Yan-Chao Lou, Zi-Mo Cheng, Yu-Xiang Yang, Zhi-Cheng Ren, Jianping Ding, Xi-Lin Wang, Hui-Tian Wang

Abstract: Nonlinear optical processes of spatially structured light, including optical vortex and vector optical fields, have stimulated a lot of interesting physical effects and found a variety of important applications ranging from optical imaging to quantum information processing. However, high harmonic generation of vector optical fields with space-varying polarization states is still a challenge. Here… ▽ More Nonlinear optical processes of spatially structured light, including optical vortex and vector optical fields, have stimulated a lot of interesting physical effects and found a variety of important applications ranging from optical imaging to quantum information processing. However, high harmonic generation of vector optical fields with space-varying polarization states is still a challenge. Here we demonstrate third harmonic generation of spatially structured light including vector optical fields, in a nonlinear Sagnac interferometer containing a carefully designed quasi-periodically poled potassium titanyl phosphate for the first time. The experimental results are in good agreement with the theoretical predictions. Our results will enable to manipulate spatially structured light or photons at new wavelengths and carrying higher orbital angular momentum. Our approach has the potential applications for the research of optical skyrmions and may open up new opportunities to produce spatially structured entangled photons for quantum communication and computation. △ Less

Submitted 8 April, 2022; originally announced April 2022.

Comments: 5 pages, 3 figures

Journal ref: Optica 9, 183-186 (2022)

Linear superposition in the general heavenly equation

Authors: S. Y. Lou, Xiazhi Hao

Abstract: Evidently, the linear superposition principle can not be exactly established as a general principle in the presence of nonlinearity, and, at the first glance, there is no expectation for it to hold even approximately. In this letter, it is shown that the balance of different nonlinear effects describes what linear superpositions may occur in nonlinear systems. The heavenly equations are of signifi… ▽ More Evidently, the linear superposition principle can not be exactly established as a general principle in the presence of nonlinearity, and, at the first glance, there is no expectation for it to hold even approximately. In this letter, it is shown that the balance of different nonlinear effects describes what linear superpositions may occur in nonlinear systems. The heavenly equations are of significance in several scientific fields, especially in relativity, gravity, field theory, and fluid dynamics. A special type of implicit shock wave solution with three two-dimensional arbitrary functions of the general heavenly equation is revealed. Restrict the two-dimensional arbitrary functions to some types of one-dimensional arbitrary functions, it is found that the nonlinear effects can be balanced such that the "impossible" linear superposition solutions can be nontrivially constituted to new solutions of the general heavenly equation. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Comments: 4pages

MSC Class: 35Q53; 37K10

A Learning Convolutional Neural Network Approach for Network Robustness Prediction

Authors: Yang Lou, Ruizi Wu, Junli Li, Lin Wang, Xiang Li, Guanrong Chen

Abstract: Network robustness is critical for various societal and industrial networks again malicious attacks. In particular, connectivity robustness and controllability robustness reflect how well a networked system can maintain its connectedness and controllability against destructive attacks, which can be quantified by a sequence of values that record the remaining connectivity and controllability of the… ▽ More Network robustness is critical for various societal and industrial networks again malicious attacks. In particular, connectivity robustness and controllability robustness reflect how well a networked system can maintain its connectedness and controllability against destructive attacks, which can be quantified by a sequence of values that record the remaining connectivity and controllability of the network after a sequence of node- or edge-removal attacks. Traditionally, robustness is determined by attack simulations, which are computationally very time-consuming or even practically infeasible. In this paper, an improved method for network robustness prediction is developed based on learning feature representation using convolutional neural network (LFR-CNN). In this scheme, higher-dimensional network data are compressed to lower-dimensional representations, and then passed to a CNN to perform robustness prediction. Extensive experimental studies on both synthetic and real-world networks, both directed and undirected, demonstrate that 1) the proposed LFR-CNN performs better than other two state-of-the-art prediction methods, with significantly lower prediction errors; 2) LFR-CNN is insensitive to the variation of the network size, which significantly extends its applicability; 3) although LFR-CNN needs more time to perform feature learning, it can achieve accurate prediction faster than attack simulations; 4) LFR-CNN not only can accurately predict network robustness, but also provides a good indicator for connectivity robustness, better than the classical spectral measures. △ Less

Submitted 20 March, 2022; originally announced March 2022.

Comments: 12 pages, 10 figures. IEEE Trans. Cybern. 2022

Journal ref: IEEE Transactions on Cybernetics, 2023, 53(7): 4531-4544

A Lifted $\ell_1 $ Framework for Sparse Recovery

Authors: Yaghoub Rahimi, Sung Ha Kang, Yifei Lou

Abstract: Motivated by re-weighted $\ell_1$ approaches for sparse recovery, we propose a lifted $\ell_1$ (LL1) regularization which is a generalized form of several popular regularizations in the literature. By exploring such connections, we discover there are two types of lifting functions which can guarantee that the proposed approach is equivalent to the $\ell_0$ minimization. Computationally, we design… ▽ More Motivated by re-weighted $\ell_1$ approaches for sparse recovery, we propose a lifted $\ell_1$ (LL1) regularization which is a generalized form of several popular regularizations in the literature. By exploring such connections, we discover there are two types of lifting functions which can guarantee that the proposed approach is equivalent to the $\ell_0$ minimization. Computationally, we design an efficient algorithm via the alternating direction method of multiplier (ADMM) and establish the convergence for an unconstrained formulation. Experimental results are presented to demonstrate how this generalization improves sparse recovery over the state-of-the-art. △ Less

Submitted 12 May, 2022; v1 submitted 9 March, 2022; originally announced March 2022.

Comments: 24 pages

MSC Class: 65K10; 49N45; 65F50; 90C90; 49M20

An Efficient Smoothing and Thresholding Image Segmentation Framework with Weighted Anisotropic-Isotropic Total Variation

Authors: Kevin Bui, Yifei Lou, Fredrick Park, Jack Xin

Abstract: In this paper, we design an efficient, multi-stage image segmentation framework that incorporates a weighted difference of anisotropic and isotropic total variation (AITV). The segmentation framework generally consists of two stages: smoothing and thresholding, thus referred to as SaT. In the first stage, a smoothed image is obtained by an AITV-regularized Mumford-Shah (MS) model, which can be sol… ▽ More In this paper, we design an efficient, multi-stage image segmentation framework that incorporates a weighted difference of anisotropic and isotropic total variation (AITV). The segmentation framework generally consists of two stages: smoothing and thresholding, thus referred to as SaT. In the first stage, a smoothed image is obtained by an AITV-regularized Mumford-Shah (MS) model, which can be solved efficiently by the alternating direction method of multipliers (ADMM) with a closed-form solution of a proximal operator of the $\ell_1 -α\ell_2$ regularizer. Convergence of the ADMM algorithm is analyzed. In the second stage, we threshold the smoothed image by $K$-means clustering to obtain the final segmentation result. Numerical experiments demonstrate that the proposed segmentation framework is versatile for both grayscale and color images, efficient in producing high-quality segmentation results within a few seconds, and robust to input images that are corrupted with noise, blur, or both. We compare the AITV method with its original convex TV and nonconvex TV$^p (0<p<1)$ counterparts, showcasing the qualitative and quantitative advantages of our proposed method. △ Less

Submitted 15 November, 2023; v1 submitted 21 February, 2022; originally announced February 2022.

Comments: final version sent to Springer CAMC

Integrable nonlinear Klein-Gordon systems with $\mathcal{PT}$ nonlocality and/or space-time exchange nonlocality

Authors: Man Jia, S. Y. Lou

Abstract: In additional to the parity ($\mathcal{P}$) symmetric, time reversal ($\mathcal{T}$) symmetric, and $\mathcal{PT}$ symmetric nonlocal integrable systems, some other types of nonlocal integrable Klein-Gordon models with the space-time exchange nonlocality and the moving nolocality are proposed. The Lax pairs of the established nonlinear nonlocal Klein-Gordon equations are explicitly given. A specia… ▽ More In additional to the parity ($\mathcal{P}$) symmetric, time reversal ($\mathcal{T}$) symmetric, and $\mathcal{PT}$ symmetric nonlocal integrable systems, some other types of nonlocal integrable Klein-Gordon models with the space-time exchange nonlocality and the moving nolocality are proposed. The Lax pairs of the established nonlinear nonlocal Klein-Gordon equations are explicitly given. A special soliton solution, composed of $\mathcal{PT}$-symmetric part and $\mathcal{PT}$-antisymmetric part, is illustrated with the shape change. △ Less

Submitted 22 February, 2022; v1 submitted 17 February, 2022; originally announced February 2022.

Journal ref: Applied Mathematics Letters, 130 (2022) 108018

One Student Knows All Experts Know: From Sparse to Dense

Authors: Fuzhao Xue, Xiaoxin He, Xiaozhe Ren, Yuxuan Lou, Yang You

Abstract: Human education system trains one student by multiple experts. Mixture-of-experts (MoE) is a powerful sparse architecture including multiple experts. However, sparse MoE model is easy to overfit, hard to deploy, and not hardware-friendly for practitioners. In this work, inspired by the human education model, we propose a novel task, knowledge integration, to obtain a dense student model (OneS) as… ▽ More Human education system trains one student by multiple experts. Mixture-of-experts (MoE) is a powerful sparse architecture including multiple experts. However, sparse MoE model is easy to overfit, hard to deploy, and not hardware-friendly for practitioners. In this work, inspired by the human education model, we propose a novel task, knowledge integration, to obtain a dense student model (OneS) as knowledgeable as one sparse MoE. We investigate this task by proposing a general training framework including knowledge gathering and knowledge distillation. Specifically, to gather key knowledge from different pre-trained experts, we first investigate four different possible knowledge gathering methods, \ie summation, averaging, Top-K Knowledge Gathering (Top-KG), and Singular Value Decomposition Knowledge Gathering (SVD-KG) proposed in this paper. We then refine the dense student model by knowledge distillation to offset the noise from gathering. On ImageNet, our OneS preserves $61.7\%$ benefits from MoE and achieves $78.4\%$ top-1 accuracy ImageNet with only $15$M parameters. On four natural language processing datasets, OneS obtains $88.2\%$ MoE benefits and outperforms the best baseline by $51.7\%$ using the same architecture and training data. In addition, compared with the MoE counterpart, OneS can achieve $3.7 \times$ inference speedup due to less computation and hardware-friendly architecture. △ Less

Submitted 25 October, 2022; v1 submitted 26 January, 2022; originally announced January 2022.

Simultaneous Location of Rail Vehicles and Mapping of Environment with Multiple LiDARs

Authors: Yusheng Wang, Weiwei Song, Yidong Lou, Fei Huang, Zhiyong Tu, Shimin Zhang

Abstract: Precise and real-time rail vehicle localization as well as railway environment monitoring is crucial for railroad safety. In this letter, we propose a multi-LiDAR based simultaneous localization and mapping (SLAM) system for railway applications. Our approach starts with measurements preprocessing to denoise and synchronize multiple LiDAR inputs. Different frame-to-frame registration methods are u… ▽ More Precise and real-time rail vehicle localization as well as railway environment monitoring is crucial for railroad safety. In this letter, we propose a multi-LiDAR based simultaneous localization and mapping (SLAM) system for railway applications. Our approach starts with measurements preprocessing to denoise and synchronize multiple LiDAR inputs. Different frame-to-frame registration methods are used according to the LiDAR placement. In addition, we leverage the plane constraints from extracted rail tracks to improve the system accuracy. The local map is further aligned with global map utilizing absolute position measurements. Considering the unavoidable metal abrasion and screw loosening, online extrinsic refinement is awakened for long-during operation. The proposed method is extensively verified on datasets gathered over 3000 km. The results demonstrate that the proposed system achieves accurate and robust localization together with effective mapping for large-scale environments. Our system has already been applied to a freight traffic railroad for monitoring tasks. △ Less

Submitted 25 December, 2021; originally announced December 2021.

Comments: arXiv admin note: text overlap with arXiv:2111.15043, arXiv:2112.08563

Rail Vehicle Localization and Mapping with LiDAR-Vision-Inertial-GNSS Fusion

Authors: Yusheng Wang, Weiwei Song, Yidong Lou, Yi Zhang, Fei Huang, Zhiyong Tu, Qiangsheng Liang

Abstract: In this paper, we present a global navigation satellite system (GNSS) aided LiDAR-visual-inertial scheme, RailLoMer-V, for accurate and robust rail vehicle localization and mapping. RailLoMer-V is formulated atop a factor graph and consists of two subsystems: an odometer assisted LiDAR-inertial system (OLIS) and an odometer integrated Visual-inertial system (OVIS). Both the subsystem exploits the… ▽ More In this paper, we present a global navigation satellite system (GNSS) aided LiDAR-visual-inertial scheme, RailLoMer-V, for accurate and robust rail vehicle localization and mapping. RailLoMer-V is formulated atop a factor graph and consists of two subsystems: an odometer assisted LiDAR-inertial system (OLIS) and an odometer integrated Visual-inertial system (OVIS). Both the subsystem exploits the typical geometry structure on the railroads. The plane constraints from extracted rail tracks are used to complement the rotation and vertical errors in OLIS. Besides, the line features and vanishing points are leveraged to constrain rotation drifts in OVIS. The proposed framework is extensively evaluated on datasets over 800 km, gathered for more than a year on both general-speed and high-speed railways, day and night. Taking advantage of the tightly-coupled integration of all measurements from individual sensors, our framework is accurate to long-during tasks and robust enough to grievously degenerated scenarios (railway tunnels). In addition, the real-time performance can be achieved with an onboard computer. △ Less

Submitted 15 December, 2021; originally announced December 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2111.15043

RailLoMer: Rail Vehicle Localization and Mapping with LiDAR-IMU-Odometer-GNSS Data Fusion

Authors: Yusheng Wang, Yidong Lou, Yi Zhang, Weiwei Song, Fei Huang, Zhiyong Tu, Shimin Zhang

Abstract: We present RailLoMer in this article, to achieve real-time accurate and robust odometry and mapping for rail vehicles. RailLoMer receives measurements from two LiDARs, an IMU, train odometer, and a global navigation satellite system (GNSS) receiver. As frontend, the estimated motion from IMU/odometer preintegration de-skews the denoised point clouds and produces initial guess for frame-to-frame Li… ▽ More We present RailLoMer in this article, to achieve real-time accurate and robust odometry and mapping for rail vehicles. RailLoMer receives measurements from two LiDARs, an IMU, train odometer, and a global navigation satellite system (GNSS) receiver. As frontend, the estimated motion from IMU/odometer preintegration de-skews the denoised point clouds and produces initial guess for frame-to-frame LiDAR odometry. As backend, a sliding window based factor graph is formulated to jointly optimize multi-modal information. In addition, we leverage the plane constraints from extracted rail tracks and the structure appearance descriptor to further improve the system robustness against repetitive structures. To ensure a globally-consistent and less blurry mapping result, we develop a two-stage mapping method that first performs scan-to-map in local scale, then utilizes the GNSS information to register the submaps. The proposed method is extensively evaluated on datasets gathered for a long time range over numerous scales and scenarios, and show that RailLoMer delivers decimeter-grade localization accuracy even in large or degenerated environments. We also integrate RailLoMer into an interactive train state and railway monitoring system prototype design, which has already been deployed to an experimental freight traffic railroad. △ Less

Submitted 29 November, 2021; originally announced November 2021.

Understanding Pixel-level 2D Image Semantics with 3D Keypoint Knowledge Engine

Authors: Yang You, Chengkun Li, Yujing Lou, Zhoujun Cheng, Liangwei Li, Lizhuang Ma, Weiming Wang, Cewu Lu

Abstract: Pixel-level 2D object semantic understanding is an important topic in computer vision and could help machine deeply understand objects (e.g. functionality and affordance) in our daily life. However, most previous methods directly train on correspondences in 2D images, which is end-to-end but loses plenty of information in 3D spaces. In this paper, we propose a new method on predicting image corres… ▽ More Pixel-level 2D object semantic understanding is an important topic in computer vision and could help machine deeply understand objects (e.g. functionality and affordance) in our daily life. However, most previous methods directly train on correspondences in 2D images, which is end-to-end but loses plenty of information in 3D spaces. In this paper, we propose a new method on predicting image corresponding semantics in 3D domain and then projecting them back onto 2D images to achieve pixel-level understanding. In order to obtain reliable 3D semantic labels that are absent in current image datasets, we build a large scale keypoint knowledge engine called KeypointNet, which contains 103,450 keypoints and 8,234 3D models from 16 object categories. Our method leverages the advantages in 3D vision and can explicitly reason about objects self-occlusion and visibility. We show that our method gives comparative and even superior results on standard semantic benchmarks. △ Less

Submitted 21 November, 2021; originally announced November 2021.

Comments: Accepted to IEEE Transactions on Pattern Analysis and Machine Intelligence; To appear in upcoming issues

MetroLoc: Metro Vehicle Mapping and Localization with LiDAR-Camera-Inertial Integration

Authors: Yusheng Wang, Weiwei Song, Yi Zhang, Fei Huang, Zhiyong Tu, Yidong Lou

Abstract: We propose an accurate and robust multi-modal sensor fusion framework, MetroLoc, towards one of the most extreme scenarios, the large-scale metro vehicle localization and mapping. MetroLoc is built atop an IMU-centric state estimator that tightly couples light detection and ranging (LiDAR), visual, and inertial information with the convenience of loosely coupled methods. The proposed framework is… ▽ More We propose an accurate and robust multi-modal sensor fusion framework, MetroLoc, towards one of the most extreme scenarios, the large-scale metro vehicle localization and mapping. MetroLoc is built atop an IMU-centric state estimator that tightly couples light detection and ranging (LiDAR), visual, and inertial information with the convenience of loosely coupled methods. The proposed framework is composed of three submodules: IMU odometry, LiDAR-inertial odometry (LIO), and Visual-inertial odometry (VIO). The IMU is treated as the primary sensor, which achieves the observations from LIO and VIO to constrain the accelerometer and gyroscope biases. Compared to previous point-only LIO methods, our approach leverages more geometry information by introducing both line and plane features into motion estimation. The VIO also utilizes the environmental structure information by employing both lines and points. Our proposed method has been extensively tested in the long-during metro environments with a maintenance vehicle. Experimental results show the system more accurate and robust than the state-of-the-art approaches with real-time performance. Besides, we develop a series of Virtual Reality (VR) applications towards efficient, economical, and interactive rail vehicle state and trackside infrastructure monitoring, which has already been deployed to an outdoor testing railroad. △ Less

Submitted 1 November, 2021; originally announced November 2021.

Feature Learning and Signal Propagation in Deep Neural Networks

Authors: Yizhang Lou, Chris Mingard, Yoonsoo Nam, Soufiane Hayou

Abstract: Recent work by Baratin et al. (2021) sheds light on an intriguing pattern that occurs during the training of deep neural networks: some layers align much more with data compared to other layers (where the alignment is defined as the euclidean product of the tangent features matrix and the data labels matrix). The curve of the alignment as a function of layer index (generally) exhibits an ascent-de… ▽ More Recent work by Baratin et al. (2021) sheds light on an intriguing pattern that occurs during the training of deep neural networks: some layers align much more with data compared to other layers (where the alignment is defined as the euclidean product of the tangent features matrix and the data labels matrix). The curve of the alignment as a function of layer index (generally) exhibits an ascent-descent pattern where the maximum is reached for some hidden layer. In this work, we provide the first explanation for this phenomenon. We introduce the Equilibrium Hypothesis which connects this alignment pattern to signal propagation in deep neural networks. Our experiments demonstrate an excellent match with the theoretical predictions. △ Less

Submitted 22 May, 2022; v1 submitted 22 October, 2021; originally announced October 2021.

Comments: 35 pages

Journal ref: International Conference on Machine Learning. PMLR, 2022

Localization with Sampling-Argmax

Authors: Jiefeng Li, Tong Chen, Ruiqi Shi, Yujing Lou, Yong-Lu Li, Cewu Lu

Abstract: Soft-argmax operation is commonly adopted in detection-based methods to localize the target position in a differentiable manner. However, training the neural network with soft-argmax makes the shape of the probability map unconstrained. Consequently, the model lacks pixel-wise supervision through the map during training, leading to performance degradation. In this work, we propose sampling-argmax,… ▽ More Soft-argmax operation is commonly adopted in detection-based methods to localize the target position in a differentiable manner. However, training the neural network with soft-argmax makes the shape of the probability map unconstrained. Consequently, the model lacks pixel-wise supervision through the map during training, leading to performance degradation. In this work, we propose sampling-argmax, a differentiable training method that imposes implicit constraints to the shape of the probability map by minimizing the expectation of the localization error. To approximate the expectation, we introduce a continuous formulation of the output distribution and develop a differentiable sampling process. The expectation can be approximated by calculating the average error of all samples drawn from the output distribution. We show that sampling-argmax can seamlessly replace the conventional soft-argmax operation on various localization tasks. Comprehensive experiments demonstrate the effectiveness and flexibility of the proposed method. Code is available at https://github.com/Jeff-sjtu/sampling-argmax △ Less

Submitted 17 October, 2021; originally announced October 2021.

Comments: NeurIPS 2021

A West Nile virus nonlocal model with free boundaries and seasonal succession

Authors: Liqiong Pu, Zhigui Lin, Yuan Lou

Abstract: The paper deals with a West Nile virus (WNv) model, where the nonlocal diffusion is introduced to characterize a long-range dispersal, the free boundary is used to describe the spreading front, and seasonal succession accounts for the effect of the warm and cold seasons. The well-posedness of the model is firstly given, its long-term dynamical behaviours are investigated and depend on the generali… ▽ More The paper deals with a West Nile virus (WNv) model, where the nonlocal diffusion is introduced to characterize a long-range dispersal, the free boundary is used to describe the spreading front, and seasonal succession accounts for the effect of the warm and cold seasons. The well-posedness of the model is firstly given, its long-term dynamical behaviours are investigated and depend on the generalized eigenvalues of the corresponding linear operator. For the spatial-independent WNv model with seasonal succession, the generalized eigenvalues are calculated and new properties are found. For the WNv nonlocal model with seasonal succession, the generalized eigenvalues are discussed. We then develop the indexes to the case with the free boundary and further use these indexes to judge whether spreading or vanishing happens. The criteria extends known results for the case with the nonlocal diffusion and the case with the free boundary. Moreover, the generalized eigenvalues reveal that there exists positive correlation between the duration of the warm season and the risk of infection. The index of the nonlocal free boundary problem, which depends on the time $t$, determines the spreading or vanishing of WNv. Moreover, the initial infection length, the initial infection scale and the spreading ability to the new area play an important role for the long time behavior of the solution. △ Less

Submitted 19 November, 2021; v1 submitted 15 October, 2021; originally announced October 2021.

Comments: 44 pages, 5 figures

MSC Class: 35K55; 35K57; 35R35; 92D30

GM-Livox: An Integrated Framework for Large-Scale Map Construction with Multiple Non-repetitive Scanning LiDARs

Authors: Yusheng Wang, Yidong Lou, Weiwei Song, Huan Yu, Zhiyong Tu

Abstract: With the ability of providing direct and accurate enough range measurements, light detection and ranging (LiDAR) is playing an essential role in localization and detection for autonomous vehicles. Since single LiDAR suffers from hardware failure and performance degradation intermittently, we present a multi-LiDAR integration scheme in this article. Our framework tightly couples multiple non-repeti… ▽ More With the ability of providing direct and accurate enough range measurements, light detection and ranging (LiDAR) is playing an essential role in localization and detection for autonomous vehicles. Since single LiDAR suffers from hardware failure and performance degradation intermittently, we present a multi-LiDAR integration scheme in this article. Our framework tightly couples multiple non-repetitive scanning LiDARs with inertial, encoder, and global navigation satellite system (GNSS) into pose estimation and simultaneous global map generation. Primarily, we formulate a precise synchronization strategy to integrate isolated sensors, and the extracted feature points from separate LiDARs are merged into a single sweep. The fused scans are introduced to compute the scan-matching correspondences, which can be further refined by additional real-time kinematic (RTK) measurements. Based thereupon, we construct a factor graph along with the inertial preintegration result, estimated ground constraints, and RTK data. For the purpose of maintaining a restricted number of poses for estimation, we deploy a keyframe based sliding-window optimization strategy in our system. The real-time performance is guaranteed with multi-threaded computation, and extensive experiments are conducted in challenging scenarios. Experimental results show that the utilization of multiple LiDARs boosts the system performance in both robustness and accuracy. △ Less

Submitted 11 October, 2021; originally announced October 2021.