Showing 1–50 of 60 results for author: Peng, L

Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares

Authors: Liangzu Peng, Wotao Yin

Abstract: Block coordinate descent is a powerful algorithmic template suitable for big data optimization. This template admits a lot of variants including block gradient descent (BGD), which performs gradient descent on a selected block of variables, while keeping other variables fixed. For a very long time, the stepsize for each block has tacitly been set to one divided by the block-wise Lipschitz smoothne… ▽ More Block coordinate descent is a powerful algorithmic template suitable for big data optimization. This template admits a lot of variants including block gradient descent (BGD), which performs gradient descent on a selected block of variables, while keeping other variables fixed. For a very long time, the stepsize for each block has tacitly been set to one divided by the block-wise Lipschitz smoothness constant, imitating the vanilla stepsize rule for gradient descent (GD). However, such a choice for BGD has not yet been able to theoretically justify its empirical superiority over GD, as existing convergence rates for BGD have worse constants than GD in the deterministic cases. To discover such theoretical justification, we set up a simple environment where we consider BGD applied to least-squares with two blocks of variables. Assuming the data matrix corresponding to each block is orthogonal, we find optimal stepsizes of BGD in closed form, which provably lead to asymptotic convergence rates twice as fast as GD with Polyak's momentum; this means, under that orthogonality assumption, one can accelerate BGD by just tuning stepsizes and without adding any momentum. An application that satisfies this assumption is \textit{generalized alternating projection} between two subspaces, and applying our stepsizes to it improves the prior convergence rate that was once claimed, slightly inaccurately, to be optimal. The main proof idea is to minimize, in stepsize variables, the spectral radius of a matrix that controls convergence rates. △ Less

Submitted 24 May, 2024; originally announced May 2024.

Comments: 36 pages, accepted to ICML 2024

Local existence and uniqueness of solution to the two-dimensional inhomogeneous Prandtl equations by energy method

Authors: Jincheng Gao, Lianyun Peng, Zheng-an Yao

Abstract: In this paper, we consider the local existence and uniqueness result for the inhomogeneous Prandtl equations in dimension two by energy method. First of all, for the homogeneous case, the local-in-time well-posedness theory of unsteady Prandtl equations was obtained by [Alexandre, Wang, Xu, Yang, J. Am. Math. Soc., 28 (3), 745-784 (2015)] and [Masmoudi, Wong, Comm. Pure Appl. Math., 68 (10), 1683-… ▽ More In this paper, we consider the local existence and uniqueness result for the inhomogeneous Prandtl equations in dimension two by energy method. First of all, for the homogeneous case, the local-in-time well-posedness theory of unsteady Prandtl equations was obtained by [Alexandre, Wang, Xu, Yang, J. Am. Math. Soc., 28 (3), 745-784 (2015)] and [Masmoudi, Wong, Comm. Pure Appl. Math., 68 (10), 1683-1741 (2015)] independently by energy method without any transformation. However, for the inhomogeneous case, the appearance of density will create some new difficulties for us to overcome the loss of tangential derivative of horizontal velocity. Thus, our first result is to overcome the loss of tangential derivative such that one can establish the local-in-time well-posedness result for the inhomogeneous Prandtl equations by energy method. Secondly, for the homogeneous case, the local-in-x well-posedness in higher regular space for the steady Prandtl equations was obtained by [Guo, Iyer, Comm. Math. Phys., 382 (3), 1403-447 (2021)] by energy method since they firstly found the good quantity(called `quotient'). With the help of this quotient, our second result is to establish the local-in-x well-posedness in higher regular Sobolev space for the steady inhomogeneous Prandtl equations. △ Less

Submitted 15 March, 2024; originally announced March 2024.

On F-polynomials for generalized quantum cluster algebras and Gupta's formula

Authors: Changjian Fu, Liangang Peng, Huihui Ye

Abstract: We show the existence of $F$-polynomials for generalized quantum cluster algebras and obtain the associated separation formulas under a mild condition. Along the way, we obtain Gupta's formulas of $F$-polynomials for generalized quantum cluster algebras. These formulas specialize to Gupta's formulas for quantum cluster algebras and cluster algebras respectively. Finally, a generalization of Gupt… ▽ More We show the existence of $F$-polynomials for generalized quantum cluster algebras and obtain the associated separation formulas under a mild condition. Along the way, we obtain Gupta's formulas of $F$-polynomials for generalized quantum cluster algebras. These formulas specialize to Gupta's formulas for quantum cluster algebras and cluster algebras respectively. Finally, a generalization of Gupta's formula has also been discussed in the setting of generalized cluster algebras. △ Less

Submitted 8 March, 2024; v1 submitted 28 January, 2024; originally announced January 2024.

Comments: 27 pages

Information geometry and $α$-parallel prior of the beta-logistic distribution

Authors: Lin Jiu, Linyu Peng

Abstract: The hyperbolic secant distribution has several generalizations with applications in finance. In this study, we explore the dual geometric structure of one such generalization, namely the beta-logistic distribution. Recent findings also interpret Bernoulli and Euler polynomials as moments of specific random variables, treating them as special cases within the framework of the beta-logistic distribu… ▽ More The hyperbolic secant distribution has several generalizations with applications in finance. In this study, we explore the dual geometric structure of one such generalization, namely the beta-logistic distribution. Recent findings also interpret Bernoulli and Euler polynomials as moments of specific random variables, treating them as special cases within the framework of the beta-logistic distribution. The current study also uncovers that the beta-logistic distribution admits an $α$-parallel prior for any real number $α$, that has the potential for application in geometric statistical inference. △ Less

Submitted 17 December, 2023; originally announced December 2023.

MSC Class: 53B12; 11B68

Federated Learning with Convex Global and Local Constraints

Authors: Chuan He, Le Peng, Ju Sun

Abstract: In practice, many machine learning (ML) problems come with constraints, and their applied domains involve distributed sensitive data that cannot be shared with others, e.g., in healthcare. Collaborative learning in such practical scenarios entails federated learning (FL) for ML problems with constraints, or FL with constraints for short. Despite the extensive developments of FL techniques in recen… ▽ More In practice, many machine learning (ML) problems come with constraints, and their applied domains involve distributed sensitive data that cannot be shared with others, e.g., in healthcare. Collaborative learning in such practical scenarios entails federated learning (FL) for ML problems with constraints, or FL with constraints for short. Despite the extensive developments of FL techniques in recent years, these techniques only deal with unconstrained FL problems or FL problems with simple constraints that are amenable to easy projections. There is little work dealing with FL problems with general constraints. To fill this gap, we take the first step toward building an algorithmic framework for solving FL problems with general constraints. In particular, we propose a new FL algorithm for constrained ML problems based on the proximal augmented Lagrangian (AL) method. Assuming convex objective and convex constraints plus other mild conditions, we establish the worst-case complexity of the proposed algorithm. Our numerical experiments show the effectiveness of our algorithm in performing Neyman-Pearson classification and fairness-aware learning with nonconvex constraints, in an FL setting. △ Less

Submitted 1 May, 2024; v1 submitted 16 October, 2023; originally announced October 2023.

Comments: Accepted by Transactions on Machine Learning Research. Code associated with this paper can be found in https://github.com/PL97/Constr_FL

MSC Class: 65Y20 68W15 90C60

Multi-fidelity climate model parameterization for better generalization and extrapolation

Authors: Mohamed Aziz Bhouri, Liran Peng, Michael S. Pritchard, Pierre Gentine

Abstract: Machine-learning-based parameterizations (i.e. representation of sub-grid processes) of global climate models or turbulent simulations have recently been proposed as a powerful alternative to physical, but empirical, representations, offering a lower computational cost and higher accuracy. Yet, those approaches still suffer from a lack of generalization and extrapolation beyond the training data,… ▽ More Machine-learning-based parameterizations (i.e. representation of sub-grid processes) of global climate models or turbulent simulations have recently been proposed as a powerful alternative to physical, but empirical, representations, offering a lower computational cost and higher accuracy. Yet, those approaches still suffer from a lack of generalization and extrapolation beyond the training data, which is however critical to projecting climate change or unobserved regimes of turbulence. Here we show that a multi-fidelity approach, which integrates datasets of different accuracy and abundance, can provide the best of both worlds: the capacity to extrapolate leveraging the physically-based parameterization and a higher accuracy using the machine-learning-based parameterizations. In an application to climate modeling, the multi-fidelity framework yields more accurate climate projections without requiring major increase in computational resources. Our multi-fidelity randomized prior networks (MF-RPNs) combine physical parameterization data as low-fidelity and storm-resolving historical run's data as high-fidelity. To extrapolate beyond the training data, the MF-RPNs are tested on high-fidelity warming scenarios, $+4K$, data. We show the MF-RPN's capacity to return much more skillful predictions compared to either low- or high-fidelity (historical data) simulations trained only on one regime while providing trustworthy uncertainty quantification across a wide range of scenarios. Our approach paves the way for the use of machine-learning based methods that can optimally leverage historical observations or high-fidelity simulations and extrapolate to unseen regimes such as climate change. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 27 pages, 16 figures

The difference variational bicomplex and multisymplectic systems

Authors: Linyu Peng, Peter E. Hydon

Abstract: The difference variational bicomplex, which is the natural setting for systems of difference equations, is constructed and used to examine the geometric and algebraic properties of various systems. Exactness of the bicomplex gives a coordinate-free setting for finite difference variational problems, Euler--Lagrange equations and Noether's theorem. We also examine the connection between the conditi… ▽ More The difference variational bicomplex, which is the natural setting for systems of difference equations, is constructed and used to examine the geometric and algebraic properties of various systems. Exactness of the bicomplex gives a coordinate-free setting for finite difference variational problems, Euler--Lagrange equations and Noether's theorem. We also examine the connection between the condition for existence of a Hamiltonian and the multisymplecticity of systems of partial difference equations. Furthermore, we define difference multimomentum maps of multisymplectic systems, which yield their conservation laws. To conclude, we demonstrate how multisymplectic integrators can be comprehended even on non-uniform meshes through a generalized difference variational bicomplex. △ Less

Submitted 25 July, 2023; originally announced July 2023.

Comments: 24 pages

Well-posedness and exponential stability of the inhomogeneous anisotropic incompressible Navier-Stokes equation with far-field vacuum in two-dimensional whole space

Authors: Jincheng Gao, Lianyun Peng, Zheng-an Yao

Abstract: In this paper, we investigate the well-posedness theory and exponential stability for the inhomogeneous incompressible Navier-Stokes equation with only horizontal dissipative structure. Due to the lack of the vertical dissipative term and appearance of vacuum, it is a highly challenging tricky problem for us to study the well-posedness, stability and large-time behavior problems in two-dimensional… ▽ More In this paper, we investigate the well-posedness theory and exponential stability for the inhomogeneous incompressible Navier-Stokes equation with only horizontal dissipative structure. Due to the lack of the vertical dissipative term and appearance of vacuum, it is a highly challenging tricky problem for us to study the well-posedness, stability and large-time behavior problems in two-dimensional whole space. The local-in-time well-posedness theory is successfully established at first because we develop some good estimates for the density and vorticity to control the nonlinear term. Finally, these good estimates of density and vorticity help us to establish the global-in-time well-posedness and exponential stability if the initial velocity is suitable small. △ Less

Submitted 25 November, 2023; v1 submitted 16 June, 2023; originally announced June 2023.

Block Coordinate Descent on Smooth Manifolds: Convergence Theory and Twenty-One Examples

Authors: Liangzu Peng, René Vidal

Abstract: Block coordinate descent is an optimization paradigm that iteratively updates one block of variables at a time, making it quite amenable to big data applications due to its scalability and performance. Its convergence behavior has been extensively studied in the (block-wise) convex case, but it is much less explored in the non-convex case. In this paper we analyze the convergence of block coordina… ▽ More Block coordinate descent is an optimization paradigm that iteratively updates one block of variables at a time, making it quite amenable to big data applications due to its scalability and performance. Its convergence behavior has been extensively studied in the (block-wise) convex case, but it is much less explored in the non-convex case. In this paper we analyze the convergence of block coordinate methods on non-convex sets and derive convergence rates on smooth manifolds under natural or weaker assumptions than prior work. Our analysis applies to many non-convex problems, including ones that seek low-dimensional structures (e.g., maximal coding rate reduction, neural collapse, reverse engineering adversarial attacks, generalized PCA, alternating projection); ones that seek combinatorial structures (homomorphic sensing, regression without correspondences, real phase retrieval, robust point matching); ones that seek geometric structures from visual data (e.g., essential matrix estimation, absolute pose estimation); and ones that seek inliers sparsely hidden in a large number of outliers (e.g., outlier-robust estimation via iteratively-reweighted least-squares). While our convergence theory applies to all these problems, yielding novel corollaries, it also applies to other, perhaps more familiar, problems (e.g., optimal transport, matrix factorization, Burer-Monteiro factorization), recovering previously known results. △ Less

Submitted 12 October, 2023; v1 submitted 24 May, 2023; originally announced May 2023.

Semi-derived Ringel-Hall algebras and Hall algebras of odd-periodic relative derived categories

Authors: Ji Lin, Liangang Peng

Abstract: Let $t$ be a positive integer and $\mathcal{A}$ a hereditary abelian category satisfying some finiteness conditions. We define the semi-derived Ringel-Hall algebra of $\mathcal{A}$ from the category $\mathcal{C}_{\mathbb{Z}/t}(\mathcal{A})$ of $\mathbb{Z}/t$-graded complexes and obtain a natural basis of the semi-derived Ringel-Hall algebra. Moreover, we describe the semi-derived Ringel-Hall algeb… ▽ More Let $t$ be a positive integer and $\mathcal{A}$ a hereditary abelian category satisfying some finiteness conditions. We define the semi-derived Ringel-Hall algebra of $\mathcal{A}$ from the category $\mathcal{C}_{\mathbb{Z}/t}(\mathcal{A})$ of $\mathbb{Z}/t$-graded complexes and obtain a natural basis of the semi-derived Ringel-Hall algebra. Moreover, we describe the semi-derived Ringel-Hall algebra by the generators and defining relations. In particular, if $t$ is an odd integer, we show that there is an embedding of derived Hall algebra of the odd-periodic relative derived category in the extended semi-derived Ringel-Hall algebra. △ Less

Submitted 23 April, 2023; originally announced April 2023.

Comments: Comments are welcome and it has been accepted for publication in SCIENCE CHINA Mathematics

MSC Class: (2010): 18E10; 18E30; 16S85

Statistical Inference for Ultrahigh Dimensional Location Parameter Based on Spatial Median

Authors: Guanghui Cheng, Liuhua Peng, Changliang Zou

Abstract: Motivated by the widely used geometric median-of-means estimator in machine learning, this paper studies statistical inference for ultrahigh dimensionality location parameter based on the sample spatial median under a general multivariate model, including simultaneous confidence intervals construction, global tests, and multiple testing with false discovery rate control. To achieve these goals, we… ▽ More Motivated by the widely used geometric median-of-means estimator in machine learning, this paper studies statistical inference for ultrahigh dimensionality location parameter based on the sample spatial median under a general multivariate model, including simultaneous confidence intervals construction, global tests, and multiple testing with false discovery rate control. To achieve these goals, we derive a novel Bahadur representation of the sample spatial median with a maximum-norm bound on the remainder term, and establish Gaussian approximation for the sample spatial median over the class of hyperrectangles. In addition, a multiplier bootstrap algorithm is proposed to approximate the distribution of the sample spatial median. The approximations are valid when the dimension diverges at an exponentially rate of the sample size, which facilitates the application of the spatial median in the ultrahigh dimensional region. The proposed approaches are further illustrated by simulations and analysis of a genomic dataset from a microarray study. △ Less

Submitted 8 January, 2023; originally announced January 2023.

Extreme Continuous Treatment Effects: Measures, Estimation and Inference

Authors: Wei Huang, Shuo Li, Liuhua Peng

Abstract: This paper concerns estimation and inference for treatment effects in deep tails of the counterfactual distribution of unobservable potential outcomes corresponding to a continuously valued treatment. We consider two measures for the deep tail characteristics: the extreme quantile function and the tail mean function defined as the conditional mean beyond a quantile level. Then we define the extrem… ▽ More This paper concerns estimation and inference for treatment effects in deep tails of the counterfactual distribution of unobservable potential outcomes corresponding to a continuously valued treatment. We consider two measures for the deep tail characteristics: the extreme quantile function and the tail mean function defined as the conditional mean beyond a quantile level. Then we define the extreme quantile treatment effect (EQTE) and the extreme average treatment effect (EATE), which can be identified through the commonly adopted unconfoundedness condition and estimated with the aid of extreme value theory. Our limiting theory is for the EQTE and EATE processes indexed by a set of quantile levels and hence facilitates uniform inference. Simulations suggest that our method works well in finite samples and an empirical application illustrates its practical merit. △ Less

Submitted 1 September, 2022; originally announced September 2022.

Global Linear and Local Superlinear Convergence of IRLS for Non-Smooth Robust Regression

Authors: Liangzu Peng, Christian Kümmerle, René Vidal

Abstract: We advance both the theory and practice of robust $\ell_p$-quasinorm regression for $p \in (0,1]$ by using novel variants of iteratively reweighted least-squares (IRLS) to solve the underlying non-smooth problem. In the convex case, $p=1$, we prove that this IRLS variant converges globally at a linear rate under a mild, deterministic condition on the feature matrix called the \textit{stable range… ▽ More We advance both the theory and practice of robust $\ell_p$-quasinorm regression for $p \in (0,1]$ by using novel variants of iteratively reweighted least-squares (IRLS) to solve the underlying non-smooth problem. In the convex case, $p=1$, we prove that this IRLS variant converges globally at a linear rate under a mild, deterministic condition on the feature matrix called the \textit{stable range space property}. In the non-convex case, $p\in(0,1)$, we prove that under a similar condition, IRLS converges locally to the global minimizer at a superlinear rate of order $2-p$; the rate becomes quadratic as $p\to 0$. We showcase the proposed methods in three applications: real phase retrieval, regression without correspondences, and robust face restoration. The results show that (1) IRLS can handle a larger number of outliers than other methods, (2) it is faster than competing methods at the same level of accuracy, (3) it restores a sparsely corrupted face image with satisfactory visual quality. https://github.com/liangzu/IRLS-NeurIPS2022 △ Less

Submitted 11 October, 2022; v1 submitted 24 August, 2022; originally announced August 2022.

Comments: Accepted to NeurIPS 2022

Towards Understanding The Semidefinite Relaxations of Truncated Least-Squares in Robust Rotation Search

Authors: Liangzu Peng, Mahyar Fazlyab, René Vidal

Abstract: The rotation search problem aims to find a 3D rotation that best aligns a given number of point pairs. To induce robustness against outliers for rotation search, prior work considers truncated least-squares (TLS), which is a non-convex optimization problem, and its semidefinite relaxation (SDR) as a tractable alternative. Whether this SDR is theoretically tight in the presence of noise, outliers,… ▽ More The rotation search problem aims to find a 3D rotation that best aligns a given number of point pairs. To induce robustness against outliers for rotation search, prior work considers truncated least-squares (TLS), which is a non-convex optimization problem, and its semidefinite relaxation (SDR) as a tractable alternative. Whether this SDR is theoretically tight in the presence of noise, outliers, or both has remained largely unexplored. We derive conditions that characterize the tightness of this SDR, showing that the tightness depends on the noise level, the truncation parameters of TLS, and the outlier distribution (random or clustered). In particular, we give a short proof for the tightness in the noiseless and outlier-free case, as opposed to the lengthy analysis of prior work. △ Less

Submitted 20 July, 2022; v1 submitted 17 July, 2022; originally announced July 2022.

Comments: presented in part in ECCV 2022

A stochastic Hamiltonian formulation applied to dissipative particle dynamics

Authors: Linyu Peng, Noriyoshi Arai, Kenji Yasuoka

Abstract: In this paper, a stochastic Hamiltonian formulation (SHF) is proposed and applied to dissipative particle dynamics (DPD) simulations. As an extension of Hamiltonian dynamics to stochastic dissipative systems, the SHF provides necessary foundations and great convenience for constructing efficient numerical integrators. As a first attempt, we develop the Störmer--Verlet type of schemes based on the… ▽ More In this paper, a stochastic Hamiltonian formulation (SHF) is proposed and applied to dissipative particle dynamics (DPD) simulations. As an extension of Hamiltonian dynamics to stochastic dissipative systems, the SHF provides necessary foundations and great convenience for constructing efficient numerical integrators. As a first attempt, we develop the Störmer--Verlet type of schemes based on the SHF, which are structure-preserving for deterministic Hamiltonian systems without external forces, the dissipative forces in DPD. Long-time behaviour of the schemes is shown numerically by studying the damped Kubo oscillator. In particular, the proposed schemes include the conventional Groot-Warren's modified velocity-Verlet method and a modified version of Gibson-Chen-Chynoweth as special cases. The schemes are applied to DPD simulations and analysed numerically. △ Less

Submitted 25 March, 2022; v1 submitted 22 March, 2022; originally announced March 2022.

Comments: 20 pages, 5 figures

Journal ref: Applied Mathematics and Computation 426, 127126, 2022

Recent Advances in Conservation-Dissipation Formalism for Irreversible Processes

Authors: Liangrong Peng, Liu Hong

Abstract: The main purpose of this review is to summarize the recent advances of the Conservation-Dissipation Formalism (CDF), a new way for constructing both thermodynamically compatible and mathematically stable and well-posed models for irreversible processes. The contents include but are not restricted to the CDF's physical motivations, mathematical foundations, formulations of several classical models… ▽ More The main purpose of this review is to summarize the recent advances of the Conservation-Dissipation Formalism (CDF), a new way for constructing both thermodynamically compatible and mathematically stable and well-posed models for irreversible processes. The contents include but are not restricted to the CDF's physical motivations, mathematical foundations, formulations of several classical models in mathematical physics from master equations and Fokker-Planck equations to Boltzmann equations and quasi-linear Maxwell equations, as well as novel applications in the fields of non-Fourier heat conduction, non-Newtonian viscoelastic fluids, wave propagation/transportation in geophysics and neural science, soft matter physics, \textit{etc.} Connections with other popular theories in the field of non-equilibrium thermodynamics are examined too. △ Less

Submitted 14 September, 2021; originally announced September 2021.

Comments: 38 pages, 2 figures

Eigenvalues of Autocovariance Matrix: A Practical Method to Identify the Koopman Eigenfrequencies

Authors: Yicun Zhen, Bertrand Chapron, Etienne Memin, Lin Peng

Abstract: To infer eigenvalues of the infinite-dimensional Koopman operator, we study the leading eigenvalues of the autocovariance matrix associated with a given observable of a dynamical system. For any observable $f$ for which all the time-delayed autocovariance exist, we construct a Hilbert space $\mathcal{H}_f$ and a Koopman-like operator $\mathcal{K}$ that acts on $\mathcal{H}_f$. We prove that the le… ▽ More To infer eigenvalues of the infinite-dimensional Koopman operator, we study the leading eigenvalues of the autocovariance matrix associated with a given observable of a dynamical system. For any observable $f$ for which all the time-delayed autocovariance exist, we construct a Hilbert space $\mathcal{H}_f$ and a Koopman-like operator $\mathcal{K}$ that acts on $\mathcal{H}_f$. We prove that the leading eigenvalues of the autocovariance matrix has one-to-one correspondence with the energy of $f$ that is represented by the eigenvectors of $\mathcal{K}$. The proof is associated to several representation theorems of isometric operators on a Hilbert space, and the weak-mixing property of the observables represented by the continuous spectrum. We also provide an alternative proof of the weakly mixing property. When $f$ is an observable of an ergodic dynamical system which has a finite invariant measure $μ$, $\mathcal{H}_f$ coincides with closure in $L^2(X,dμ)$ of Krylov subspace generated by $f$, and $\mathcal{K}$ coincides with the classical Koopman operator. The main theorem sheds light to the theoretical foundation of several semi-empirical methods, including singular spectrum analysis (SSA), data-adaptive harmonic analysis (DAHD), Hankel DMD and Hankel alternative view of Koopman analysis (HAVOK). It shows that, when the system is ergodic and has finite invariant measure, the leading temporal empirical orthogonal functions indeed correspond to the Koopman eigenfrequencies. A theorem-based practical methodology is then proposed to identify the eigenfrequencies of $\mathcal{K}$ from a given time series. It builds on the fact that the convergence of the renormalized eigenvalues of the Gram matrix is a necessary and sufficient condition for the existence of $\mathcal{K}-$eigenfrequencies. △ Less

Submitted 3 March, 2022; v1 submitted 5 July, 2021; originally announced July 2021.

Non-intrusive Nonlinear Model Reduction via Machine Learning Approximations to Low-dimensional Operators

Authors: Zhe Bai, Liqian Peng

Abstract: Although projection-based reduced-order models (ROMs) for parameterized nonlinear dynamical systems have demonstrated exciting results across a range of applications, their broad adoption has been limited by their intrusivity: implementing such a reduced-order model typically requires significant modifications to the underlying simulation code. To address this, we propose a method that enables tra… ▽ More Although projection-based reduced-order models (ROMs) for parameterized nonlinear dynamical systems have demonstrated exciting results across a range of applications, their broad adoption has been limited by their intrusivity: implementing such a reduced-order model typically requires significant modifications to the underlying simulation code. To address this, we propose a method that enables traditionally intrusive reduced-order models to be accurately approximated in a non-intrusive manner. Specifically, the approach approximates the low-dimensional operators associated with projection-based reduced-order models (ROMs) using modern machine-learning regression techniques. The only requirement of the simulation code is the ability to export the velocity given the state and parameters as this functionality is used to train the approximated low-dimensional operators. In addition to enabling nonintrusivity, we demonstrate that the approach also leads to very low computational complexity, achieving up to $1000\times$ reduction in run time. We demonstrate the effectiveness of the proposed technique on two types of PDEs. △ Less

Submitted 17 June, 2021; originally announced June 2021.

Quantized cohomological Hall algebra of the $d$-loop quiver revisited

Authors: Neil J. Y. Fan, Changjian Fu, Liangang Peng

Abstract: Let $Λ$ be the set of partitions of length $\geq 0$. We introduce an $\mathbb{N}$-graded algebra $\mathbb{A}_q^d(Λ)$ associated to $Λ$, which can be viewed as a quantization of the algebra of partitions defined by Reineke. The multiplication of $\mathbb{A}^d_q(Λ)$ has some kind of quasi-commutativity, and the associativity comes from combinatorial properties of certain polynomials appeared in the… ▽ More Let $Λ$ be the set of partitions of length $\geq 0$. We introduce an $\mathbb{N}$-graded algebra $\mathbb{A}_q^d(Λ)$ associated to $Λ$, which can be viewed as a quantization of the algebra of partitions defined by Reineke. The multiplication of $\mathbb{A}^d_q(Λ)$ has some kind of quasi-commutativity, and the associativity comes from combinatorial properties of certain polynomials appeared in the quantized cohomological Hall algebra $\mathcal{H}^d_q$ of the $d$-loop quiver. It turns out that $\mathbb{A}^d_q(Λ)$ is isomorphic to $\mathcal{H}^d_q$, thus can be viewed as a combinatorial realization for $\mathcal{H}^d_q$. △ Less

Submitted 5 June, 2021; originally announced June 2021.

Homomorphic Sensing of Subspace Arrangements

Authors: Liangzu Peng, Manolis C. Tsakiris

Abstract: Homomorphic sensing is a recent algebraic-geometric framework that studies the unique recovery of points in a linear subspace from their images under a given collection of linear maps. It has been successful in interpreting such a recovery in the case of permutations composed by coordinate projections, an important instance in applications known as unlabeled sensing, which models data that are out… ▽ More Homomorphic sensing is a recent algebraic-geometric framework that studies the unique recovery of points in a linear subspace from their images under a given collection of linear maps. It has been successful in interpreting such a recovery in the case of permutations composed by coordinate projections, an important instance in applications known as unlabeled sensing, which models data that are out of order and have missing values. In this paper, we provide tighter and simpler conditions that guarantee the unique recovery for the single-subspace case, extend the result to the case of a subspace arrangement, and show that the unique recovery in a single subspace is locally stable under noise. We specialize our results to several examples of homomorphic sensing such as real phase retrieval and unlabeled sensing. In so doing, in a unified way, we obtain conditions that guarantee the unique recovery for those examples, typically known via diverse techniques in the literature, as well as novel conditions for sparse and unsigned versions of unlabeled sensing. Similarly, our noise result also implies that the unique recovery in unlabeled sensing is locally stable. △ Less

Submitted 19 September, 2022; v1 submitted 9 June, 2020; originally announced June 2020.

Comments: 18 pages

Journal ref: Applied and Computational Harmonic Analysis, 55, 466-485 (2021)

Quantum cluster characters of Hall algebras revisited

Authors: Changjian Fu, Liangang Peng, Haicheng Zhang

Abstract: Let $Q$ be a finite acyclic valued quiver. We define a bialgebra structure and an integration map on the Hall algebra associated to the morphism category of projective representations of $Q$. As an application, we recover the surjective homomorphism defined in \cite{DXZ}, which realizes the principal coefficient quantum cluster algebra $\A_q(Q)$ as a sub-quotient of the Hall algebra of morphisms.… ▽ More Let $Q$ be a finite acyclic valued quiver. We define a bialgebra structure and an integration map on the Hall algebra associated to the morphism category of projective representations of $Q$. As an application, we recover the surjective homomorphism defined in \cite{DXZ}, which realizes the principal coefficient quantum cluster algebra $\A_q(Q)$ as a sub-quotient of the Hall algebra of morphisms. Moreover, we also recover the quantum Caldero--Chapoton formula, as well as some multiplication formulas between quantum Caldero--Chapoton characters. △ Less

Submitted 4 November, 2022; v1 submitted 21 May, 2020; originally announced May 2020.

Comments: 27 pages; accepted by Selecta Mathematica, New Series

Rational evaluation of various epidemic models based on the COVID-19 data of China

Authors: Wuyue Yang, Dongyan Zhang, Liangrong Peng, Changjing Zhuge, Liu Hong

Abstract: In this paper, based on the Akaike information criterion, root mean square error and robustness coefficient, a rational evaluation of various epidemic models/methods, including seven empirical functions, four statistical inference methods and five dynamical models, on their forecasting abilities is carried out. With respect to the outbreak data of COVID-19 epidemics in China, we find that before t… ▽ More In this paper, based on the Akaike information criterion, root mean square error and robustness coefficient, a rational evaluation of various epidemic models/methods, including seven empirical functions, four statistical inference methods and five dynamical models, on their forecasting abilities is carried out. With respect to the outbreak data of COVID-19 epidemics in China, we find that before the inflection point, all models fail to make a reliable prediction. The Logistic function consistently underestimates the final epidemic size, while the Gompertz's function makes an overestimation in all cases. Towards statistical inference methods, the methods of sequential Bayesian and time-dependent reproduction number are more accurate at the late stage of an epidemic. And the transition-like behavior of exponential growth method from underestimation to overestimation with respect to the inflection point might be useful for constructing a more reliable forecast. Compared to ODE-based SIR, SEIR and SEIR-AHQ models, the SEIR-QD and SEIR-PO models generally show a better performance on studying the COVID-19 epidemics, whose success we believe could be attributed to a proper trade-off between model complexity and fitting accuracy. Our findings not only are crucial for the forecast of COVID-19 epidemics, but also may apply to other infectious diseases. △ Less

Submitted 14 September, 2021; v1 submitted 12 March, 2020; originally announced March 2020.

Comments: 25 pages, 5 figures, 2 tables

Fisher-Rao Geometry and Jeffreys Prior for Pareto Distribution

Authors: Mingming Li, Huafei Sun, Linyu Peng

Abstract: In this paper, we investigate the Fisher-Rao geometry of the two-parameter family of Pareto distribution. We prove that its geometrical structure is isometric to the Poincaré upper half-plane model, and then study the corresponding geometrical features by presenting explicit expressions for connection, curvature and geodesics. It is then applied to Bayesian inference by considering the Jeffreys pr… ▽ More In this paper, we investigate the Fisher-Rao geometry of the two-parameter family of Pareto distribution. We prove that its geometrical structure is isometric to the Poincaré upper half-plane model, and then study the corresponding geometrical features by presenting explicit expressions for connection, curvature and geodesics. It is then applied to Bayesian inference by considering the Jeffreys prior determined by the volume form. In addition, the posterior distribution from the prior is computed, providing a systematic method to the Bayesian inference for Pareto distribution. △ Less

Submitted 12 July, 2019; originally announced July 2019.

Journal ref: Communications in Statistics - Theory and Methods 51(6), 1895-1910, 2022

An automatic dynamic balancer in a rotating mechanism with time-varying angular velocity

Authors: James A Wright, Linyu Peng

Abstract: We consider the system of a two ball automatic dynamic balancer attached to a rotating disc with nonconstant angular velocity. We directly compare the scenario of constant angular velocity with that when the acceleration of the rotor is taken into consideration. In doing so we show that there are cases where one must take the acceleration phase into consideration to obtain an accurate picture of t… ▽ More We consider the system of a two ball automatic dynamic balancer attached to a rotating disc with nonconstant angular velocity. We directly compare the scenario of constant angular velocity with that when the acceleration of the rotor is taken into consideration. In doing so we show that there are cases where one must take the acceleration phase into consideration to obtain an accurate picture of the dynamics. Similarly we identify cases where the acceleration phase of the disc may be ignored. Finally, we briefly consider nonmonotonic variations of the angular velocity, with a view of maximising the basin of attraction of the desired solution, corresponding to damped vibrations. △ Less

Submitted 10 June, 2019; originally announced June 2019.

Comments: 15 pages, 5 figures, 7 tables

Journal ref: Results in Applied Mathematics 2, 100015, 2019

Application of gradient descent algorithms based on geodesic distances

Authors: Xiaomin Duan, Huafei Sun, Linyu Peng

Abstract: In this paper, the Riemannian gradient algorithm and the natural gradient algorithm are applied to solve descent direction problems on the manifold of positive definite Hermitian matrices, where the geodesic distance is considered as the cost function. The first proposed problem is control for positive definite Hermitian matrix systems whose outputs only depend on their inputs. The geodesic distan… ▽ More In this paper, the Riemannian gradient algorithm and the natural gradient algorithm are applied to solve descent direction problems on the manifold of positive definite Hermitian matrices, where the geodesic distance is considered as the cost function. The first proposed problem is control for positive definite Hermitian matrix systems whose outputs only depend on their inputs. The geodesic distance is adopted as the difference of the output matrix and the target matrix. The controller to adjust the input is obtained such that the output matrix is as close as possible to the target matrix. We show the trajectory of the control input on the manifold using the Riemannian gradient algorithm. The second application is to compute the Karcher mean of a finite set of given Toeplitz positive definite Hermitian matrices, which is defined as the minimizer of the sum of geodesic distances. To obtain more efficient iterative algorithm compared with traditional ones, a natural gradient algorithm is proposed to compute the Karcher mean. Illustrative simulations are provided to show the computational behavior of the proposed algorithms. △ Less

Submitted 4 April, 2019; originally announced April 2019.

Comments: 13 pages, 11 figures

Journal ref: Science China: Information Sciences, 63, 152201, 2020

Statistical Einstein manifolds of exponential families with group-invariant potential functions

Authors: Linyu Peng, Zhenning Zhang

Abstract: This paper mainly contributes to a classification of statistical Einstein manifolds, namely statistical manifolds at the same time are Einstein manifolds. A statistical manifold is a Riemannian manifold, each of whose points is a probability distribution. With the Fisher information metric as a Riemannian metric, information geometry was developed to understand the intrinsic properties of statisti… ▽ More This paper mainly contributes to a classification of statistical Einstein manifolds, namely statistical manifolds at the same time are Einstein manifolds. A statistical manifold is a Riemannian manifold, each of whose points is a probability distribution. With the Fisher information metric as a Riemannian metric, information geometry was developed to understand the intrinsic properties of statistical models, which play important roles in statistical inference, etc. Among all these models, exponential families is one of the most important kinds, whose geometric structures are fully determined by their potential functions. To classify statistical Einstein manifolds, we derive partial differential equations for potential functions of exponential families; special solutions of these equations are obtained through the ansatz method as well as group-invariant solutions via reductions using Lie point symmetries. △ Less

Submitted 17 July, 2019; v1 submitted 4 April, 2019; originally announced April 2019.

Comments: 14 pages

Journal ref: Journal of Mathematical Analysis and Applications 479 (2), 2104-2118, 2019

Symmetries and reductions of integrable nonlocal partial differential equations

Authors: Linyu Peng

Abstract: In this paper, symmetry analysis is extended to study nonlocal differential equations, in particular two integrable nonlocal equations, the nonlocal nonlinear Schrödinger equation and the nonlocal modified Korteweg--de Vries equation. Lie point symmetries are obtained based on a general theory and used to reduce these equations to nonlocal and local ordinary differential equations separately; name… ▽ More In this paper, symmetry analysis is extended to study nonlocal differential equations, in particular two integrable nonlocal equations, the nonlocal nonlinear Schrödinger equation and the nonlocal modified Korteweg--de Vries equation. Lie point symmetries are obtained based on a general theory and used to reduce these equations to nonlocal and local ordinary differential equations separately; namely one symmetry may allow reductions to both nonlocal and local equations depending on how the invariant variables are chosen. For the nonlocal modified Korteweg--de Vries equation, analogously to the local situation, all reduced local equations are integrable. At the end, we also define complex transformations to connect nonlocal differential equations and differential-difference equations. △ Less

Submitted 4 July, 2019; v1 submitted 3 April, 2019; originally announced April 2019.

Comments: 10 pages

Journal ref: Symmetry 2019, 11(7), 884

Bootstrap inference for the finite population total under complex sampling designs

Authors: Zhonglei Wang, Jae Kwang Kim, Liuhua Peng

Abstract: Bootstrap is a useful tool for making statistical inference, but it may provide erroneous results under complex survey sampling. Most studies about bootstrap-based inference are developed under simple random sampling and stratified random sampling. In this paper, we propose a unified bootstrap method applicable to some complex sampling designs, including Poisson sampling and probability-proportion… ▽ More Bootstrap is a useful tool for making statistical inference, but it may provide erroneous results under complex survey sampling. Most studies about bootstrap-based inference are developed under simple random sampling and stratified random sampling. In this paper, we propose a unified bootstrap method applicable to some complex sampling designs, including Poisson sampling and probability-proportional-to-size sampling. Two main features of the proposed bootstrap method are that studentization is used to make inference, and the finite population is bootstrapped based on a multinomial distribution by incorporating the sampling information. We show that the proposed bootstrap method is second-order accurate using the Edgeworth expansion. Two simulation studies are conducted to compare the proposed bootstrap method with the Wald-type method, which is widely used in survey sampling. Results show that the proposed bootstrap method is better in terms of coverage rate especially when sample size is limited. △ Less

Submitted 6 January, 2019; originally announced January 2019.

Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning

Authors: Kevin T. Carlberg, Antony Jameson, Mykel J. Kochenderfer, Jeremy Morton, Liqian Peng, Freddie D. Witherden

Abstract: Data I/O poses a significant bottleneck in large-scale CFD simulations; thus, practitioners would like to significantly reduce the number of times the solution is saved to disk, yet retain the ability to recover any field quantity (at any time instance) a posteriori. The objective of this work is therefore to accurately recover missing CFD data a posteriori at any time instance, given that the sol… ▽ More Data I/O poses a significant bottleneck in large-scale CFD simulations; thus, practitioners would like to significantly reduce the number of times the solution is saved to disk, yet retain the ability to recover any field quantity (at any time instance) a posteriori. The objective of this work is therefore to accurately recover missing CFD data a posteriori at any time instance, given that the solution has been written to disk at only a relatively small number of time instances. We consider in particular high-order discretizations (e.g., discontinuous Galerkin), as such techniques are becoming increasingly popular for the simulation of highly separated flows. To satisfy this objective, this work proposes a methodology consisting of two stages: 1) dimensionality reduction and 2) dynamics learning. For dimensionality reduction, we propose a novel hierarchical approach. First, the method reduces the number of degrees of freedom within each element of the high-order discretization by applying autoencoders from deep learning. Second, the methodology applies principal component analysis to compress the global vector of encodings. This leads to a low-dimensional state, which associates with a nonlinear embedding of the original CFD data. For dynamics learning, we propose to apply regression techniques (e.g., kernel methods) to learn the discrete-time velocity characterizing the time evolution of this low-dimensional state. A numerical example on a large-scale CFD example characterized by nearly 13 million degrees of freedom illustrates the suitability of the proposed method in an industrial setting. △ Less

Submitted 28 May, 2019; v1 submitted 30 November, 2018; originally announced December 2018.

Comments: Accepted in Journal of Computational Physics

On class A Lorentzian 2-tori with poles II: Foliations by timelike lines

Authors: Liang Jin, Lu Peng, Xiaojun Cui

Abstract: We show that if $(\mathbb{T}^{2},g)$ is a class A Lorentzian 2-torus with timelike poles, then there exists a Lipschitz foliation by complete future-directed timelike geodesics with any pre-assigned asymptotic direction in the interior of the stable time cone. This is done by constructing certain $C^{1,1}$ solutions to the equation $g(\nabla u,\nabla u)=-1$ on the Abelian cover… ▽ More We show that if $(\mathbb{T}^{2},g)$ is a class A Lorentzian 2-torus with timelike poles, then there exists a Lipschitz foliation by complete future-directed timelike geodesics with any pre-assigned asymptotic direction in the interior of the stable time cone. This is done by constructing certain $C^{1,1}$ solutions to the equation $g(\nabla u,\nabla u)=-1$ on the Abelian cover $(\mathbb{R}^{2},g)$. △ Less

Submitted 27 November, 2018; originally announced November 2018.

Comments: 14 pages, 0 figures

Lyapunov exponent and variance in the CLT for products of random matrices related to random Fibonacci sequences

Authors: Rajeshwari Majumdar, Phanuel Mariano, Hugo Panzo, Lowen Peng, Anthony Sisti

Abstract: We consider three matrix models of order 2 with one random entry $ε$ and the other three entries being deterministic. In the first model, we let $ε\sim\textrm{Bernoulli}\left(\frac{1}{2}\right)$. For this model we develop a new technique to obtain estimates for the top Lyapunov exponent in terms of a multi-level recursion involving Fibonacci-like sequences. This in turn gives a new characterizatio… ▽ More We consider three matrix models of order 2 with one random entry $ε$ and the other three entries being deterministic. In the first model, we let $ε\sim\textrm{Bernoulli}\left(\frac{1}{2}\right)$. For this model we develop a new technique to obtain estimates for the top Lyapunov exponent in terms of a multi-level recursion involving Fibonacci-like sequences. This in turn gives a new characterization for the Lyapunov exponent in terms of these sequences. In the second model, we give similar estimates when $ε\sim\textrm{Bernoulli}\left(p\right)$ and $p\in [0,1]$ is a parameter. Both of these models are related to random Fibonacci sequences. In the last model, we compute the Lyapunov exponent exactly when the random entry is replaced with $ξε$ where $ε$ is a standard Cauchy random variable and $ξ$ is a real parameter. We then use Monte Carlo simulations to approximate the variance in the CLT for both parameter models. △ Less

Submitted 3 April, 2020; v1 submitted 6 September, 2018; originally announced September 2018.

Comments: 18 pages, 8 figures. to appear in Discrete and Continuous Dynamical Systems series b

MSC Class: 37H15 (Primary) 60B20; 60B15; 11B39 (Secondary)

On class A Lorentzian 2-tori with poles I: Closed geodesics pass through poles

Authors: Lu Peng, Liang Jin, Xiaojun Cui

Abstract: In this paper, by studying certain isometries on globally hyperbolic planes, we prove that if $p$ is a timelike pole on a class A Lorentzian 2-torus, then there exists a closed timelike geodesic passing through $p$ with any preassigned free homotopy class in the interior of the stable time cone. We also show a non-rigid result when timelike poles appear. In this paper, by studying certain isometries on globally hyperbolic planes, we prove that if $p$ is a timelike pole on a class A Lorentzian 2-torus, then there exists a closed timelike geodesic passing through $p$ with any preassigned free homotopy class in the interior of the stable time cone. We also show a non-rigid result when timelike poles appear. △ Less

Submitted 29 May, 2018; originally announced May 2018.

MSC Class: 53B30; 53C22; 53C50

Distributed Statistical Inference for Massive Data

Authors: Song Xi Chen, Liuhua Peng

Abstract: This paper considers distributed statistical inference for general symmetric statistics %that encompasses the U-statistics and the M-estimators in the context of massive data where the data can be stored at multiple platforms in different locations. In order to facilitate effective computation and to avoid expensive communication among different platforms, we formulate distributed statistics which… ▽ More This paper considers distributed statistical inference for general symmetric statistics %that encompasses the U-statistics and the M-estimators in the context of massive data where the data can be stored at multiple platforms in different locations. In order to facilitate effective computation and to avoid expensive communication among different platforms, we formulate distributed statistics which can be conducted over smaller data blocks. The statistical properties of the distributed statistics are investigated in terms of the mean square error of estimation and asymptotic distributions with respect to the number of data blocks. In addition, we propose two distributed bootstrap algorithms which are computationally effective and are able to capture the underlying distribution of the distributed statistics. Numerical simulation and real data applications of the proposed approaches are provided to demonstrate the empirical performance. △ Less

Submitted 28 May, 2018; originally announced May 2018.

Moving Frames and Noether's Finite Difference Conservation Laws I

Authors: E. L. Mansfield, A. Rojo-Echeburua, L. Peng, P. E. Hydon

Abstract: We consider the calculation of Euler--Lagrange systems of ordinary difference equations, including the difference Noether's Theorem, in the light of the recently-developed calculus of difference invariants and discrete moving frames. We introduce the difference moving frame, a natural discrete moving frame that is adapted to difference equations by prolongation conditions. For any Lagrangian tha… ▽ More We consider the calculation of Euler--Lagrange systems of ordinary difference equations, including the difference Noether's Theorem, in the light of the recently-developed calculus of difference invariants and discrete moving frames. We introduce the difference moving frame, a natural discrete moving frame that is adapted to difference equations by prolongation conditions. For any Lagrangian that is invariant under a Lie group action on the space of dependent variables, we show that the Euler--Lagrange equations can be calculated directly in terms of the invariants of the group action. Furthermore, Noether's conservation laws can be written in terms of a difference moving frame and the invariants. We show that this form of the laws can significantly ease the problem of solving the Euler--Lagrange equations, and we also show how to use a difference frame to integrate Lie group invariant difference equations. In this Part I, we illustrate the theory by applications to Lagrangians invariant under various solvable Lie groups. The theory is also generalized to deal with variational symmetries that do not leave the Lagrangian invariant. Apart from the study of systems that are inherently discrete, one significant application is to obtain geometric (variational) integrators that have finite difference approximations of the continuous conservation laws embedded \textit{a priori}. This is achieved by taking an invariant finite difference Lagrangian in which the discrete invariants have the correct continuum limit to their smooth counterparts. We show the calculations for a discretization of the Lagrangian for Euler's elastica, and compare our discrete solution to that of its smooth continuum limit. △ Less

Submitted 4 June, 2019; v1 submitted 1 April, 2018; originally announced April 2018.

Comments: 45 pages, 6 figures accepted version

MSC Class: 39A12; 69Q10; 22F05

Journal ref: Transactions of Mathematics and Its Applications, Volume 3, Issue 1, February 2019, tnz004

Modified Ringel-Hall Algebras, Green's formula and Derived Hall Algebras

Authors: Ji Lin, Liangang Peng

Abstract: In this paper we define the modified Ringel-Hall algebra $\cm\ch(\ca)$ of a hereditary abelian category $\ca$ from the category $C^b(\mathcal{A})$ of bounded $\mathbb{Z}$-graded complexes. Two main results have been obtained. One is to give a new proof of Green's formula on Ringel-Hall numbers by using the associative multiplication of the modified Ringel-Hall algebra. The other is to show that in… ▽ More In this paper we define the modified Ringel-Hall algebra $\cm\ch(\ca)$ of a hereditary abelian category $\ca$ from the category $C^b(\mathcal{A})$ of bounded $\mathbb{Z}$-graded complexes. Two main results have been obtained. One is to give a new proof of Green's formula on Ringel-Hall numbers by using the associative multiplication of the modified Ringel-Hall algebra. The other is to show that in certain twisted cases the derived Hall algebra can be embedded in the modified Ringel-Hall algebra. As a consequence of the second result, we get that in certain twisted cases the modified Ringel-Hall algebra is isomorphic to the tensor algebra of the derived Hall algebra and the torus of acyclic complexes and so the modified Ringel-Hall algebra is invariant under derived equivalences. △ Less

Submitted 23 April, 2018; v1 submitted 26 July, 2017; originally announced July 2017.

Comments: 18 pages

MSC Class: 18E10; 18E30; 16T10

Structure-preserving model reduction for marginally stable LTI systems

Authors: Liqian Peng, Kevin Carlberg

Abstract: This work proposes a structure-preserving model reduction method for marginally stable linear time-invariant (LTI) systems. In contrast to Lyapunov-stability-based approaches---which ensure the poles of the reduced system remain in the open left-half plane---the proposed method preserves marginal stability by reducing the subsystem with poles on the imaginary axis in a manner that ensures those po… ▽ More This work proposes a structure-preserving model reduction method for marginally stable linear time-invariant (LTI) systems. In contrast to Lyapunov-stability-based approaches---which ensure the poles of the reduced system remain in the open left-half plane---the proposed method preserves marginal stability by reducing the subsystem with poles on the imaginary axis in a manner that ensures those poles remain purely imaginary. In particular, the proposed method decomposes a marginally stable LTI system into (1) an asymptotically stable subsystem with eigenvalues in the open left-half plane and (2) a pure marginally stable subsystem with a purely imaginary spectrum. We propose a method based on inner-product projection and the Lyapunov inequality to reduce the first subsystem while preserving asymptotic stability. In addition, we demonstrate that the pure marginally stable subsystem is a generalized Hamiltonian system; we then propose a method based on symplectic projection to reduce this subsystem while preserving pure marginal stability. In addition, we propose both inner-product and symplectic balancing methods that balance the operators associated with two quadratic energy functionals while preserving asymptotic and pure marginal stability, respectively. We formulate a geometric perspective that enables a unified comparison of the proposed inner-product and symplectic projection methods. Numerical examples illustrate the ability of the method to reduce the dimensionality of marginally stable LTI systems while retaining accuracy and preserving marginal stability; further, the resulting reduced-order model yields a finite infinite-time energy, which arises from the pure marginally stable subsystem. △ Less

Submitted 20 April, 2017; v1 submitted 13 April, 2017; originally announced April 2017.

Comments: Fix a few typos

MSC Class: 65P10; 37M15; 34C20; 93A15; 37J25

Semi-derived Ringel-Hall algebras and Drinfeld double

Authors: Ming Lu, Liangang Peng

Abstract: Let $\mathcal{A}$ be an arbitrary hereditary abelian category that may not have enough projective objects. For example, $\mathcal{A}$ can be the category of finite-dimensional representations of a quiver or the category of coherent sheaves on a smooth projective curve or on a weighted projective line. Inspired by the works of Bridgeland and Gorsky, we define the semi-derived Ringel-Hall algebra of… ▽ More Let $\mathcal{A}$ be an arbitrary hereditary abelian category that may not have enough projective objects. For example, $\mathcal{A}$ can be the category of finite-dimensional representations of a quiver or the category of coherent sheaves on a smooth projective curve or on a weighted projective line. Inspired by the works of Bridgeland and Gorsky, we define the semi-derived Ringel-Hall algebra of $\mathcal{A}$, denoted by $\mathcal{S}\mathcal{D}\mathcal{H}_{\mathbb{Z}/2}(\mathcal{A})$, to be the localization of a quotient algebra of the Ringel-Hall algebra of the category of $\mathbb{Z}/2$-graded complexes over $\mathcal{A}$. We obtain the following three main results. The semi-derived Ringel-Hall algebra has a natural basis. A twisted version of the semi-derived Ringel-Hall algebra of $\mathcal{A}$ is isomorphic to the Drinfeld double of the twisted extended Ringel-Hall algebra $\mathcal{H}_{tw}^e(\mathcal{A})$ of $\mathcal{A}$. If $\mathcal{A}$ has a tilting object $T$, then its semi-derived Ringel-Hall algebra is isomorphic to the $\mathbb{Z}/2$-graded semi-derived Hall algebra $\mathcal{S}\mathcal{D}\mathcal{H}_{\mathbb{Z}/2}(\mathrm{add} T)$ of the exact category $\mathrm{add} T$ defined by Gorsky, and so is isomorphic to Bridgeland's Hall algebra of $\mod (\mathrm{End}(T)^{op})$. △ Less

Submitted 2 March, 2021; v1 submitted 10 August, 2016; originally announced August 2016.

Comments: 53 pages, minor changes, accepted by Adv. Math

MSC Class: 18E10; 16W30

Symmetries, conservation laws and Noether's theorem for differential-difference equations

Authors: Linyu Peng

Abstract: This paper mainly contributes to the extension of Noether's theorem to differential-difference equations. For that purpose, we first investigate the prolongation formula for continuous symmetries, which makes a characteristic representation possible. The relations of symmetries, conservation laws and the Fréchet derivative are also investigated. For non-variational equations, since Noether's theor… ▽ More This paper mainly contributes to the extension of Noether's theorem to differential-difference equations. For that purpose, we first investigate the prolongation formula for continuous symmetries, which makes a characteristic representation possible. The relations of symmetries, conservation laws and the Fréchet derivative are also investigated. For non-variational equations, since Noether's theorem is now available, the self-adjointness method is adapted to the computation of conservation laws for differential-difference equations. A couple of differential-difference equations are investigated as illustrative examples, including the Toda lattice and semi-discretisations of the Korteweg-de Vries (KdV) equation. In particular, the Volterra equation is taken as a running example. △ Less

Submitted 9 February, 2017; v1 submitted 4 July, 2016; originally announced July 2016.

Comments: 30 pages

Journal ref: Studies in Applied Mathematics 139 (3), 457-502, 2017

A multiscale mathematical model of tumour invasive growth

Authors: Lu Peng, Dumitru Trucu, Ping Lin, Alastair Thompson, Mark A. J. Chaplain

Abstract: Known as one of the hallmarks of cancer [30], cancer cell invasion of human body tissue is a complicated spatio-temporal multiscale process which enables a localised solid tumour to transform into a systemic, metastatic and fatal disease. This process explores and takes advantage of the reciprocal relation that solid tumours establish with the extracellular matrix (ECM) components and other multip… ▽ More Known as one of the hallmarks of cancer [30], cancer cell invasion of human body tissue is a complicated spatio-temporal multiscale process which enables a localised solid tumour to transform into a systemic, metastatic and fatal disease. This process explores and takes advantage of the reciprocal relation that solid tumours establish with the extracellular matrix (ECM) components and other multiple distinct cell types from the surrounding microenvironment. Through the secretion of various proteolytic enzymes such as matrix metalloproteinases (MMP) or the urokinase plasminogen activator (uPA), the cancer cell population alters the configuration of the surrounding ECM composition and overcomes the physical barriers to ultimately achieve local cancer spread into the surrounding tissue. The active interplay between the tissue-scale tumour dynamics and the molecular mechanics of the involved proteolytic enzymes at the cell-scale underlines the biologically multiscale character of invasion, and raises the challenge of modelling this process with an appropriate multiscale approach. In this paper, we present a new two-scale moving boundary model of cancer invasion that explores the tissue scale tumour dynamics in conjunction with the molecular dynamics of the urokinase plasminogen activation system. Building on the multiscale moving boundary method proposed in [58], the modelling that we propose here allows us to study the changes in tissue scale tumour morphology caused by the cell-scale uPA micro-dynamics occurring along the invasive edge of the tumour. Our computational simulation results demonstrate a range of heterogeneous dynamics which are qualitatively similar to the invasive growth patterns observed in a number of different types of cancer, such as the tumour infiltrative growth patterns discussed in [33]. △ Less

Submitted 24 March, 2016; originally announced March 2016.

Structure-Preserving Model Reduction of Forced Hamiltonian Systems

Authors: Liqian Peng, Kamran Mohseni

Abstract: This paper reports a development in the proper symplectic decomposition (PSD) for model reduction of forced Hamiltonian systems. As an analogy to the proper orthogonal decomposition (POD), PSD is designed to build a symplectic subspace to fit empirical data. Our aim is two-fold. First, to achieve computational savings for large-scale Hamiltonian systems with external forces. Second, to simultaneou… ▽ More This paper reports a development in the proper symplectic decomposition (PSD) for model reduction of forced Hamiltonian systems. As an analogy to the proper orthogonal decomposition (POD), PSD is designed to build a symplectic subspace to fit empirical data. Our aim is two-fold. First, to achieve computational savings for large-scale Hamiltonian systems with external forces. Second, to simultaneously preserve the symplectic structure and the forced structure of the original system. We first reformulate d'Alembert's principle in the Hamiltonian form. Corresponding to the integral and local forms of d'Alembert's principle, we propose two different structure-preserving model reduction approaches to reconstruct low-dimensional systems, based on the variational principle and on the structure-preserving projection, respectively. These two approaches are proven to yield the same reduced system. Moreover, by incorporating the vector field into the data ensemble, we provided several algorithms for energy preservation. In a special case when the external force is described by the Rayleigh dissipative function, the proposed method automatically preserves the dissipativity, boundedness, and stability of the original system. The stability, accuracy, and efficiency of the proposed method are illustrated through numerical simulations of a dissipative wave equation. △ Less

Submitted 10 March, 2016; originally announced March 2016.

Comments: 25 page, 8 figures

MSC Class: 65P10; 37M15; 34C20; 93A15; 37J25

Symplectic Model Reduction of Hamiltonian Systems

Authors: Liqian Peng, Kamran Mohseni

Abstract: In this paper, a symplectic model reduction technique, proper symplectic decomposition (PSD) with symplectic Galerkin projection, is proposed to save the computational cost for the simplification of large-scale Hamiltonian systems while preserving the symplectic structure. As an analogy to the classical proper orthogonal decomposition (POD)-Galerkin approach, PSD is designed to build a symplectic… ▽ More In this paper, a symplectic model reduction technique, proper symplectic decomposition (PSD) with symplectic Galerkin projection, is proposed to save the computational cost for the simplification of large-scale Hamiltonian systems while preserving the symplectic structure. As an analogy to the classical proper orthogonal decomposition (POD)-Galerkin approach, PSD is designed to build a symplectic subspace to fit empirical data, while the symplectic Galerkin projection constructs a reduced Hamiltonian system on the symplectic subspace. For practical use, we introduce three algorithms for PSD, which are based upon: the cotangent lift, complex singular value decomposition, and nonlinear programming. The proposed technique has been proven to preserve system energy and stability. Moreover, PSD can be combined with the discrete empirical interpolation method to reduce the computational cost for nonlinear Hamiltonian systems. Owing to these properties, the proposed technique is better suited than the classical POD-Galerkin approach for model reduction of Hamiltonian systems, especially when long-time integration is required. The stability, accuracy, and efficiency of the proposed technique are illustrated through numerical simulations of linear and nonlinear wave equations. △ Less

Submitted 13 March, 2015; v1 submitted 23 July, 2014; originally announced July 2014.

Comments: 25 pages, 13 figures

Self-adjointness and conservation laws of difference equations

Authors: Linyu Peng

Abstract: A general theorem on conservation laws for arbitrary difference equations is proved. The theorem is based on an introduction of an adjoint system related with a given difference system, and it does not require the existence of a difference Lagrangian. It is proved that the system, combined by the original system and its adjoint system, is governed by a variational principle, which inherits all sym… ▽ More A general theorem on conservation laws for arbitrary difference equations is proved. The theorem is based on an introduction of an adjoint system related with a given difference system, and it does not require the existence of a difference Lagrangian. It is proved that the system, combined by the original system and its adjoint system, is governed by a variational principle, which inherits all symmetries of the original system. Noether's theorem can then be applied. With some special techniques, e.g. self-adjointness properties, this allows us to obtain conservation laws for difference equations, which are not necessary governed by Lagrangian formalisms. △ Less

Submitted 20 May, 2014; originally announced May 2014.

Comments: 16 pages

Journal ref: Communications in Nonlinear Science and Numerical Simulation 23 (1-3), 209-219, 2015

Inference for a Special Bilinear Time Series Model

Authors: Shiqing Ling, Liang Peng, Fukang Zhu

Abstract: It is well known that estimating bilinear models is quite challenging. Many different ideas have been proposed to solve this problem. However, there is not a simple way to do inference even for its simple cases. This paper studies the special bilinear model $$Y_t=μ+φY_{t-2}+ bY_{t-2}\varepsilon_{t-1}+ \varepsilon_t,$$ where $\{\varepsilon_t\}$ is a sequence of i.i.d. random variables with mean zer… ▽ More It is well known that estimating bilinear models is quite challenging. Many different ideas have been proposed to solve this problem. However, there is not a simple way to do inference even for its simple cases. This paper studies the special bilinear model $$Y_t=μ+φY_{t-2}+ bY_{t-2}\varepsilon_{t-1}+ \varepsilon_t,$$ where $\{\varepsilon_t\}$ is a sequence of i.i.d. random variables with mean zero. We first give a sufficient condition for the existence of a unique stationary solution for the model and then propose a GARCH-type maximum likelihood estimator for estimating the unknown parameters. It is shown that the GMLE is consistent and asymptotically normal under only finite fourth moment of errors. Also a simple consistent estimator for the asymptotic covariance is provided. A simulation study confirms the good finite sample performance. Our estimation approach is novel and nonstandard and it may provide a new insight for future research in this direction. △ Less

Submitted 13 May, 2014; originally announced May 2014.

Comments: 23 pages, 1 figures, 3 tables

MSC Class: 62F12; 62M10; 60G10

Relations between symmetries and conservation laws for difference systems

Authors: Linyu Peng

Abstract: For difference variational problems on lattice, this paper presents a relation between divergence variational symmetries and conservation laws for the associated Euler-Lagrange system provided by Noether's theorem. This hence inspires us to define conservation laws related with symmetries for arbitrary difference equations with or without Lagrangian formulations. These conservation laws are constr… ▽ More For difference variational problems on lattice, this paper presents a relation between divergence variational symmetries and conservation laws for the associated Euler-Lagrange system provided by Noether's theorem. This hence inspires us to define conservation laws related with symmetries for arbitrary difference equations with or without Lagrangian formulations. These conservation laws are constrained by some partial differential equations obtained from the symmetries generators. It is shown that the orders of these partial differential equations have been reduced comparing to the ones used in a general approach. Illustrating examples are presented. △ Less

Submitted 25 March, 2014; v1 submitted 23 March, 2014; originally announced March 2014.

Comments: 18 pages

Journal ref: Journal of Difference Equations and Applications 20 (12), 1609-1626, 2014

Maxima of a triangular array of multivariate Gaussian sequence

Authors: Enkelejd Hashorva, Liang Peng, Zhichao Weng

Abstract: It is known that the normalized maxima of a sequence of independent and identically distributed bivariate normal random vectors with correlation coefficient $ρ\in (-1,1)$ is asymptotically independent, which may seriously underestimate extreme probabilities in practice. By letting $ρ$ depend on the sample size and go to one with certain rate, Hüsler and Reiss (1989) showed that the normalized maxi… ▽ More It is known that the normalized maxima of a sequence of independent and identically distributed bivariate normal random vectors with correlation coefficient $ρ\in (-1,1)$ is asymptotically independent, which may seriously underestimate extreme probabilities in practice. By letting $ρ$ depend on the sample size and go to one with certain rate, Hüsler and Reiss (1989) showed that the normalized maxima can become asymptotically dependent. In this paper, we extend such a study to a triangular array of multivariate Gaussian sequence, which further generalizes the results in Hsing, Hüsler and Reiss (1996) and Hashorva and Weng (2013). △ Less

Submitted 23 February, 2014; originally announced February 2014.

Comments: 14 pages

Tests for covariance matrix with fixed or divergent dimension

Authors: Rongmao Zhang, Liang Peng, Ruodu Wang

Abstract: Testing covariance structure is of importance in many areas of statistical analysis, such as microarray analysis and signal processing. Conventional tests for finite-dimensional covariance cannot be applied to high-dimensional data in general, and tests for high-dimensional covariance in the literature usually depend on some special structure of the matrix. In this paper, we propose some empirical… ▽ More Testing covariance structure is of importance in many areas of statistical analysis, such as microarray analysis and signal processing. Conventional tests for finite-dimensional covariance cannot be applied to high-dimensional data in general, and tests for high-dimensional covariance in the literature usually depend on some special structure of the matrix. In this paper, we propose some empirical likelihood ratio tests for testing whether a covariance matrix equals a given one or has a banded structure. The asymptotic distributions of the new tests are independent of the dimension. △ Less

Submitted 30 October, 2013; originally announced October 2013.

Comments: Published in at http://dx.doi.org/10.1214/13-AOS1136 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1136

Journal ref: Annals of Statistics 2013, Vol. 41, No. 4, 2075-2096

The Bridgeland's Ringel-Hall algebra associated to an algebra with global dimension at most two

Authors: Shengfei Geng, Liangang Peng

Abstract: For any finitely dimensional associative algebra with global dimension $\leq 2$, we show that there is an embedding from the twisted Ringel-Hall algebra to the Brigeland's Ringel-Hall algebra. In particular, this result is true for tilted algebras and canonical algebras. For any finitely dimensional associative algebra with global dimension $\leq 2$, we show that there is an embedding from the twisted Ringel-Hall algebra to the Brigeland's Ringel-Hall algebra. In particular, this result is true for tilted algebras and canonical algebras. △ Less

Submitted 23 April, 2019; v1 submitted 4 September, 2013; originally announced September 2013.

Comments: arXiv admin note: text overlap with arXiv:1111.0745 by other authors;The title changed

MSC Class: 16G10; 16W35

Nonlinear Model Reduction via an Adaptive Weighting of Snapshots

Authors: Liqian Peng, Kamran Mohseni

Abstract: In this paper, we propose a new approach to model reduction of parameterized partial differential equations (PDEs) based on the concept of adaptive reduced bases. The presented approach is particularly suited for large-scale nonlinear systems characterized by parameter variations. Instead of using a global basis to construct a global reduced model, the proposed method approximates the original sys… ▽ More In this paper, we propose a new approach to model reduction of parameterized partial differential equations (PDEs) based on the concept of adaptive reduced bases. The presented approach is particularly suited for large-scale nonlinear systems characterized by parameter variations. Instead of using a global basis to construct a global reduced model, the proposed method approximates the original system by multiple lower-dimensional subspaces. Each localized reduced basis is generated by the SVD of a weighted snapshot ensemble; here, each weighting coefficient is a function of the input parameter. Compared with a global model reduction method, such as the classical POD, the adaptive model reduction method could yield a more accurate solution with a fixed subspace dimension. Moreover, we combine the adaptive reduced model with the chord iteration to solve elliptic PDEs in a computationally efficient fashion. The potential of the method for achieving large speedups, while maintaining good accuracy, is demonstrated for both elliptic and parabolic PDEs in a few numerical examples. △ Less

Submitted 29 September, 2014; v1 submitted 6 August, 2013; originally announced August 2013.

Comments: 23 pages, 14 figures

Quantum dilogarithm identities and cyclic quivers

Authors: Changjian Fu, Liangang Peng

Abstract: We study quantum dilogarithm identities for cyclic quivers following Reineke's idea via Ringel-Hall algebra approach. For any given discrete stability function for the cyclic quiver $Δ_n$ with $n$ vertices, we obtain certain cyclic quantum dilogarithm identities of order $n$ in the sense of Bytsko and Volkov. We study quantum dilogarithm identities for cyclic quivers following Reineke's idea via Ringel-Hall algebra approach. For any given discrete stability function for the cyclic quiver $Δ_n$ with $n$ vertices, we obtain certain cyclic quantum dilogarithm identities of order $n$ in the sense of Bytsko and Volkov. △ Less

Submitted 23 May, 2013; originally announced May 2013.

Comments: 11 pages

MSC Class: 16G20; 16G99

Journal ref: Sci.Sin. Math 47(11)(2017),1157-1564

Weighted estimation of the dependence function for an extreme-value distribution

Authors: Liang Peng, Linyi Qian, Jingping Yang

Abstract: Bivariate extreme-value distributions have been used in modeling extremes in environmental sciences and risk management. An important issue is estimating the dependence function, such as the Pickands dependence function. Some estimators for the Pickands dependence function have been studied by assuming that the marginals are known. Recently, Genest and Segers [Ann. Statist. 37 (2009) 2990-3022] de… ▽ More Bivariate extreme-value distributions have been used in modeling extremes in environmental sciences and risk management. An important issue is estimating the dependence function, such as the Pickands dependence function. Some estimators for the Pickands dependence function have been studied by assuming that the marginals are known. Recently, Genest and Segers [Ann. Statist. 37 (2009) 2990-3022] derived the asymptotic distributions of those proposed estimators with marginal distributions replaced by the empirical distributions. In this article, we propose a class of weighted estimators including those of Genest and Segers (2009) as special cases. We propose a jackknife empirical likelihood method for constructing confidence intervals for the Pickands dependence function, which avoids estimating the complicated asymptotic variance. A simulation study demonstrates the effectiveness of our proposed jackknife empirical likelihood method. △ Less

Submitted 20 March, 2013; originally announced March 2013.

Comments: Published in at http://dx.doi.org/10.3150/11-BEJ409 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ409

Journal ref: Bernoulli 2013, Vol. 19, No. 2, 492-520