-
Exploring incentive strategies and predicting development trends for new energy vehicles
Authors:
Tao Jin,
Yulian Jiang,
Xingwen Liu
Abstract:
To facilitate new energy vehicles (NEVs), we construct a game model between vehicle manufacturers and consumers to explore their interactions. In the model, we propose the Expectation Supply-Demand Game (ESDG), construct the consumer purchasing decision-making process with feedback and analyse the stability of the system under different feedback factors. We processes the data of the model in numer…
▽ More
To facilitate new energy vehicles (NEVs), we construct a game model between vehicle manufacturers and consumers to explore their interactions. In the model, we propose the Expectation Supply-Demand Game (ESDG), construct the consumer purchasing decision-making process with feedback and analyse the stability of the system under different feedback factors. We processes the data of the model in numerical simulation through Min-Max normalisation and predicts the development of NEVs. The results show that: (1) An evolutionary stabilisation strategy (ESS) emerges in the evolutionary game model with the introduction of feedback. (2) The Min-Max normalisation method is conducive to the accuracy of the model. (3) Excessive advertising and marketing may cause consumer boredom. (4) The establishment of an appropriate battery compensation and replacement insurance is conducive to the development of NEVs. (5) The production and sales ratio of China's NEVs is predicted to reach 37.2\% and 36.9\% respectively in 2024.
△ Less
Submitted 15 July, 2024;
originally announced July 2024.
-
Limiting Over-Smoothing and Over-Squashing of Graph Message Passing by Deep Scattering Transforms
Authors:
Yuanhong Jiang,
Dongmian Zou,
Xiaoqun Zhang,
Yu Guang Wang
Abstract:
Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability, over-smoothing, and over-squashing, which can degrade performance and create a trade-off dilemma. In this paper, we introduce a discriminatively trained, multi-layer Deep…
▽ More
Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability, over-smoothing, and over-squashing, which can degrade performance and create a trade-off dilemma. In this paper, we introduce a discriminatively trained, multi-layer Deep Scattering Message Passing (DSMP) neural network designed to overcome these challenges. By harnessing spectral transformation, the DSMP model aggregates neighboring nodes with global information, thereby enhancing the precision and accuracy of graph signal processing. We provide theoretical proofs demonstrating the DSMP's effectiveness in mitigating these issues under specific conditions. Additionally, we support our claims with empirical evidence and thorough frequency analysis, showcasing the DSMP's superior ability to address instability, over-smoothing, and over-squashing.
△ Less
Submitted 9 July, 2024;
originally announced July 2024.
-
Symplectic double groupoids and the generalized Kähler potential
Authors:
Daniel Álvarez,
Marco Gualtieri,
Yucong Jiang
Abstract:
A description of the fundamental degrees of freedom underlying a generalized Kähler manifold, which separates its holomorphic moduli from the space of compatible metrics in a similar way to the Kähler case, has been sought since its discovery in 1984. In this paper, we describe a full solution to this problem for arbitrary generalized Kähler manifolds, which involves the new concept of a holomorph…
▽ More
A description of the fundamental degrees of freedom underlying a generalized Kähler manifold, which separates its holomorphic moduli from the space of compatible metrics in a similar way to the Kähler case, has been sought since its discovery in 1984. In this paper, we describe a full solution to this problem for arbitrary generalized Kähler manifolds, which involves the new concept of a holomorphic symplectic Morita 2-equivalence between double symplectic groupoids, equipped with a Lagrangian bisection of its real symplectic core. Essentially, any generalized Kähler manifold has an associated holomorphic symplectic manifold of quadruple dimension and equipped with an anti-holomorphic involution; the metric is determined by a Lagrangian submanifold of its fixed point locus. This finally resolves affirmatively a long-standing conjecture by physicists concerning the existence of a generalized Kähler potential.
We demonstrate the theory by constructing explicitly the above Morita 2-equivalence and Lagrangian bisection for the well-known generalized Kähler structures on compact even-dimensional semisimple Lie groups, which have until now escaped such analysis. We construct the required holomorphic symplectic manifolds by expressing them as moduli spaces of flat connections on surfaces with decorated boundary, through a quasi-Hamiltonian reduction.
△ Less
Submitted 30 June, 2024;
originally announced July 2024.
-
Truncated-degree-choosability of planar graphs
Authors:
Yiting Jiang,
Huijuan Xu,
Xinbo Xu,
Xuding Zhu
Abstract:
Assume $G$ is a graph and $k$ is a positive integer. Let $f:V(G)\to N$ be defined as $f(v)=\min\{k,d_G(v)\}$. If $G$ is $f$-choosable, then we say $G$ is $k$-truncated-degree-choosable. It was proved in [Zhou,Zhu,Zhu, Arc-weighted acyclic orientations and variations of degeneracy of graphs, arXiv:2308.15853] that there is a 3-connected non-complete planar graph that is not 7-truncated-degree-choos…
▽ More
Assume $G$ is a graph and $k$ is a positive integer. Let $f:V(G)\to N$ be defined as $f(v)=\min\{k,d_G(v)\}$. If $G$ is $f$-choosable, then we say $G$ is $k$-truncated-degree-choosable. It was proved in [Zhou,Zhu,Zhu, Arc-weighted acyclic orientations and variations of degeneracy of graphs, arXiv:2308.15853] that there is a 3-connected non-complete planar graph that is not 7-truncated-degree-choosable, and every 3-connected non-complete planar graph is 16-truncated-degree-choosable. This paper improves the bounds, and proves that there is a 3-connected non-complete planar graph that is not 8-truncated-degree-choosable and every non-complete 3-connected planar graph is 12-truncated-degree-choosable.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Multiscale Tests for Point Processes and Longitudinal Networks
Authors:
Youmeng Jiang,
Min Xu
Abstract:
We propose a new testing framework applicable to both the two-sample problem on point processes and the community detection problem on rectangular arrays of point processes, which we refer to as longitudinal networks; the latter problem is useful in situations where we observe interactions among a group of individuals over time. Our framework is based on a multiscale discretization scheme that con…
▽ More
We propose a new testing framework applicable to both the two-sample problem on point processes and the community detection problem on rectangular arrays of point processes, which we refer to as longitudinal networks; the latter problem is useful in situations where we observe interactions among a group of individuals over time. Our framework is based on a multiscale discretization scheme that consider not just the global null but also a collection of nulls local to small regions in the domain; in the two-sample problem, the local rejections tell us where the intensity functions differ and in the longitudinal network problem, the local rejections tell us when the community structure is most salient. We provide theoretical analysis for the two-sample problem and show that our method has minimax optimal power under a Holder continuity condition. We provide extensive simulation and real data analysis demonstrating the practicality of our proposed method.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Full Asymptotic Expansion of Monodromy Data for the First Painlevé Transcendent: Applications to Connection Problems
Authors:
Yun-Jiang Jiang,
Yu-Tian Li,
Wen-Gao Long
Abstract:
We study the full asymptotic expansion of the monodromy data ({\it i.e.}, Stokes multipliers) for the first Painlevé transcendent (PI) with large initial data or large pole parameters. Our primary approach involves refining the complex WKB method, also known as the method of uniform asymptotics, to approximate the second-order ODEs derived from PI's Lax pair with higher-order accuracy. As an appli…
▽ More
We study the full asymptotic expansion of the monodromy data ({\it i.e.}, Stokes multipliers) for the first Painlevé transcendent (PI) with large initial data or large pole parameters. Our primary approach involves refining the complex WKB method, also known as the method of uniform asymptotics, to approximate the second-order ODEs derived from PI's Lax pair with higher-order accuracy. As an application, we provide a rigorous proof of the full asymptotic expansion of the nonlinear eigenvalues proposed numerically by Bender, Komijani, and Wang. Additionally, we present the full asymptotic expansion for the pole parameters $(p_{n}, H_{n})$ corresponding to the $n$-th pole of the real tritronquée solution of the PI equation as $n \to +\infty$.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
The quantum cohomology of moduli space of $\PGL_2$-bundles on curves
Authors:
Sagnik Das,
Yunfeng Jiang,
Hsian-Hua Tseng
Abstract:
We calculate the quantum cohomology of the moduli space of stable $\PGL_2$-bundles over a smooth curve of genus $g\ge 2$.
We calculate the quantum cohomology of the moduli space of stable $\PGL_2$-bundles over a smooth curve of genus $g\ge 2$.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Incorporating changeable attitudes toward vaccination into an SIR infectious disease model
Authors:
Yi Jiang,
Kristin M. Kurianski,
Jane H. Lee,
Yanping Ma,
Daniel Cicala,
Glenn Ledder
Abstract:
We develop a mechanistic model that classifies individuals both in terms of epidemiological status (SIR) and vaccination attitude (willing or unwilling), with the goal of discovering how disease spread is influenced by changing opinions about vaccination. Analysis of the model identifies existence and stability criteria for both disease-free and endemic disease equilibria. The analytical results,…
▽ More
We develop a mechanistic model that classifies individuals both in terms of epidemiological status (SIR) and vaccination attitude (willing or unwilling), with the goal of discovering how disease spread is influenced by changing opinions about vaccination. Analysis of the model identifies existence and stability criteria for both disease-free and endemic disease equilibria. The analytical results, supported by numerical simulations, show that attitude changes induced by disease prevalence can destabilize endemic disease equilibria, resulting in limit cycles.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
Wellposedness of the Master Equation for Mean Field Games with Grushin Type Diffusion
Authors:
Yiming Jiang,
Yawei Wei,
Yiyun Yang
Abstract:
We study the wellposedness of the master equation for a second-order mean field games with the Grushin type diffusion. In order to do this, we obtain the properties of its solution by investigating a degenerate mean field games system for which there exists an equivalent characterization with the master equation. The crucial points of this paper are to explore some regularities of solutions to two…
▽ More
We study the wellposedness of the master equation for a second-order mean field games with the Grushin type diffusion. In order to do this, we obtain the properties of its solution by investigating a degenerate mean field games system for which there exists an equivalent characterization with the master equation. The crucial points of this paper are to explore some regularities of solutions to two types of linear degenerate partial differential equations and a kind of degenerate linear coupled system so as to derive the existence of solutions to the master equation.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
A third-order low-regularity trigonometric integrator for the semilinear Klein-Gordon equation
Authors:
Bin Wang,
Yaolin Jiang
Abstract:
In this paper, we propose and analyze a novel third-order low-regularity trigonometric integrator for the semilinear Klein-Gordon equation in the $d$-dimensional space with $d=1,2,3$. The integrator is constructed based on the full use of Duhamel's formula and the technique of twisted function to the trigonometric integrals. Rigorous error estimates are presented and the proposed method is shown t…
▽ More
In this paper, we propose and analyze a novel third-order low-regularity trigonometric integrator for the semilinear Klein-Gordon equation in the $d$-dimensional space with $d=1,2,3$. The integrator is constructed based on the full use of Duhamel's formula and the technique of twisted function to the trigonometric integrals. Rigorous error estimates are presented and the proposed method is shown to have third-order accuracy in the energy space under a weak regularity requirement in $H^{2}\times H^{1}$. A numerical experiment shows that the proposed third-order low-regularity integrator is much more accurate than the well-known exponential integrators of order three for approximating the Klein-Gordon equation with nonsmooth solutions.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Unconditionally positivity-preserving approximations of the Ait-Sahalia type model: Explicit Milstein-type schemes
Authors:
Yingsong Jiang,
Ruishu Liu,
Xiaojie Wang,
Jinghua Zhuo
Abstract:
The present article aims to design and analyze efficient first-order strong schemes for a generalized Aït-Sahalia type model arising in mathematical finance and evolving in a positive domain $(0, \infty)$, which possesses a diffusion term with superlinear growth and a highly nonlinear drift that blows up at the origin. Such a complicated structure of the model unavoidably causes essential difficul…
▽ More
The present article aims to design and analyze efficient first-order strong schemes for a generalized Aït-Sahalia type model arising in mathematical finance and evolving in a positive domain $(0, \infty)$, which possesses a diffusion term with superlinear growth and a highly nonlinear drift that blows up at the origin. Such a complicated structure of the model unavoidably causes essential difficulties in the construction and convergence analysis of time discretizations. By incorporating implicitness in the term $α_{-1} x^{-1}$ and a corrective mapping $Φ_h$ in the recursion, we develop a novel class of explicit and unconditionally positivity-preserving (i.e., for any step-size $h>0$) Milstein-type schemes for the underlying model. In both non-critical and general critical cases, we introduce a novel approach to analyze mean-square error bounds of the novel schemes, without relying on a priori high-order moment bounds of the numerical approximations. The expected order-one mean-square convergence is attained for the proposed scheme. The above theoretical guarantee can be used to justify the optimal complexity of the Multilevel Monte Carlo method. Numerical experiments are finally provided to verify the theoretical findings.
△ Less
Submitted 12 July, 2024; v1 submitted 25 March, 2024;
originally announced March 2024.
-
On Terwilliger $\mathbb{F}$-algebras of factorial association schemes
Authors:
Yu Jiang
Abstract:
The Terwilliger algebras of association schemes over an arbitrary field $\mathbb{F}$ were called the Terwilliger $\mathbb{F}$-algebras of association schemes in [8]. In this paper, we study the Terwilliger $\mathbb{F}$-algebras of factorial association schemes. We determine the $\mathbb{F}$-dimensions, the centers, the semisimplicity, the Jacobson radicals, and the algebraic structures of the Terw…
▽ More
The Terwilliger algebras of association schemes over an arbitrary field $\mathbb{F}$ were called the Terwilliger $\mathbb{F}$-algebras of association schemes in [8]. In this paper, we study the Terwilliger $\mathbb{F}$-algebras of factorial association schemes. We determine the $\mathbb{F}$-dimensions, the centers, the semisimplicity, the Jacobson radicals, and the algebraic structures of the Terwilliger $\mathbb{F}$-algebras of factorial association schemes.
△ Less
Submitted 13 March, 2024;
originally announced March 2024.
-
Inexact and Implementable Accelerated Newton Proximal Extragradient Method for Convex Optimization
Authors:
Ziyu Huang,
Bo Jiang,
Yuntian Jiang
Abstract:
In this paper, we investigate the convergence behavior of the Accelerated Newton Proximal Extragradient (A-NPE) method when employing inexact Hessian information. The exact A-NPE method was the pioneer near-optimal second-order approach, exhibiting an oracle complexity of $\Tilde{O}(ε^{-2/7})$ for convex optimization. Despite its theoretical optimality, there has been insufficient attention given…
▽ More
In this paper, we investigate the convergence behavior of the Accelerated Newton Proximal Extragradient (A-NPE) method when employing inexact Hessian information. The exact A-NPE method was the pioneer near-optimal second-order approach, exhibiting an oracle complexity of $\Tilde{O}(ε^{-2/7})$ for convex optimization. Despite its theoretical optimality, there has been insufficient attention given to the study of its inexact version and efficient implementation. We introduce the inexact A-NPE method (IA-NPE), which is shown to maintain the near-optimal oracle complexity. In particular, we design a dynamic approach to balance the computational cost of constructing the Hessian matrix and the progress of the convergence. Moreover, we show the robustness of the line-search procedure, which is a subroutine in IA-NPE, in the face of the inexactness of the Hessian. These nice properties enable the implementation of highly effective machine learning techniques like sub-sampling and various heuristics in the method. Extensive numerical results illustrate that IA-NPE compares favorably with state-of-the-art second-order methods, including Newton's method with cubic regularization and Trust-Region methods.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
A new type of simplified inverse Lax-Wendroff boundary treatment I: hyperbolic conservation laws
Authors:
Shihao Liu,
Tingting Li,
Ziqiang Cheng,
Yan Jiang,
Chi-Wang Shu,
Mengping Zhang
Abstract:
In this paper, we design a new kind of high order inverse Lax-Wendroff (ILW) boundary treatment for solving hyperbolic conservation laws with finite difference method on a Cartesian mesh. This new ILW method decomposes the construction of ghost point values near inflow boundary into two steps: interpolation and extrapolation. At first, we impose values of some artificial auxiliary points through a…
▽ More
In this paper, we design a new kind of high order inverse Lax-Wendroff (ILW) boundary treatment for solving hyperbolic conservation laws with finite difference method on a Cartesian mesh. This new ILW method decomposes the construction of ghost point values near inflow boundary into two steps: interpolation and extrapolation. At first, we impose values of some artificial auxiliary points through a polynomial interpolating the interior points near the boundary. Then, we will construct a Hermite extrapolation based on those auxiliary point values and the spatial derivatives at boundary obtained via the ILW procedure. This polynomial will give us the approximation to the ghost point value. By an appropriate selection of those artificial auxiliary points, high-order accuracy and stable results can be achieved. Moreover, theoretical analysis indicates that comparing with the original ILW method, especially for higher order accuracy, the new proposed one would require fewer terms using the relatively complicated ILW procedure and thus improve computational efficiency on the premise of maintaining accuracy and stability. We perform numerical experiments on several benchmarks, including one- and two-dimensional scalar equations and systems. The robustness and efficiency of the proposed scheme is numerically verified.
△ Less
Submitted 15 February, 2024;
originally announced February 2024.
-
Real-Time Coordination of Integrated Transmission and Distribution Systems: Flexibility Modeling and Distributed NMPC Scheduling
Authors:
Xinliang Dai,
Yi Guo,
Yuning Jiang,
Colin N. Jones,
Gabriela Hug,
Veit Hagenmeyer
Abstract:
This paper proposes a real-time distributed operational architecture to efficiently coordinate intergrated transmission and distribution systems (ITD). At the distribution system level, the distribution system operator (DSO) computes the aggregated flexibility of all controllable devices by power-energy envelopes and provides them to the transmission system operators. At the transmission system le…
▽ More
This paper proposes a real-time distributed operational architecture to efficiently coordinate intergrated transmission and distribution systems (ITD). At the distribution system level, the distribution system operator (DSO) computes the aggregated flexibility of all controllable devices by power-energy envelopes and provides them to the transmission system operators. At the transmission system level, a distributed nonlinear MPC approach is proposed to coordinate the economic dispatch of multiple TSOs, considering the aggregated flexibility of all distribution systems. The subproblems of the proposed approach are associated with different TSOs and individual time periods. In addition, the aggregated flexibility of controllable devices in distribution networks is encapsulated, re-calculated, and communicated through the power-energy envelopes, facilitating a reduction in computational complexity and eliminating redundant information exchanges between TSOs and DSOs, thereby enhancing privacy and security. The framework's effectiveness and applicability in real-world scenarios are validated through simulated operational scenarios on a summer day in Germany, highlighting its robustness in the face of significant prediction mismatches due to severe weather conditions.
△ Less
Submitted 20 February, 2024; v1 submitted 1 February, 2024;
originally announced February 2024.
-
Duality of causal distributionally robust optimization: the discrete-time case
Authors:
Yifan Jiang
Abstract:
This paper studies distributionally robust optimization (DRO) in a dynamic context. We consider a general penalized DRO problem with a causal transport-type penalization. Such a penalization naturally captures the information flow generated by the dynamic model. We derive a tractable dynamic duality formula under mild conditions. Furthermore, we apply this duality formula to address distributional…
▽ More
This paper studies distributionally robust optimization (DRO) in a dynamic context. We consider a general penalized DRO problem with a causal transport-type penalization. Such a penalization naturally captures the information flow generated by the dynamic model. We derive a tractable dynamic duality formula under mild conditions. Furthermore, we apply this duality formula to address distributionally robust version of average value-at-risk, stochastic control, and optimal stopping.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Long term analysis of a geometric low-regularity integrator for nonlinear Klein-Gordon equation
Authors:
Bin Wang,
Zhen Miao,
Yaolin Jiang
Abstract:
In this paper, we formulate and analyse a geometric low-regularity integrator for solving the nonlinear Klein-Gordon equation in the $d$-dimensional space with $d=1,2,3$. The integrator is constructed based on the two-step trigonometric method and thus it has a simple form. Error estimates are rigorously presented to show that the integrator can achieve second-order time accuracy in the energy spa…
▽ More
In this paper, we formulate and analyse a geometric low-regularity integrator for solving the nonlinear Klein-Gordon equation in the $d$-dimensional space with $d=1,2,3$. The integrator is constructed based on the two-step trigonometric method and thus it has a simple form. Error estimates are rigorously presented to show that the integrator can achieve second-order time accuracy in the energy space under the regularity requirement in $H^{1+\frac{d}{4}}\times H^{\frac{d}{4}}$. Moreover, the time symmetry of the scheme ensures its good long-time energy conservation which is rigorously proved by the technique of modulated Fourier expansions. A numerical test is presented and the numerical results demonstrate the superiorities of the new integrator over some existing methods.
△ Less
Submitted 19 January, 2024; v1 submitted 21 December, 2023;
originally announced December 2023.
-
Upwind summation-by-parts finite differences: error estimates and WENO methodology
Authors:
Yan Jiang,
Siyang Wang
Abstract:
High order upwind summation-by-parts finite difference operators have recently been developed. When combined with the simultaneous-approximation-term method to impose boundary conditions, the method converges faster than using traditional summation-by-parts operators. We prove the convergence rate by the normal mode analysis for such methods for a class of hyperbolic partial differential equations…
▽ More
High order upwind summation-by-parts finite difference operators have recently been developed. When combined with the simultaneous-approximation-term method to impose boundary conditions, the method converges faster than using traditional summation-by-parts operators. We prove the convergence rate by the normal mode analysis for such methods for a class of hyperbolic partial differential equations. Our analysis shows that the penalty parameter for imposing boundary conditions affects the convergence rate for stable methods. In addition, to solve problems with discontinuous data, we extend the method to also have the weighted essentially nonoscillatory property. The overall method is stable, achieves high order accuracy for smooth problems, and is capable of solving problems with discontinuities.
△ Less
Submitted 13 June, 2024; v1 submitted 18 December, 2023;
originally announced December 2023.
-
The doubly asymmetric simple exclusion process, the colored Boolean process, and the restricted random growth model
Authors:
Yuhan Jiang
Abstract:
The multispecies asymmetric simple exclusion process (mASEP) is a Markov chain in which particles of different species hop along a one-dimensional lattice. This paper studies the doubly asymmetric simple exclusion process $\mathrm{DASEP}(n,p,q)$ in which $q$ particles with species $1, \dots, p$ hop along a circular lattice with $n$ sites, but also the particles are allowed to spontaneously change…
▽ More
The multispecies asymmetric simple exclusion process (mASEP) is a Markov chain in which particles of different species hop along a one-dimensional lattice. This paper studies the doubly asymmetric simple exclusion process $\mathrm{DASEP}(n,p,q)$ in which $q$ particles with species $1, \dots, p$ hop along a circular lattice with $n$ sites, but also the particles are allowed to spontaneously change from one species to another. In this paper, we introduce two related Markov chains called the colored Boolean process and the restricted random growth model, and we show that the DASEP lumps to the colored Boolean process, and the colored Boolean process lumps to the restricted random growth model. This allows us to generalize a theorem of David Ash on the relations between sums of steady state probabilities. We also give explicit formulas for the stationary distribution of $\mathrm{DASEP}(n,2,2)$.
△ Less
Submitted 8 March, 2024; v1 submitted 14 December, 2023;
originally announced December 2023.
-
An example of an infinite amenable group with the ISR property
Authors:
Yongle Jiang,
Xiaoyan Zhou
Abstract:
Let $G$ be $S_{\mathbb{N}}$, the finitary permutation (i.e. permutations with finite support) group on positive integers $\mathbb{N}$. We prove that $G$ has the invariant von Neumann subalgebras rigidity (ISR, for short) property as introduced in Amrutam-Jiang's work. More precisely, every $G$-invariant von Neumann subalgebra $P\subseteq L(G)$ is of the form $L(H)$ for some normal sugbroup…
▽ More
Let $G$ be $S_{\mathbb{N}}$, the finitary permutation (i.e. permutations with finite support) group on positive integers $\mathbb{N}$. We prove that $G$ has the invariant von Neumann subalgebras rigidity (ISR, for short) property as introduced in Amrutam-Jiang's work. More precisely, every $G$-invariant von Neumann subalgebra $P\subseteq L(G)$ is of the form $L(H)$ for some normal sugbroup $H\lhd G$ and in this case, $H=\{e\}, A_{\mathbb{N}}$ or $G$, where $A_{\mathbb{N}}$ denotes the finitary alternating group on $\mathbb{N}$, i.e. the subgroup of all even permutations in $S_{\mathbb{N}}$. This gives the first known example of an infinite amenable group with the ISR property.
△ Less
Submitted 2 April, 2024; v1 submitted 13 December, 2023;
originally announced December 2023.
-
Algorithms for mean-field variational inference via polyhedral optimization in the Wasserstein space
Authors:
Yiheng Jiang,
Sinho Chewi,
Aram-Alexandre Pooladian
Abstract:
We develop a theory of finite-dimensional polyhedral subsets over the Wasserstein space and optimization of functionals over them via first-order methods. Our main application is to the problem of mean-field variational inference, which seeks to approximate a distribution $π$ over $\mathbb{R}^d$ by a product measure $π^\star$. When $π$ is strongly log-concave and log-smooth, we provide (1) approxi…
▽ More
We develop a theory of finite-dimensional polyhedral subsets over the Wasserstein space and optimization of functionals over them via first-order methods. Our main application is to the problem of mean-field variational inference, which seeks to approximate a distribution $π$ over $\mathbb{R}^d$ by a product measure $π^\star$. When $π$ is strongly log-concave and log-smooth, we provide (1) approximation rates certifying that $π^\star$ is close to the minimizer $π^\star_\diamond$ of the KL divergence over a \emph{polyhedral} set $\mathcal{P}_\diamond$, and (2) an algorithm for minimizing $\text{KL}(\cdot\|π)$ over $\mathcal{P}_\diamond$ with accelerated complexity $O(\sqrt κ\log(κd/\varepsilon^2))$, where $κ$ is the condition number of $π$.
△ Less
Submitted 8 June, 2024; v1 submitted 5 December, 2023;
originally announced December 2023.
-
Two-scale exponential integrators with uniform accuracy for three-dimensional charged-particle dynamics under strong magnetic field
Authors:
Bin Wang,
Zhen Miao,
Yaolin Jiang
Abstract:
The numerical simulation of three-dimensional charged-particle dynamics (CPD) under strong magnetic field is challenging. In this paper, we introduce a new methodology to design two-scale exponential integrators for three-dimensional CPD whose magnetic field's strength is inversely proportional to a dimensionless parameter $0<\varepsilon \ll 1$. By dealing with the transformed form of three-dimens…
▽ More
The numerical simulation of three-dimensional charged-particle dynamics (CPD) under strong magnetic field is challenging. In this paper, we introduce a new methodology to design two-scale exponential integrators for three-dimensional CPD whose magnetic field's strength is inversely proportional to a dimensionless parameter $0<\varepsilon \ll 1$. By dealing with the transformed form of three-dimensional CPD, we linearize the magnetic field and put the rest part in a nonlinear function which can be shown to be small. Based on which and the proposed two-scale exponential integrators, a class of novel integrators is formulated. The corresponding uniform accuracy over $\mathcal{O}(1/\varepsilon^β)$ time interval is $\mathcal{O}(\varepsilon^{rβ} h^r)$ for the $r$-th order integrator with the time stepsize $h$, $r=1,2,3,4$ and $0<β<1$. A rigorous proof of this error bound is presented and a numerical test is performed to illustrate the error behaviour of the proposed integrators.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
A Collaborative Jamming Algorithm Based on Multi-UAV Scheduling
Authors:
Yixin Jiang,
Lingyun Zhou,
Yijia Tang,
Ya Tu,
Chunhong Liu,
Qingjiang Shi
Abstract:
In this paper, we consider the problem of multi-unmanned aerial vehicles' scheduling for cooperative jamming, where UAVs equipped with directional antennas perform collaborative jamming tasks against several targets of interest. To ensure effective jamming towards the targets, we formulate it as an non-convex optimization problem, aiming to minimize the communication performance of the targets by…
▽ More
In this paper, we consider the problem of multi-unmanned aerial vehicles' scheduling for cooperative jamming, where UAVs equipped with directional antennas perform collaborative jamming tasks against several targets of interest. To ensure effective jamming towards the targets, we formulate it as an non-convex optimization problem, aiming to minimize the communication performance of the targets by jointly optimizing UAVs' deployment and directional antenna orientations. Due to the unique structure of the problem, we derive an equivalent transformation by introducing a set of auxiliary matrices. Subsequently, we propose an efficient iterative algorithm based on the alternating direction method of multipliers, which decomposes the problem into multiple tractable subproblems solved in closed-form or by gradient projection method. Extensive simulations validate the efficacy of the proposed algorithm.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
Pointwise Ergodic Theorems for Uniformly Behaved in ${\mathbb N}$ Sequences
Authors:
Yunping Jiang,
Jessica Liu
Abstract:
We define a uniformly behaved in ${\mathbb N}$ arithmetic sequence ${\bf a}$ and an ${\bf a}$-mean Lyapunov stable dynamical system $f$. We consider the mean partial sum of a continuous function $φ$ over the ${\bf a}$-orbit of $f$ up to $N$. The main result we prove in the paper is that the mean partial sum converges pointwise if ${\bf a}$ is uniformly behaved in ${\mathbb N}$ and $f$ is minimal a…
▽ More
We define a uniformly behaved in ${\mathbb N}$ arithmetic sequence ${\bf a}$ and an ${\bf a}$-mean Lyapunov stable dynamical system $f$. We consider the mean partial sum of a continuous function $φ$ over the ${\bf a}$-orbit of $f$ up to $N$. The main result we prove in the paper is that the mean partial sum converges pointwise if ${\bf a}$ is uniformly behaved in ${\mathbb N}$ and $f$ is minimal and uniquely ergodic and ${\bf a}$-mean Lyapunov stable. In addition, if ${\bf a}$ is also completely additive, we then prove that the mean partial sum of a continuous function $φ$ over the square-free ${\bf a}$-orbit of $f$ up to $N$ converges pointwise as well. All equicontinuous dynamical systems are ${\bf a}$-mean Lyapunov stable for any sequence ${\bf a}$. When ${\bf a}$ is uniformly distributed in ${\mathbb Z}$, we give two non-trivial examples of ${\bf a}$-mean Lyapunov stable dynamical systems. We give several examples of uniformly behaved in ${\mathbb N}$ sequences, including the counting function of the prime factors in natural numbers, the subsequence of natural numbers indexed by the Thue-Morse (or Rudin-Shapiro) sequence, and the sequence of even (or odd) prime factor natural numbers. We also show that the sequence of square-free natural numbers (or even (or odd) prime factor square-free natural numbers) is rotationally distributed in ${\mathbb N}$ but not uniformly distributed in ${\mathbb Z}$, thus not uniformly behaved in ${\mathbb N}$. We derive other consequences from the main result relevant to number theory and ergodic theory/dynamical systems.
△ Less
Submitted 18 January, 2024; v1 submitted 28 November, 2023;
originally announced November 2023.
-
A Universal Trust-Region Method for Convex and Nonconvex Optimization
Authors:
Yuntian Jiang,
Chang He,
Chuwen Zhang,
Dongdong Ge,
Bo Jiang,
Yinyu Ye
Abstract:
This paper presents a universal trust-region method simultaneously incorporating quadratic regularization and the ball constraint. We introduce a novel mechanism to set the parameters in the proposed method that unifies the analysis for convex and nonconvex optimization. Our method exhibits an iteration complexity of $\tilde O(ε^{-3/2})$ to find an approximate second-order stationary point for non…
▽ More
This paper presents a universal trust-region method simultaneously incorporating quadratic regularization and the ball constraint. We introduce a novel mechanism to set the parameters in the proposed method that unifies the analysis for convex and nonconvex optimization. Our method exhibits an iteration complexity of $\tilde O(ε^{-3/2})$ to find an approximate second-order stationary point for nonconvex optimization. Meanwhile, the analysis reveals that the universal method attains an $O(ε^{-1/2})$ complexity bound for convex optimization and can be accelerated. These results are complementary to the existing literature as the trust-region method was historically conceived for nonconvex optimization. Finally, we develop an adaptive universal method to address practical implementations. The numerical results show the effectiveness of our method in both nonconvex and convex problems.
△ Less
Submitted 12 March, 2024; v1 submitted 19 November, 2023;
originally announced November 2023.
-
Mean Field Games with infinitely degenerate diffusion and non-coercive Hamiltonian
Authors:
Yiming Jiang,
Jingchuang Ren,
Yawei Wei,
Jie Xue
Abstract:
In this paper, we consider a class of infinitely degenerate partial differential systems to obtain the Nash equilibria in the mean field games. The degeneracy in the diffusion and the Hamiltonian may be different. This feature brings difficulties to the uniform boundness of the solutions, which is central to the existence and regularity results. First, from the perspective of the value function in…
▽ More
In this paper, we consider a class of infinitely degenerate partial differential systems to obtain the Nash equilibria in the mean field games. The degeneracy in the diffusion and the Hamiltonian may be different. This feature brings difficulties to the uniform boundness of the solutions, which is central to the existence and regularity results. First, from the perspective of the value function in the stochastic optimal control problems, we prove the Lipschitz continuity and the semiconcavity for the solutions of the Hamilton-Jacobi equations (HJE). Then the existence of the weak solutions for the degenerate systems is obtained via a vanishing viscosity method. Furthermore, by constructing an auxiliary function, we conclude the regularity of the viscosity solution for the HJE in the almost everywhere sense.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Aggregating Dependent Signals with Heavy-Tailed Combination Tests
Authors:
Lin Gui,
Yuchao Jiang,
Jingshu Wang
Abstract:
Combining dependent p-values to evaluate the global null hypothesis presents a longstanding challenge in statistical inference, particularly when aggregating results from diverse methods to boost signal detection. P-value combination tests using heavy-tailed distribution based transformations, such as the Cauchy combination test and the harmonic mean p-value, have recently garnered significant int…
▽ More
Combining dependent p-values to evaluate the global null hypothesis presents a longstanding challenge in statistical inference, particularly when aggregating results from diverse methods to boost signal detection. P-value combination tests using heavy-tailed distribution based transformations, such as the Cauchy combination test and the harmonic mean p-value, have recently garnered significant interest for their potential to efficiently handle arbitrary p-value dependencies. Despite their growing popularity in practical applications, there is a gap in comprehensive theoretical and empirical evaluations of these methods. This paper conducts an extensive investigation, revealing that, theoretically, while these combination tests are asymptotically valid for pairwise quasi-asymptotically independent test statistics, such as bivariate normal variables, they are also asymptotically equivalent to the Bonferroni test under the same conditions. However, extensive simulations unveil their practical utility, especially in scenarios where stringent type-I error control is not necessary and signals are dense. Both the heaviness of the distribution and its support substantially impact the tests' non-asymptotic validity and power, and we recommend using a truncated Cauchy distribution in practice. Moreover, we show that under the violation of quasi-asymptotic independence among test statistics, these tests remain valid and, in fact, can be considerably less conservative than the Bonferroni test. We also present two case studies in genetics and genomics, showcasing the potential of the combination tests to significantly enhance statistical power while effectively controlling type-I errors.
△ Less
Submitted 31 October, 2023;
originally announced October 2023.
-
The Anytime Convergence of Stochastic Gradient Descent with Momentum: From a Continuous-Time Perspective
Authors:
Yasong Feng,
Yifan Jiang,
Tianyu Wang,
Zhiliang Ying
Abstract:
In this paper, we study the stochastic optimization problem from a continuous-time perspective, with a focus on the Stochastic Gradient Descent with Momentum (SGDM) method. We show that the trajectory of SGDM, despite its stochastic nature, converges to a deterministic second-order Ordinary Differential Equation (ODE) in $L_2$-norm, as the stepsize goes to zero. The connection between the ODE and…
▽ More
In this paper, we study the stochastic optimization problem from a continuous-time perspective, with a focus on the Stochastic Gradient Descent with Momentum (SGDM) method. We show that the trajectory of SGDM, despite its stochastic nature, converges to a deterministic second-order Ordinary Differential Equation (ODE) in $L_2$-norm, as the stepsize goes to zero. The connection between the ODE and the algorithm results in delightful patterns in the discrete-time convergence analysis. More specifically, we develop convergence results for the ODE through a Lyapunov function, and translate the whole argument to the discrete-time case. This approach yields a novel anytime convergence guarantee for stochastic gradient methods. Precisely, we prove that the sequence $\{ x_k \}$ governed by running SGDM on a smooth convex function $f$ satisfies \begin{align*}
\mathbb{P}\left(\text{for any $k$},\;f (x_k) - f^* \le C\left(1+\log\frac{1}β\right)\frac{\log k}{\sqrt{k}}\right)\ge 1-β\end{align*} for any $β$, where $f^*=\min_{x\in\mathbb{R}^n} f(x)$, and $C$ is a constant. Our contribution is significant in that it better captures the convergence behavior across the entire trajectory of the algorithm, rather than at a single iterate.
△ Less
Submitted 14 July, 2024; v1 submitted 30 October, 2023;
originally announced October 2023.
-
Theta Operator Equals Fontaine Operator on Modular Curves
Authors:
Yuanyang Jiang
Abstract:
Inspired by [Pan22], we give a new proof that for an overconvergent modular eigenform $f$ of weight $1+k$ with $k\in\mathbb{Z}_{\ge1}$, assuming that its associated global Galois representation $ρ_{f}$ is irreducible, then $f$ is classical if and only if $ρ_{f}$ is de Rham at $p$. For the proof, we prove that theta operator $θ^{k}$ coincides with Fontaine operator in a suitable sense.
Inspired by [Pan22], we give a new proof that for an overconvergent modular eigenform $f$ of weight $1+k$ with $k\in\mathbb{Z}_{\ge1}$, assuming that its associated global Galois representation $ρ_{f}$ is irreducible, then $f$ is classical if and only if $ρ_{f}$ is de Rham at $p$. For the proof, we prove that theta operator $θ^{k}$ coincides with Fontaine operator in a suitable sense.
△ Less
Submitted 22 October, 2023;
originally announced October 2023.
-
Tail probability of maximal displacement in critical branching Lévy process with stable branching
Authors:
Haojie Hou,
Yiyang Jiang,
Yan-Xia Ren,
Renming Song
Abstract:
Consider a critical branching Lévy process $\{X_t, t\ge 0\}$ with branching rate $β>0, $ offspring distribution $\{p_k:k\geq 0\}$ and spatial motion $\{ξ_t, Π_x\}$. For any $t\ge 0$, let $N_t$ be the collection of particles alive at time $t$, and, for any $u\in N_t$, let $X_u(t)$ be the position of $u$ at time $t$. We study the tail probability of the maximal displacement…
▽ More
Consider a critical branching Lévy process $\{X_t, t\ge 0\}$ with branching rate $β>0, $ offspring distribution $\{p_k:k\geq 0\}$ and spatial motion $\{ξ_t, Π_x\}$. For any $t\ge 0$, let $N_t$ be the collection of particles alive at time $t$, and, for any $u\in N_t$, let $X_u(t)$ be the position of $u$ at time $t$. We study the tail probability of the maximal displacement $M:=\sup_{t>0}\sup_{u\in N_t} X_u(t)$ under the assumption $\lim_{n\to\infty} n^α\sum_{k=n}^\infty p_k =κ\in(0,\infty)$ for some $α\in (1,2)$, $Π_0(ξ_1)=0$ and $Π_0 (|ξ_1|^r)\in (0,\infty)$ for some $r> 2α/(α-1)$. Our main result is a generalization of the main result of Sawyer and Fleischman (1979) for branching Brownian motions and that of Lalley and Shao (2015) for branching random walks, both of which are proved under the assumption $\sum_{k=0}^\infty k^3 p_k<\infty$.
△ Less
Submitted 8 October, 2023;
originally announced October 2023.
-
Ichino period for CM forms
Authors:
Li Cai,
Yangyu Fan,
Yong Jiang
Abstract:
In both local and global settings, we establish explicit relations between Ichino triple product period and Waldspurger toric periods for CM forms via the theta lifting and the see-saw principle.
In both local and global settings, we establish explicit relations between Ichino triple product period and Waldspurger toric periods for CM forms via the theta lifting and the see-saw principle.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
-
Multi-Agent Bayesian Optimization with Coupled Black-Box and Affine Constraints
Authors:
Wenjie Xu,
Yuning Jiang,
Bratislav Svetozarevic,
Colin N. Jones
Abstract:
This paper studies the problem of distributed multi-agent Bayesian optimization with both coupled black-box constraints and known affine constraints. A primal-dual distributed algorithm is proposed that achieves similar regret/violation bounds as those in the single-agent case for the black-box objective and constraint functions. Additionally, the algorithm guarantees an $\mathcal{O}(N\sqrt{T})$ b…
▽ More
This paper studies the problem of distributed multi-agent Bayesian optimization with both coupled black-box constraints and known affine constraints. A primal-dual distributed algorithm is proposed that achieves similar regret/violation bounds as those in the single-agent case for the black-box objective and constraint functions. Additionally, the algorithm guarantees an $\mathcal{O}(N\sqrt{T})$ bound on the cumulative violation for the known affine constraints, where $N$ is the number of agents. Hence, it is ensured that the average of the samples satisfies the affine constraints up to the error $\mathcal{O}({N}/{\sqrt{T}})$. Furthermore, we characterize certain conditions under which our algorithm can bound a stronger metric of cumulative violation and provide best-iterate convergence without affine constraint. The method is then applied to both sampled instances from Gaussian processes and a real-world optimal power allocation problem for wireless communication; the results show that our method simultaneously provides close-to-optimal performance and maintains minor violations on average, corroborating our theoretical analysis.
△ Less
Submitted 2 October, 2023;
originally announced October 2023.
-
Ergodicity in some families of Nevanlinna Functions
Authors:
Tao Chen,
Yunping Jiang,
Linda Keen
Abstract:
We study Nevanlinna functions f that are transcendental meromorphic functions having N asymptotic values and no critical values. In [KK] it was proved that if the orbits of all the asymptotic values have accumulation sets that are compact and on which f is a repeller, then f acts ergodically on its Julia set. In this paper, we prove that if some, but not all of the asymptotic values have this prop…
▽ More
We study Nevanlinna functions f that are transcendental meromorphic functions having N asymptotic values and no critical values. In [KK] it was proved that if the orbits of all the asymptotic values have accumulation sets that are compact and on which f is a repeller, then f acts ergodically on its Julia set. In this paper, we prove that if some, but not all of the asymptotic values have this property, while the others are prepoles, the same holds true. This is the first paper to consider this mixed case.
△ Less
Submitted 18 January, 2024; v1 submitted 28 September, 2023;
originally announced September 2023.
-
Smoothing of surface singularities via equivariant smoothing of lci covers
Authors:
Yunfeng Jiang
Abstract:
We provide some results of the smoothing of surface singularities by Looijenga-Wahl and study smoothing of isolated surface singularities induced by equivariant smoothing of locally complete intersection ($\lci$) singularities. We classify the situation where the smoothing of a simple elliptic singularity, a cusp singularity or its cyclic quotient is induced by the equivariant smoothing of the…
▽ More
We provide some results of the smoothing of surface singularities by Looijenga-Wahl and study smoothing of isolated surface singularities induced by equivariant smoothing of locally complete intersection ($\lci$) singularities. We classify the situation where the smoothing of a simple elliptic singularity, a cusp singularity or its cyclic quotient is induced by the equivariant smoothing of the $\lci$ covers.
△ Less
Submitted 28 September, 2023;
originally announced September 2023.
-
A Generalized Stopping Criterion for Real-Time MPC with Guaranteed Stability
Authors:
Kristína Fedorová,
Yuning Jiang,
Juraj Oravec,
Colin N. Jones,
Michal Kvasnica
Abstract:
Most of the real-time implementations of the stabilizing optimal control actions suffer from the necessity to provide high computational effort. This paper presents a cutting-edge approach for real-time evaluation of linear-quadratic model predictive control (MPC) that employs a novel generalized stopping criterion, achieving asymptotic stability in the presence of input constraints. The proposed…
▽ More
Most of the real-time implementations of the stabilizing optimal control actions suffer from the necessity to provide high computational effort. This paper presents a cutting-edge approach for real-time evaluation of linear-quadratic model predictive control (MPC) that employs a novel generalized stopping criterion, achieving asymptotic stability in the presence of input constraints. The proposed method evaluates a fixed number of iterations independent of the initial condition, eliminating the necessity for computationally expensive methods. We demonstrate the effectiveness of the introduced technique by its implementation of two widely-used first-order optimization methods: the projected gradient descent method (PGDM) and the alternating directions method of multipliers (ADMM). The numerical simulation confirmed a significantly reduced number of iterations, resulting in suboptimality rates of less than 2\,\%, while the effort reductions exceeded 80\,\%. These results nominate the proposed criterion for an efficient real-time implementation method of MPC controllers.
△ Less
Submitted 8 September, 2023;
originally announced September 2023.
-
Data-Driven Robust Control Using Prediction Error Bounds Based on Perturbation Analysis
Authors:
Baiwei Guo,
Yuning Jiang,
Colin N. Jones,
Giancarlo Ferrari-Trecate
Abstract:
For linear systems, many data-driven control methods rely on the behavioral framework, using historical data of the system to predict the future trajectories. However, measurement noise introduces errors in predictions. When the noise is bounded, we propose a method for designing historical experiments that enable the computation of an upper bound on the prediction error. This approach allows us t…
▽ More
For linear systems, many data-driven control methods rely on the behavioral framework, using historical data of the system to predict the future trajectories. However, measurement noise introduces errors in predictions. When the noise is bounded, we propose a method for designing historical experiments that enable the computation of an upper bound on the prediction error. This approach allows us to formulate a minimax control problem where robust constraint satisfaction is enforced. We derive an upper bound on the suboptimality gap of the resulting control input sequence compared to optimal control utilizing accurate measurements. As demonstrated in numerical experiments, the solution derived by our method can achieve constraint satisfaction and a small suboptimality gap despite the measurement noise.
△ Less
Submitted 27 August, 2023;
originally announced August 2023.
-
Degenerate Mean Field Games with Hörmander diffusion
Authors:
Yiming Jiang,
Jingchuang Ren,
Yawei Wei,
Jie Xue
Abstract:
In this paper, we study a class of degenerate mean field game systems arising from the mean field games with Hörmander diffusion, where the generic player may have a ``forbidden'' direction at some point. Here we prove the existence and uniqueness of the classical solutions in weighted Hölder spaces for the PDE systems, which describe the Nash equilibria in the games. The degeneracy causes the lac…
▽ More
In this paper, we study a class of degenerate mean field game systems arising from the mean field games with Hörmander diffusion, where the generic player may have a ``forbidden'' direction at some point. Here we prove the existence and uniqueness of the classical solutions in weighted Hölder spaces for the PDE systems, which describe the Nash equilibria in the games. The degeneracy causes the lack of commutation of vector fields and the fundamental solution which are the main difficulties in the proof of the global Schauder estimate and the weak maximum principle. Based on the idea of the localizing technique and the local homogeneity of degenerate operators, we extend the maximum regularity result and obtain the global Schauder estimates. For the weak maximum principle, we construct a subsolution instead of the fundamental solution of the degenerate operators.
△ Less
Submitted 20 August, 2023;
originally announced August 2023.
-
Inverse problems for nonlinear progressive waves
Authors:
Yan Jiang,
Hongyu Liu,
Tianhao Ni,
Kai Zhang
Abstract:
We propose and study several inverse problems associated with the nonlinear progressive waves that arise in infrasonic inversions. The nonlinear progressive equation (NPE) is of a quasilinear form $\partial_t^2 u=Δf(x, u)$ with $f(x, u)=c_1(x) u+c_2(x) u^n$, $n\geq 2$, and can be derived from the hyperbolic system of conservation laws associated with the Euler equations. We establish unique identi…
▽ More
We propose and study several inverse problems associated with the nonlinear progressive waves that arise in infrasonic inversions. The nonlinear progressive equation (NPE) is of a quasilinear form $\partial_t^2 u=Δf(x, u)$ with $f(x, u)=c_1(x) u+c_2(x) u^n$, $n\geq 2$, and can be derived from the hyperbolic system of conservation laws associated with the Euler equations. We establish unique identifiability results in determining $f(x, u)$ as well as the associated initial data by the boundary measurement. Our analysis relies on high-order linearisation and construction of proper Gaussian beam solutions for the underlying wave equations. In addition to its theoretical interest, we connect our study to applications of practical importance in infrasound waveform inversion.
△ Less
Submitted 15 August, 2023;
originally announced August 2023.
-
A virtual $\mathrm{PGL}_r$-$\mathrm{SL}_r$ correspondence for projective surfaces
Authors:
D. van Bree,
A. Gholampour,
Y. Jiang,
M. Kool
Abstract:
For a smooth projective surface $X$ satisfying $H_1(X,\mathbb{Z}) = 0$ and $w \in H^2(X,μ_r)$, we study deformation invariants of the pair $(X,w)$. Choosing a Brauer-Severi variety $Y$ (or, equivalently, Azumaya algebra $\mathcal{A}$) over $X$ with Stiefel-Whitney class $w$, the invariants are defined as virtual intersection numbers on suitable moduli spaces of stable twisted sheaves on $Y$ constr…
▽ More
For a smooth projective surface $X$ satisfying $H_1(X,\mathbb{Z}) = 0$ and $w \in H^2(X,μ_r)$, we study deformation invariants of the pair $(X,w)$. Choosing a Brauer-Severi variety $Y$ (or, equivalently, Azumaya algebra $\mathcal{A}$) over $X$ with Stiefel-Whitney class $w$, the invariants are defined as virtual intersection numbers on suitable moduli spaces of stable twisted sheaves on $Y$ constructed by Yoshioka (or, equivalently, moduli spaces of $\mathcal{A}$-modules of Hoffmann-Stuhler).
We show that the invariants do not depend on the choice of $Y$. Using a result of de Jong, we observe that they are deformation invariants of the pair $(X,w)$. For surfaces with $h^{2,0}(X) > 0$, we show that the invariants can often be expressed as virtual intersection numbers on Gieseker-Maruyama-Simpson moduli spaces of stable sheaves on $X$. This can be seen as a $\mathrm{PGL}_r$-$\mathrm{SL}_r$ correspondence.
As an application, we express $\mathrm{SU}(r) / μ_r$ Vafa-Witten invariants of $X$ in terms of $\mathrm{SU}(r)$ Vafa-Witten invariants of $X$. We also show how formulae from Donaldson theory can be used to obtain upper bounds for the minimal second Chern class of Azumaya algebras on $X$ with given division algebra at the generic point.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Hypergraph-Based Fast Distributed AC Power Flow Optimization
Authors:
Xinliang Dai,
Yingzhao Lian,
Yuning Jiang,
Colin N. Jones,
Veit Hagenmeyer
Abstract:
This paper presents a novel distributed approach for solving AC power flow (PF) problems. The optimization problem is reformulated into a distributed form using a communication structure corresponding to a hypergraph, by which complex relationships between subgrids can be expressed as hyperedges. Then, a hypergraph-based distributed sequential quadratic programming (HDQ) approach is proposed to ha…
▽ More
This paper presents a novel distributed approach for solving AC power flow (PF) problems. The optimization problem is reformulated into a distributed form using a communication structure corresponding to a hypergraph, by which complex relationships between subgrids can be expressed as hyperedges. Then, a hypergraph-based distributed sequential quadratic programming (HDQ) approach is proposed to handle the reformulated problems, and the hypergraph-based distributed sequential quadratic programming (HDSQP) is used as the inner algorithm to solve the corresponding QP subproblems, which are respectively condensed using Schur complements with respect to coupling variables defined by hyperedges. Furthermore, we rigorously establish the convergence guarantee of the proposed algorithm with a locally quadratic rate and the one-step convergence of the inner algorithm when using the Levenberg-Marquardt regularization. Our analysis also demonstrates that the computational complexity of the proposed algorithm is much lower than the state-of-art distributed algorithm. We implement the proposed algorithm in an open-source toolbox, i.e., rapidPF, and conduct numerical tests that validate the proof and demonstrate the great potential of the proposed distributed algorithm in terms of communication effort and computational speed.
△ Less
Submitted 14 July, 2023; v1 submitted 13 July, 2023;
originally announced July 2023.
-
Homogeneous Second-Order Descent Framework: A Fast Alternative to Newton-Type Methods
Authors:
Chang He,
Yuntian Jiang,
Chuwen Zhang,
Dongdong Ge,
Bo Jiang,
Yinyu Ye
Abstract:
This paper proposes a homogeneous second-order descent framework (HSODF) for nonconvex and convex optimization based on the generalized homogeneous model (GHM). In comparison to the Newton steps, the GHM can be solved by extremal symmetric eigenvalue procedures and thus grant an advantage in ill-conditioned problems. Moreover, GHM extends the ordinary homogeneous model (OHM) (Zhang et al. 2022) to…
▽ More
This paper proposes a homogeneous second-order descent framework (HSODF) for nonconvex and convex optimization based on the generalized homogeneous model (GHM). In comparison to the Newton steps, the GHM can be solved by extremal symmetric eigenvalue procedures and thus grant an advantage in ill-conditioned problems. Moreover, GHM extends the ordinary homogeneous model (OHM) (Zhang et al. 2022) to allow adaptiveness in the construction of the aggregated matrix. Consequently, HSODF is able to recover some well-known second-order methods, such as trust-region methods and gradient regularized methods, while maintaining comparable iteration complexity bounds. We also study two specific realizations of HSODF. One is adaptive HSODM, which has a parameter-free $O(ε^{-3/2})$ global complexity bound for nonconvex second-order Lipschitz continuous objective functions. The other one is homotopy HSODM, which is proven to have a global linear rate of convergence without strong convexity. The efficiency of our approach to ill-conditioned and high-dimensional problems is justified by some preliminary numerical results.
△ Less
Submitted 6 May, 2024; v1 submitted 30 June, 2023;
originally announced June 2023.
-
Wasserstein distributional robustness of neural networks
Authors:
Xingjian Bai,
Guangyi He,
Yifan Jiang,
Jan Obloj
Abstract:
Deep neural networks are known to be vulnerable to adversarial attacks (AA). For an image recognition task, this means that a small perturbation of the original can result in the image being misclassified. Design of such attacks as well as methods of adversarial training against them are subject of intense research. We re-cast the problem using techniques of Wasserstein distributionally robust opt…
▽ More
Deep neural networks are known to be vulnerable to adversarial attacks (AA). For an image recognition task, this means that a small perturbation of the original can result in the image being misclassified. Design of such attacks as well as methods of adversarial training against them are subject of intense research. We re-cast the problem using techniques of Wasserstein distributionally robust optimization (DRO) and obtain novel contributions leveraging recent insights from DRO sensitivity analysis. We consider a set of distributional threat models. Unlike the traditional pointwise attacks, which assume a uniform bound on perturbation of each input data point, distributional threat models allow attackers to perturb inputs in a non-uniform way. We link these more general attacks with questions of out-of-sample performance and Knightian uncertainty. To evaluate the distributional robustness of neural networks, we propose a first-order AA algorithm and its multi-step version. Our attack algorithms include Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD) as special cases. Furthermore, we provide a new asymptotic estimate of the adversarial accuracy against distributional threat models. The bound is fast to compute and first-order accurate, offering new insights even for the pointwise AA. It also naturally yields out-of-sample performance guarantees. We conduct numerical experiments on the CIFAR-10 dataset using DNNs on RobustBench to illustrate our theoretical results. Our code is available at https://github.com/JanObloj/W-DRO-Adversarial-Methods.
△ Less
Submitted 16 June, 2023;
originally announced June 2023.
-
On counting plurifibered varieties
Authors:
Yunfeng Jiang,
Hsian-Hua Tseng
Abstract:
We consider the problem of enumeration of maps from plurifibered varieties.
We consider the problem of enumeration of maps from plurifibered varieties.
△ Less
Submitted 14 June, 2023;
originally announced June 2023.
-
Entropy Structure Informed Learning for Inverse XDE Problems
Authors:
Yan Jiang,
Wuyue Yang,
Yi Zhu,
Liu Hong
Abstract:
Entropy, since its first discovery by Ludwig Boltzmann in 1877, has been widely applied in diverse disciplines, including thermodynamics, continuum mechanics, mathematical analysis, machine learning, etc. In this paper, we propose a new method for solving the inverse XDE (ODE, PDE, SDE) problems by utilizing the entropy balance equation instead of the original differential equations. This distingu…
▽ More
Entropy, since its first discovery by Ludwig Boltzmann in 1877, has been widely applied in diverse disciplines, including thermodynamics, continuum mechanics, mathematical analysis, machine learning, etc. In this paper, we propose a new method for solving the inverse XDE (ODE, PDE, SDE) problems by utilizing the entropy balance equation instead of the original differential equations. This distinguishing feature constitutes a major difference between our current method and other previous classical methods (e.g. SINDy). Despite concerns about the potential information loss during the compression procedure from the original XDEs to single entropy balance equation, various examples from MM reactions, Schlogl model and chemical Lorenz equations in the form of ODEs to nonlinear porous medium equation and Fokker-Planck equation with a double-well potential in the PDE form all well confirm the accuracy, robustness and reliability of our method, as well as its comparable performance with respect to SINDy.
△ Less
Submitted 14 June, 2023;
originally announced June 2023.
-
Bayesian Optimization of Expensive Nested Grey-Box Functions
Authors:
Wenjie Xu,
Yuning Jiang,
Bratislav Svetozarevic,
Colin N. Jones
Abstract:
We consider the problem of optimizing a grey-box objective function, i.e., nested function composed of both black-box and white-box functions. A general formulation for such grey-box problems is given, which covers the existing grey-box optimization formulations as special cases. We then design an optimism-driven algorithm to solve it. Under certain regularity assumptions, our algorithm achieves s…
▽ More
We consider the problem of optimizing a grey-box objective function, i.e., nested function composed of both black-box and white-box functions. A general formulation for such grey-box problems is given, which covers the existing grey-box optimization formulations as special cases. We then design an optimism-driven algorithm to solve it. Under certain regularity assumptions, our algorithm achieves similar regret bound as that for the standard black-box Bayesian optimization algorithm, up to a constant multiplicative term depending on the Lipschitz constants of the functions considered. We further extend our method to the constrained case and discuss special cases. For the commonly used kernel functions, the regret bounds allow us to derive a convergence rate to the optimal solution. Experimental results show that our grey-box optimization method empirically improves the speed of finding the global optimal solution significantly, as compared to the standard black-box optimization algorithm.
△ Less
Submitted 2 August, 2023; v1 submitted 8 June, 2023;
originally announced June 2023.
-
UAdam: Unified Adam-Type Algorithmic Framework for Non-Convex Stochastic Optimization
Authors:
Yiming Jiang,
Jinlan Liu,
Dongpo Xu,
Danilo P. Mandic
Abstract:
Adam-type algorithms have become a preferred choice for optimisation in the deep learning setting, however, despite success, their convergence is still not well understood. To this end, we introduce a unified framework for Adam-type algorithms (called UAdam). This is equipped with a general form of the second-order moment, which makes it possible to include Adam and its variants as special cases,…
▽ More
Adam-type algorithms have become a preferred choice for optimisation in the deep learning setting, however, despite success, their convergence is still not well understood. To this end, we introduce a unified framework for Adam-type algorithms (called UAdam). This is equipped with a general form of the second-order moment, which makes it possible to include Adam and its variants as special cases, such as NAdam, AMSGrad, AdaBound, AdaFom, and Adan. This is supported by a rigorous convergence analysis of UAdam in the non-convex stochastic setting, showing that UAdam converges to the neighborhood of stationary points with the rate of $\mathcal{O}(1/T)$. Furthermore, the size of neighborhood decreases as $β$ increases. Importantly, our analysis only requires the first-order momentum factor to be close enough to 1, without any restrictions on the second-order momentum factor. Theoretical results also show that vanilla Adam can converge by selecting appropriate hyperparameters, which provides a theoretical guarantee for the analysis, applications, and further developments of the whole class of Adam-type algorithms.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
A Practical Walk-on-Boundary Method for Boundary Value Problems
Authors:
Ryusuke Sugimoto,
Terry Chen,
Yiti Jiang,
Christopher Batty,
Toshiya Hachisuka
Abstract:
We introduce the walk-on-boundary (WoB) method for solving boundary value problems to computer graphics. WoB is a grid-free Monte Carlo solver for certain classes of second order partial differential equations. A similar Monte Carlo solver, the walk-on-spheres (WoS) method, has been recently popularized in computer graphics due to its advantages over traditional spatial discretization-based altern…
▽ More
We introduce the walk-on-boundary (WoB) method for solving boundary value problems to computer graphics. WoB is a grid-free Monte Carlo solver for certain classes of second order partial differential equations. A similar Monte Carlo solver, the walk-on-spheres (WoS) method, has been recently popularized in computer graphics due to its advantages over traditional spatial discretization-based alternatives. We show that WoB's intrinsic properties yield further advantages beyond those of WoS. Unlike WoS, WoB naturally supports various boundary conditions (Dirichlet, Neumann, Robin, and mixed) for both interior and exterior domains. WoB builds upon boundary integral formulations, and it is mathematically more similar to light transport simulation in rendering than the random walk formulation of WoS. This similarity between WoB and rendering allows us to implement WoB on top of Monte Carlo ray tracing, and to incorporate advanced rendering techniques (e.g., bidirectional estimators with multiple importance sampling, the virtual point lights method, and Markov chain Monte Carlo) into WoB. WoB does not suffer from the intrinsic bias of WoS near the boundary and can estimate solutions precisely on the boundary. Our numerical results highlight the advantages of WoB over WoS as an attractive alternative to solve boundary value problems based on Monte Carlo.
△ Less
Submitted 19 May, 2023; v1 submitted 7 May, 2023;
originally announced May 2023.
-
Terwilliger $\mathbb{F}$-algebras of certain Cayley tables
Authors:
Yu Jiang
Abstract:
Let $\mathbb{F}$ be an arbitrary field. In this paper, we continue studying the Terwilliger algebras of association schemes over $\mathbb{F}$ that were called the Terwilliger $\mathbb{F}$-algebras of association schemes in [8]. We determine the algebraic structures of the Terwilliger $\mathbb{F}$-algebras of the association schemes induced from the Cayley tables of elementary abelian $2$-groups, w…
▽ More
Let $\mathbb{F}$ be an arbitrary field. In this paper, we continue studying the Terwilliger algebras of association schemes over $\mathbb{F}$ that were called the Terwilliger $\mathbb{F}$-algebras of association schemes in [8]. We determine the algebraic structures of the Terwilliger $\mathbb{F}$-algebras of the association schemes induced from the Cayley tables of elementary abelian $2$-groups, which provides infinite many examples and counterexamples for the study of the Terwilliger $\mathbb{F}$-algebras of association schemes.
△ Less
Submitted 4 September, 2023; v1 submitted 16 April, 2023;
originally announced April 2023.
-
Primal-Dual Contextual Bayesian Optimization for Control System Online Optimization with Time-Average Constraints
Authors:
Wenjie Xu,
Yuning Jiang,
Bratislav Svetozarevic,
Colin N. Jones
Abstract:
This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual disturbances. A primal-dual contextual Bayesian optimization algorithm is proposed that achieves sublinear cumulative regret with respect to the dynamic optimal soluti…
▽ More
This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual disturbances. A primal-dual contextual Bayesian optimization algorithm is proposed that achieves sublinear cumulative regret with respect to the dynamic optimal solution under certain regularity conditions. Furthermore, the algorithm achieves zero time-average constraint violation, ensuring that the average value of the constraint function satisfies the desired constraint. The method is applied to both sampled instances from Gaussian processes and a continuous stirred tank reactor parameter tuning problem; simulation results show that the method simultaneously provides close-to-optimal performance and maintains constraint feasibility on average. This contrasts current state-of-the-art methods, which either suffer from large cumulative regret or severe constraint violations for the case studies presented.
△ Less
Submitted 20 September, 2023; v1 submitted 12 April, 2023;
originally announced April 2023.
-
Safe Zeroth-Order Optimization Using Linear Programs
Authors:
Baiwei Guo,
Yang Wang,
Yuning Jiang,
Maryam Kamgarpour,
Giancarlo Ferrari-Trecate
Abstract:
To solve unmodeled optimization problems with hard constraints, this paper proposes a novel zeroth-order approach called Safe Zeroth-order Optimization using Linear Programs (SZO-LP). The SZO-LP method solves a linear program in each iteration to find a descent direction, followed by a step length determination. We prove that, under mild conditions, the iterates of SZO-LP have an accumulation poin…
▽ More
To solve unmodeled optimization problems with hard constraints, this paper proposes a novel zeroth-order approach called Safe Zeroth-order Optimization using Linear Programs (SZO-LP). The SZO-LP method solves a linear program in each iteration to find a descent direction, followed by a step length determination. We prove that, under mild conditions, the iterates of SZO-LP have an accumulation point that is also the primal of a KKT pair. We then apply SZO-LP to solve an Optimal Power Flow (OPF) problem on the IEEE 30-bus system. The results demonstrate that SZO-LP requires less computation time and samples compared to state-of-the-art approaches.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.