Showing 1–50 of 115 results for author: Pang, S

Motif-Consistent Counterfactuals with Adversarial Refinement for Graph-Level Anomaly Detection

Authors: Chunjing Xiao, Shikang Pang, Wenxin Tai, Yanlong Huang, Goce Trajcevski, Fan Zhou

Abstract: Graph-level anomaly detection is significant in diverse domains. To improve detection performance, counterfactual graphs have been exploited to benefit the generalization capacity by learning causal relations. Most existing studies directly introduce perturbations (e.g., flipping edges) to generate counterfactual graphs, which are prone to alter the semantics of generated examples and make them of… ▽ More Graph-level anomaly detection is significant in diverse domains. To improve detection performance, counterfactual graphs have been exploited to benefit the generalization capacity by learning causal relations. Most existing studies directly introduce perturbations (e.g., flipping edges) to generate counterfactual graphs, which are prone to alter the semantics of generated examples and make them off the data manifold, resulting in sub-optimal performance. To address these issues, we propose a novel approach, Motif-consistent Counterfactuals with Adversarial Refinement (MotifCAR), for graph-level anomaly detection. The model combines the motif of one graph, the core subgraph containing the identification (category) information, and the contextual subgraph (non-motif) of another graph to produce a raw counterfactual graph. However, the produced raw graph might be distorted and cannot satisfy the important counterfactual properties: Realism, Validity, Proximity and Sparsity. Towards that, we present a Generative Adversarial Network (GAN)-based graph optimizer to refine the raw counterfactual graphs. It adopts the discriminator to guide the generator to generate graphs close to realistic data, i.e., meet the property Realism. Further, we design the motif consistency to force the motif of the generated graphs to be consistent with the realistic graphs, meeting the property Validity. Also, we devise the contextual loss and connection loss to control the contextual subgraph and the newly added links to meet the properties Proximity and Sparsity. As a result, the model can generate high-quality counterfactual graphs. Experiments demonstrate the superiority of MotifCAR. △ Less

Submitted 18 July, 2024; originally announced July 2024.

Comments: Accepted by KDD 2024

Foster Adaptivity and Balance in Learning with Noisy Labels

Authors: Mengmeng Sheng, Zeren Sun, Tao Chen, Shuchao Pang, Yucheng Wang, Yazhou Yao

Abstract: Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection paradigm and usually rely on dataset-dependent prior knowledge (\eg, a pre-defined threshold) to cope with label noise, inevitably degrading the adaptivity. Mo… ▽ More Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection paradigm and usually rely on dataset-dependent prior knowledge (\eg, a pre-defined threshold) to cope with label noise, inevitably degrading the adaptivity. Moreover, existing methods tend to neglect the class balance in selecting samples, leading to biased model performance. To this end, we propose a simple yet effective approach named \textbf{SED} to deal with label noise in a \textbf{S}elf-adaptiv\textbf{E} and class-balance\textbf{D} manner. Specifically, we first design a novel sample selection strategy to empower self-adaptivity and class balance when identifying clean and noisy data. A mean-teacher model is then employed to correct labels of noisy samples. Subsequently, we propose a self-adaptive and class-balanced sample re-weighting mechanism to assign different weights to detected noisy samples. Finally, we additionally employ consistency regularization on selected clean samples to improve model generalization performance. Extensive experimental results on synthetic and real-world datasets demonstrate the effectiveness and superiority of our proposed method. The source code has been made available at https://github.com/NUST-Machine-Intelligence-Laboratory/SED. △ Less

Submitted 2 July, 2024; originally announced July 2024.

Comments: accepted by the European Conference on Computer Vision (ECCV), 2024

Counterfactual Data Augmentation with Denoising Diffusion for Graph Anomaly Detection

Authors: Chunjing Xiao, Shikang Pang, Xovee Xu, Xuan Li, Goce Trajcevski, Fan Zhou

Abstract: A critical aspect of Graph Neural Networks (GNNs) is to enhance the node representations by aggregating node neighborhood information. However, when detecting anomalies, the representations of abnormal nodes are prone to be averaged by normal neighbors, making the learned anomaly representations less distinguishable. To tackle this issue, we propose CAGAD -- an unsupervised Counterfactual data Aug… ▽ More A critical aspect of Graph Neural Networks (GNNs) is to enhance the node representations by aggregating node neighborhood information. However, when detecting anomalies, the representations of abnormal nodes are prone to be averaged by normal neighbors, making the learned anomaly representations less distinguishable. To tackle this issue, we propose CAGAD -- an unsupervised Counterfactual data Augmentation method for Graph Anomaly Detection -- which introduces a graph pointer neural network as the heterophilic node detector to identify potential anomalies whose neighborhoods are normal-node-dominant. For each identified potential anomaly, we design a graph-specific diffusion model to translate a part of its neighbors, which are probably normal, into anomalous ones. At last, we involve these translated neighbors in GNN neighborhood aggregation to produce counterfactual representations of anomalies. Through aggregating the translated anomalous neighbors, counterfactual representations become more distinguishable and further advocate detection performance. The experimental results on four datasets demonstrate that CAGAD significantly outperforms strong baselines, with an average improvement of 2.35% on F1, 2.53% on AUC-ROC, and 2.79% on AUC-PR. △ Less

Submitted 2 July, 2024; originally announced July 2024.

Comments: Accepted by IEEE Transactions on Computational Social Systems(TCSS). DOI: https://doi.org/10.1109/TCSS.2024.3403503

EmoAttack: Emotion-to-Image Diffusion Models for Emotional Backdoor Generation

Authors: Tianyu Wei, Shanmin Pang, Qi Guo, Yizhuo Ma, Qing Guo

Abstract: Text-to-image diffusion models can create realistic images based on input texts. Users can describe an object to convey their opinions visually. In this work, we unveil a previously unrecognized and latent risk of using diffusion models to generate images; we utilize emotion in the input texts to introduce negative contents, potentially eliciting unfavorable emotions in users. Emotions play a cruc… ▽ More Text-to-image diffusion models can create realistic images based on input texts. Users can describe an object to convey their opinions visually. In this work, we unveil a previously unrecognized and latent risk of using diffusion models to generate images; we utilize emotion in the input texts to introduce negative contents, potentially eliciting unfavorable emotions in users. Emotions play a crucial role in expressing personal opinions in our daily interactions, and the inclusion of maliciously negative content can lead users astray, exacerbating negative emotions. Specifically, we identify the emotion-aware backdoor attack (EmoAttack) that can incorporate malicious negative content triggered by emotional texts during image generation. We formulate such an attack as a diffusion personalization problem to avoid extensive model retraining and propose the EmoBooth. Unlike existing personalization methods, our approach fine-tunes a pre-trained diffusion model by establishing a mapping between a cluster of emotional words and a given reference image containing malicious negative content. To validate the effectiveness of our method, we built a dataset and conducted extensive analysis and discussion about its effectiveness. Given consumers' widespread use of diffusion models, uncovering this threat is critical for society. △ Less

Submitted 22 June, 2024; originally announced June 2024.

m-QMDS codes over mixed alphabets via orthogonal arrays

Authors: Shanqi Pang, Mengqian Chen, Rong Yan, Yan Zhu

Abstract: The construction of quantum error-correcting codes (QECCs) with good parameters is a hot topic in the area of quantum information and quantum computing. Quantum maximum distance separable (QMDS) codes are optimal because the minimum distance cannot be improved for a given length and code size. The QMDS codes over mixed alphabets are rarely known even if the existence and construction of QECCs over… ▽ More The construction of quantum error-correcting codes (QECCs) with good parameters is a hot topic in the area of quantum information and quantum computing. Quantum maximum distance separable (QMDS) codes are optimal because the minimum distance cannot be improved for a given length and code size. The QMDS codes over mixed alphabets are rarely known even if the existence and construction of QECCs over mixed alphabets with minimum distance more than or equal to three are still an open question. In this paper, we define an $m$-QMDS code over mixed alphabets, which is a generalization of QMDS codes. We establish a relation between $m$-QMDS codes over mixed alphabets and asymmetrical orthogonal arrays (OAs) with orthogonal partitions. Using this relation, we propose a general method to construct $m$-QMDS codes. As applications of this method, numerous infinite families of $m$-QMDS codes over mixed alphabets can be constructed explicitly. Compared with existing codes, the constructed codes have more flexibility in the choice of parameters, such as the alphabet sizes, length and dimension of the encoding state. △ Less

Submitted 15 June, 2024; originally announced June 2024.

SOPHON: Non-Fine-Tunable Learning to Restrain Task Transferability For Pre-trained Models

Authors: Jiangyi Deng, Shengyuan Pang, Yanjiao Chen, Liangming Xia, Yijie Bai, Haiqin Weng, Wenyuan Xu

Abstract: Instead of building deep learning models from scratch, developers are more and more relying on adapting pre-trained models to their customized tasks. However, powerful pre-trained models may be misused for unethical or illegal tasks, e.g., privacy inference and unsafe content generation. In this paper, we introduce a pioneering learning paradigm, non-fine-tunable learning, which prevents the pre-t… ▽ More Instead of building deep learning models from scratch, developers are more and more relying on adapting pre-trained models to their customized tasks. However, powerful pre-trained models may be misused for unethical or illegal tasks, e.g., privacy inference and unsafe content generation. In this paper, we introduce a pioneering learning paradigm, non-fine-tunable learning, which prevents the pre-trained model from being fine-tuned to indecent tasks while preserving its performance on the original task. To fulfill this goal, we propose SOPHON, a protection framework that reinforces a given pre-trained model to be resistant to being fine-tuned in pre-defined restricted domains. Nonetheless, this is challenging due to a diversity of complicated fine-tuning strategies that may be adopted by adversaries. Inspired by model-agnostic meta-learning, we overcome this difficulty by designing sophisticated fine-tuning simulation and fine-tuning evaluation algorithms. In addition, we carefully design the optimization process to entrap the pre-trained model within a hard-to-escape local optimum regarding restricted domains. We have conducted extensive experiments on two deep learning modes (classification and generation), seven restricted domains, and six model architectures to verify the effectiveness of SOPHON. Experiment results verify that fine-tuning SOPHON-protected models incurs an overhead comparable to or even greater than training from scratch. Furthermore, we confirm the robustness of SOPHON to three fine-tuning methods, five optimizers, various learning rates and batch sizes. SOPHON may help boost further investigations into safe and responsible AI. △ Less

Submitted 19 April, 2024; originally announced April 2024.

Comments: Accepted by IEEE Symposium on Security and Privacy 2024

Efficiently Adversarial Examples Generation for Visual-Language Models under Targeted Transfer Scenarios using Diffusion Models

Authors: Qi Guo, Shanmin Pang, Xiaojun Jia, Qing Guo

Abstract: Targeted transfer-based attacks involving adversarial examples pose a significant threat to large visual-language models (VLMs). However, the state-of-the-art (SOTA) transfer-based attacks incur high costs due to excessive iteration counts. Furthermore, the generated adversarial examples exhibit pronounced adversarial noise and demonstrate limited efficacy in evading defense methods such as DiffPu… ▽ More Targeted transfer-based attacks involving adversarial examples pose a significant threat to large visual-language models (VLMs). However, the state-of-the-art (SOTA) transfer-based attacks incur high costs due to excessive iteration counts. Furthermore, the generated adversarial examples exhibit pronounced adversarial noise and demonstrate limited efficacy in evading defense methods such as DiffPure. To address these issues, inspired by score matching, we introduce AdvDiffVLM, which utilizes diffusion models to generate natural, unrestricted adversarial examples. Specifically, AdvDiffVLM employs Adaptive Ensemble Gradient Estimation to modify the score during the diffusion model's reverse generation process, ensuring the adversarial examples produced contain natural adversarial semantics and thus possess enhanced transferability. Simultaneously, to enhance the quality of adversarial examples further, we employ the GradCAM-guided Mask method to disperse adversarial semantics throughout the image, rather than concentrating them in a specific area. Experimental results demonstrate that our method achieves a speedup ranging from 10X to 30X compared to existing transfer-based attack methods, while maintaining superior quality of adversarial examples. Additionally, the generated adversarial examples possess strong transferability and exhibit increased robustness against adversarial defense methods. Notably, AdvDiffVLM can successfully attack commercial VLMs, including GPT-4V, in a black-box manner. △ Less

Submitted 18 April, 2024; v1 submitted 16 April, 2024; originally announced April 2024.

Enhancing Content-based Recommendation via Large Language Model

Authors: Wentao Xu, Qianqian Xie, Shuo Yang, Jiangxia Cao, Shuchao Pang

Abstract: In real-world applications, users express different behaviors when they interact with different items, including implicit click/like interactions, and explicit comments/reviews interactions. Nevertheless, almost all recommender works are focused on how to describe user preferences by the implicit click/like interactions, to find the synergy of people. For the content-based explicit comments/review… ▽ More In real-world applications, users express different behaviors when they interact with different items, including implicit click/like interactions, and explicit comments/reviews interactions. Nevertheless, almost all recommender works are focused on how to describe user preferences by the implicit click/like interactions, to find the synergy of people. For the content-based explicit comments/reviews interactions, some works attempt to utilize them to mine the semantic knowledge to enhance recommender models. However, they still neglect the following two points: (1) The content semantic is a universal world knowledge; how do we extract the multi-aspect semantic information to empower different domains? (2) The user/item ID feature is a fundamental element for recommender models; how do we align the ID and content semantic feature space? In this paper, we propose a `plugin' semantic knowledge transferring method \textbf{LoID}, which includes two major components: (1) LoRA-based large language model pretraining to extract multi-aspect semantic information; (2) ID-based contrastive objective to align their feature spaces. We conduct extensive experiments with SOTA baselines on real-world datasets, the detailed results demonstrating significant improvements of our method LoID. △ Less

Submitted 29 March, 2024; originally announced April 2024.

Comments: Work in progress

Quantum-limited superresolution of two incoherent point sources with unknown photon numbers

Authors: Junyan Li, Shengshi Pang

Abstract: Superresolution has been demonstrated to overcome the limitation of the Rayleigh's criterion and achieve significant improvement of the precision in resolving the centroid separation of two incoherent optical point sources. However, in recent years, it was found that if the photon numbers of the two incoherent optical sources are unknown, the precision of superresolution vanishes when the two phot… ▽ More Superresolution has been demonstrated to overcome the limitation of the Rayleigh's criterion and achieve significant improvement of the precision in resolving the centroid separation of two incoherent optical point sources. However, in recent years, it was found that if the photon numbers of the two incoherent optical sources are unknown, the precision of superresolution vanishes when the two photon numbers are actually different. In this work, we analyze the estimation precision of the centroid separation between two incoherent optical sources with the same point-spread functions and unknown photon numbers in detail, and show that when the photon numbers of the two optical sources are different but sufficiently close, the superresolution can still realized but with different precisions. We find the condition on how close the photons numbers of two optical sources need to be to realize the superresolution, and derive the precision of superresolution in different regimes of the photon number difference. We further consider the superresolution for two incoherent optical sources with different point-spread functions, and show that the competition between the difference of photon numbers, the difference of the two point-spread functions and the centroid separation of the two optical sources determines the precision of superresolution. The results exhibit various precision limits of the centroid separation distinct from that of two point sources with identical point-spread functions and equal photon numbers. The results are finally illustrated by Gaussian point-spread functions. △ Less

Submitted 20 March, 2024; originally announced March 2024.

Comments: 24 pages, 3 figures, 2 tables

Monotone Mean-Variance Portfolio Selection in Semimartingale Markets: Martingale Method

Authors: Yuchen Li, Zongxia Liang, Shunzhi Pang

Abstract: We use the martingale method to discuss the relationship between mean-variance (MV) and monotone mean-variance (MMV) portfolio selections. We propose a unified framework to discuss the relationship in general financial markets without any specific setting or completeness requirement. We apply this framework to a semimartingale market and find that MV and MMV are consistent if and only if the varia… ▽ More We use the martingale method to discuss the relationship between mean-variance (MV) and monotone mean-variance (MMV) portfolio selections. We propose a unified framework to discuss the relationship in general financial markets without any specific setting or completeness requirement. We apply this framework to a semimartingale market and find that MV and MMV are consistent if and only if the variance-optimal signed martingale measure keeps non-negative. Further, we provide an example to show the application of our result. △ Less

Submitted 10 March, 2024; originally announced March 2024.

MSC Class: 91G10; 91B16; 93E20

A Novel Shortest Path Query Algorithm Based on Optimized Adaptive Topology Structure

Authors: Xiao Fang, Xuyang Song, Jiyuan Ma, Guanhua Liu, Shurong Pang, Wenbo Zhao, Cong Cao, Ling Fan

Abstract: Urban rail transit is a fundamental component of public transportation, however, commonly station-based path search algorithms often overlook the impact of transfer times on search results, leading to decreased accuracy. To solve this problem, this paper proposes a novel shortest path query algorithm based on adaptive topology optimization called the Adaptive Topology Extension Road Network Struct… ▽ More Urban rail transit is a fundamental component of public transportation, however, commonly station-based path search algorithms often overlook the impact of transfer times on search results, leading to decreased accuracy. To solve this problem, this paper proposes a novel shortest path query algorithm based on adaptive topology optimization called the Adaptive Topology Extension Road Network Structure (ATEN). This algorithm categorizes transfer stations into different types and treats travel time and transfer time equivalently as weights for edges in the topological graph. The proposed algorithm introduces virtual stations to differentiate between pedestrian paths and train paths, eliminating the need for additional operations on transfer stations. The algorithm controls the extent of expansion in the urban rail transit topology, overcoming query errors caused by mishandling of transfer stations in the existing algorithm. Finally, a series of simulation experiments were conducted on Beijing's urban rail transit network to validate both correctness and efficiency of the proposed adaptive topology optimization algorithm. The results demonstrate significant advantages compared to existing similar algorithms. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Reverse Shock Emission in an Off-axis Top-hat Jet Model for Gamma-Ray Bursts

Authors: Sen-Lin Pang, Zi-Gao Dai

Abstract: The afterglow of a gamma-ray burst (GRB) has been widely argued to arise from the interaction of a relativistic outflow with its ambient medium. During such an interaction, a pair of shocks are generated: a forward shock that propagates into the medium, and a reverse shock that propagates into the outflow. Extensive studies have been conducted on the emission from the forward shock viewed off-axis… ▽ More The afterglow of a gamma-ray burst (GRB) has been widely argued to arise from the interaction of a relativistic outflow with its ambient medium. During such an interaction, a pair of shocks are generated: a forward shock that propagates into the medium, and a reverse shock that propagates into the outflow. Extensive studies have been conducted on the emission from the forward shock viewed off-axis. Furthermore, the observation of a reverse shock in an on-axis short GRB suggests that the reverse shock can produce an electromagnetic counterpart to a gravitational wave-detected merger. In this paper, we investigate the contribution of the reverse shock to the afterglow from a top-hat jet viewed off-axis, and apply our model to some short GRBs previously modeled by an off-axis emission. We employ the Markov Chain Monte Carlo (MCMC) method to get the model parameters (i.e., the jet's half-opening angle $θ_j$, the viewing angle $θ_\text{obs}$, the initial Lorentz factor $Γ_0$, and the isotropic energy $E_\mathrm{iso}$). Our model successfully reproduces off-axis afterglow emission without a structured jet. In addition, our calculations suggest that the reverse shock may produce a prominent feature in an early afterglow, which can be potentially observed in an orphan optical afterglow. △ Less

Submitted 27 February, 2024; originally announced February 2024.

Comments: 13 pages, 10 figures, 2 tables, accepted for publication in MNRAS

Quantum Control for Zeno effect with noises

Authors: Haorui Chen, Shengshi Pang

Abstract: The quantum Zeno effect is a distinctive phenomenon in quantum mechanics, describing the nontrivial effect of frequent projective measurements on hindering the evolution of a quantum system. However, when subjecting to environmental noises, the quantum system may dissipate and the quantum Zeno effect no longer works. This research studies the physical mechanism for the decay of the quantum Zeno ef… ▽ More The quantum Zeno effect is a distinctive phenomenon in quantum mechanics, describing the nontrivial effect of frequent projective measurements on hindering the evolution of a quantum system. However, when subjecting to environmental noises, the quantum system may dissipate and the quantum Zeno effect no longer works. This research studies the physical mechanism for the decay of the quantum Zeno effect in the presence of noises, and investigates the effect of coherent quantum controls on mitigating the decrease of the survival probability that the system stays in the initial state induced by the noises. We derive the decay rate of the survival probability with and without coherent quantum controls in general, and show that when the frequency of the projective measurements is large but finite, proper coherent controls by sufficiently strong Hamiltonians can be designed to decrease the decay rate of the survival probability. A two-level quantum system suffering from typical unitary and non-unitary noises is then considered to demonstrate the effect of the proposed coherent quantum control scheme in protecting the quantum Zeno effect against the noises. The decay rate of the survival probability is obtained in the presence of the noises, and the control Hamiltonian is further optimized analytically to minimize the decay rate by a variational approach. The evolution paths of the quantum system with the optimal coherent controls is illustrated numerically for different scenarios to explicitly show how the coherent control scheme works in lowering the decay of survival probability. △ Less

Submitted 22 February, 2024; v1 submitted 20 February, 2024; originally announced February 2024.

Comments: 22 pages, 11 figures

A mode-multiplexed photonic integrated vector dot-product core from inverse design

Authors: Zheyuan Zhu, Raktim Sarma, Seth Smith-Dryden, Guifang Li, Shuo Pang

Abstract: Photonic computing has the potential of harnessing the full degrees of freedom (DOFs) of the light field, including wavelength, spatial mode, spatial location, phase quadrature, and polarization, to achieve higher level of computation parallelization and scalability than digital electronic processors. While multiplexing using wavelength and other DOFs can be readily integrated on silicon photonics… ▽ More Photonic computing has the potential of harnessing the full degrees of freedom (DOFs) of the light field, including wavelength, spatial mode, spatial location, phase quadrature, and polarization, to achieve higher level of computation parallelization and scalability than digital electronic processors. While multiplexing using wavelength and other DOFs can be readily integrated on silicon photonics platforms with compact footprints, conventional mode-division multiplexed (MDM) photonic designs occupy areas exceeding tens to hundreds of microns for a few spatial modes, significantly limiting their scalability. Here we utilize inverse design to demonstrate an ultracompact photonic computing core that calculates vector dot-products based on MDM coherent mixing within a nominal footprint of 5 um x 3 um. Our dot-product core integrates the functionalities of 2 mode multiplexers and 1 multi-mode coherent mixers, all within the footprint, and could be applied to various computation and computer vision tasks, with high computing throughput density. We experimentally demonstrate computing examples on the fabricated core, including complex number multiplication and motion estimation using optical flow. △ Less

Submitted 9 February, 2024; v1 submitted 18 January, 2024; originally announced January 2024.

Comments: 13 pages, 8 figures. Initial submission to Optica

UniMOS: A Universal Framework For Multi-Organ Segmentation Over Label-Constrained Datasets

Authors: Can Li, Sheng Shao, Junyi Qu, Shuchao Pang, Mehmet A. Orgun

Abstract: Machine learning models for medical images can help physicians diagnose and manage diseases. However, due to the fact that medical image annotation requires a great deal of manpower and expertise, as well as the fact that clinical departments perform image annotation based on task orientation, there is the problem of having fewer medical image annotation data with more unlabeled data and having ma… ▽ More Machine learning models for medical images can help physicians diagnose and manage diseases. However, due to the fact that medical image annotation requires a great deal of manpower and expertise, as well as the fact that clinical departments perform image annotation based on task orientation, there is the problem of having fewer medical image annotation data with more unlabeled data and having many datasets that annotate only a single organ. In this paper, we present UniMOS, the first universal framework for achieving the utilization of fully and partially labeled images as well as unlabeled images. Specifically, we construct a Multi-Organ Segmentation (MOS) module over fully/partially labeled data as the basenet and designed a new target adaptive loss. Furthermore, we incorporate a semi-supervised training module that combines consistent regularization and pseudolabeling techniques on unlabeled data, which significantly improves the segmentation of unlabeled data. Experiments show that the framework exhibits excellent performance in several medical image segmentation tasks compared to other advanced methods, and also significantly improves data utilization and reduces annotation cost. Code and models are available at: https://github.com/lw8807001/UniMOS. △ Less

Submitted 19 November, 2023; v1 submitted 16 November, 2023; originally announced November 2023.

Comments: Accepted by BIBM2023

Fiber optic computing using distributed feedback

Authors: Brandon Redding, Joseph B. Murray, Joseph D. Hart, Zheyuan Zhu, Shuo S. Pang, Raktim Sarma

Abstract: The widespread adoption of machine learning and other matrix intensive computing algorithms has inspired renewed interest in analog optical computing, which has the potential to perform large-scale matrix multiplications with superior energy scaling and lower latency than digital electronics. However, most existing optical techniques rely on spatial multiplexing to encode and process data in paral… ▽ More The widespread adoption of machine learning and other matrix intensive computing algorithms has inspired renewed interest in analog optical computing, which has the potential to perform large-scale matrix multiplications with superior energy scaling and lower latency than digital electronics. However, most existing optical techniques rely on spatial multiplexing to encode and process data in parallel, requiring a large number of high-speed modulators and detectors. More importantly, most of these architectures are restricted to performing a single kernel convolution operation per layer. Here, we introduce a fiber-optic computing architecture based on temporal multiplexing and distributed feedback that performs multiple convolutions on the input data in a single layer (i.e. grouped convolutions). Our approach relies on temporally encoding the input data as an optical pulse train and injecting it into an optical fiber where partial reflectors create a series of delayed copies of the input vector. In this work, we used Rayleigh backscattering in standard single mode fiber as the partial reflectors to encode a series of random kernel transforms. We show that this technique effectively performs a random non-linear projection of the input data into a higher dimensional space which can facilitate a variety of computing tasks, including non-linear principal component analysis, support vector machines, or extreme learning machines. By using a passive fiber to perform the kernel transforms, this approach enables efficient energy scaling with orders of magnitude lower power consumption than GPUs, while using a high-speed modulator and detector maintains low latency and high data-throughput. Finally, our approach is readily integrated with fiber-optic communication links, enabling additional applications such as processing remote sensing data transmitted in the analog domain. △ Less

Submitted 28 August, 2023; originally announced August 2023.

Near MDS and near quantum MDS codes via orthogonal arrays

Authors: Shanqi Pang, Chaomeng Zhang, Mengqian Chen, Miaomiao Zhang

Abstract: Near MDS (NMDS) codes are closely related to interesting objects in finite geometry and have nice applications in combinatorics and cryptography. But there are many unsolved problems about construction of NMDS codes. In this paper, by using symmetrical orthogonal arrays (OAs), we construct a lot of NMDS, $m$-MDS and almost extremal NMDS codes. We establish a relation between asymmetrical OAs and q… ▽ More Near MDS (NMDS) codes are closely related to interesting objects in finite geometry and have nice applications in combinatorics and cryptography. But there are many unsolved problems about construction of NMDS codes. In this paper, by using symmetrical orthogonal arrays (OAs), we construct a lot of NMDS, $m$-MDS and almost extremal NMDS codes. We establish a relation between asymmetrical OAs and quantum error correcting codes (QECCs) over mixed alphabets. Since quantum maximum distance separable (QMDS) codes over mixed alphabets with the dimension equal to one have not been found in all the literature so far, the definition of a near quantum maximum distance separable (NQMDS) code over mixed alphabets is proposed. By using asymmetrical OAs, we obtain many such codes. △ Less

Submitted 1 August, 2023; originally announced August 2023.

Comments: 13 pages, 0 figures

Journal ref: Quantum Sci. Technol. 9 (2024) 025018

Integrated Photonic Encoder for Terapixel Image Processing

Authors: Xiao Wang, Brandon Redding, Nicholas Karl, Christopher Long, Zheyuan Zhu, Shuo Pang, David Brady, Raktim Sarma

Abstract: Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compressio… ▽ More Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process Terapixel/s data streams using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems. △ Less

Submitted 7 June, 2023; originally announced June 2023.

TransCAR: Transformer-based Camera-And-Radar Fusion for 3D Object Detection

Authors: Su Pang, Daniel Morris, Hayder Radha

Abstract: Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar fusion solution for 3D object detection. Our TransCAR consists of two modules. The first module learns 2D features from surround-view camera images and then uses a sparse set of 3D… ▽ More Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar fusion solution for 3D object detection. Our TransCAR consists of two modules. The first module learns 2D features from surround-view camera images and then uses a sparse set of 3D object queries to index into these 2D features. The vision-updated queries then interact with each other via transformer self-attention layer. The second module learns radar features from multiple radar scans and then applies transformer decoder to learn the interactions between radar features and vision-updated queries. The cross-attention layer within the transformer decoder can adaptively learn the soft-association between the radar features and vision-updated queries instead of hard-association based on sensor calibration only. Finally, our model estimates a bounding box per query using set-to-set Hungarian loss, which enables the method to avoid non-maximum suppression. TransCAR improves the velocity estimation using the radar scans without temporal information. The superior experimental results of our TransCAR on the challenging nuScenes datasets illustrate that our TransCAR outperforms state-of-the-art Camera-Radar fusion-based 3D object detection approaches. △ Less

Submitted 30 April, 2023; originally announced May 2023.

Data and Knowledge Co-driving for Cancer Subtype Classification on Multi-Scale Histopathological Slides

Authors: Bo Yu, Hechang Chen, Yunke Zhang, Lele Cong, Shuchao Pang, Hongren Zhou, Ziye Wang, Xianling Cong

Abstract: Artificial intelligence-enabled histopathological data analysis has become a valuable assistant to the pathologist. However, existing models lack representation and inference abilities compared with those of pathologists, especially in cancer subtype diagnosis, which is unconvincing in clinical practice. For instance, pathologists typically observe the lesions of a slide from global to local, and… ▽ More Artificial intelligence-enabled histopathological data analysis has become a valuable assistant to the pathologist. However, existing models lack representation and inference abilities compared with those of pathologists, especially in cancer subtype diagnosis, which is unconvincing in clinical practice. For instance, pathologists typically observe the lesions of a slide from global to local, and then can give a diagnosis based on their knowledge and experience. In this paper, we propose a Data and Knowledge Co-driving (D&K) model to replicate the process of cancer subtype classification on a histopathological slide like a pathologist. Specifically, in the data-driven module, the bagging mechanism in ensemble learning is leveraged to integrate the histological features from various bags extracted by the embedding representation unit. Furthermore, a knowledge-driven module is established based on the Gestalt principle in psychology to build the three-dimensional (3D) expert knowledge space and map histological features into this space for metric. Then, the diagnosis can be made according to the Euclidean distance between them. Extensive experimental results on both public and in-house datasets demonstrate that the D&K model has a high performance and credible results compared with the state-of-the-art methods for diagnosing histopathological subtypes. Code: https://github.com/Dennis-YB/Data-and-Knowledge-Co-driving-for-Cancer-Subtypes-Classification △ Less

Submitted 18 April, 2023; originally announced April 2023.

Journal ref: [J]. Knowledge-Based Systems, 2023, 260: 110168

A physical neural network training approach toward multi-plane light conversion design

Authors: Zheyuan Zhu, Joe H. Doerr, Guifang Li, Shuo Pang

Abstract: Multi-plane light converter (MPLC) designs supporting hundreds of modes are attractive in high-throughput optical communications. These photonic structures typically comprise >10 phase masks in free space, with millions of independent design parameters. Conventional MPLC design using wavefront matching updates one mask at a time while fixing the rest. Here we construct a physical neural network (P… ▽ More Multi-plane light converter (MPLC) designs supporting hundreds of modes are attractive in high-throughput optical communications. These photonic structures typically comprise >10 phase masks in free space, with millions of independent design parameters. Conventional MPLC design using wavefront matching updates one mask at a time while fixing the rest. Here we construct a physical neural network (PNN) to model the light propagation and phase modulation in MPLC, providing access to the entire parameter set for optimization, including not only profiles of the phase masks and the distances between them. PNN training supports flexible optimization sequences and is a superset of existing MPLC design methods. In addition, our method allows tuning of hyperparameters of PNN training such as learning rate and batch size. Because PNN-based MPLC is found to be insensitive to the number of input and target modes in each training step, we have demonstrated a high-order MPLC design (45 modes) using mini batches that fit into the available computing resources. △ Less

Submitted 5 April, 2023; originally announced April 2023.

Comments: Draft for submission to Optics Express

Optimization of probabilistic quantum search algorithm with a priori information

Authors: Yutong Huang, Shengshi Pang

Abstract: A quantum computer encodes information in quantum states and runs quantum algorithms to surpass the classical counterparts by exploiting quantum superposition and quantum correlation. Grover's quantum search algorithm is a typical quantum algorithm that proves the superiority of quantum computing over classical computing. It has a quadratic reduction in the query complexity of database search, and… ▽ More A quantum computer encodes information in quantum states and runs quantum algorithms to surpass the classical counterparts by exploiting quantum superposition and quantum correlation. Grover's quantum search algorithm is a typical quantum algorithm that proves the superiority of quantum computing over classical computing. It has a quadratic reduction in the query complexity of database search, and is known to be optimal when no a priori information about the elements of the database is provided. In this work, we consider a probabilistic Grover search algorithm allowing nonzero probability of failure for a database with a general a priori probability distribution of the elements, and minimize the number of oracle calls by optimizing the initial state of the quantum system and the reflection axis of the diffusion operator. The initial state and the reflection axis are allowed to not coincide, and thus the quantum search algorithm rotates the quantum system in a three-dimensional subspace spanned by the initial state, the reflection axis and the search target state in general. The number of oracle calls is minimized by a variational method, and formal results are obtained with the assumption of low failure probability. The results show that for a nonuniform a priori distribution of the database elements, the number of oracle calls can be significantly reduced given a small decrease in the success probability of the quantum search algorithm, leading to a lower average query complexity to find the solution of the search problem. The results are applied to a simple but nontrivial database model with two-value a priori probabilities to show the power of the optimized quantum search algorithm. The paper concludes with a discussion about the generalization to higher-order results that allows for a larger failure probability for the quantum search algorithm. △ Less

Submitted 21 August, 2023; v1 submitted 6 April, 2023; originally announced April 2023.

Comments: v2: Main text expanded to include analysis of the first-order optimization result. Close to the published version

Journal ref: Physical Review A 108, 022417 (2023)

Why is the winner the best?

Authors: Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Sharib Ali, Vincent Andrearczyk, Marc Aubreville, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano, Jorge Bernal, Sebastian Bodenstedt, Alessandro Casella, Veronika Cheplygina, Marie Daum, Marleen de Bruijne, Adrien Depeursinge, Reuben Dorent, Jan Egger, David G. Ellis, Sandy Engelhardt, Melanie Ganz , et al. (100 additional authors not shown)

Abstract: International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To addre… ▽ More International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a solution superior to a competing method? To address this gap in the literature, we performed a multi-center study with all 80 competitions that were conducted in the scope of IEEE ISBI 2021 and MICCAI 2021. Statistical analyses performed based on comprehensive descriptions of the submitted algorithms linked to their rank as well as the underlying participation strategies revealed common characteristics of winning solutions. These typically include the use of multi-task learning (63%) and/or multi-stage pipelines (61%), and a focus on augmentation (100%), image preprocessing (97%), data curation (79%), and postprocessing (66%). The "typical" lead of a winning team is a computer scientist with a doctoral degree, five years of experience in biomedical image analysis, and four years of experience in deep learning. Two core general development strategies stood out for highly-ranked teams: the reflection of the metrics in the method design and the focus on analyzing and handling failure cases. According to the organizers, 43% of the winning algorithms exceeded the state of the art but only 11% completely solved the respective domain problem. The insights of our study could help researchers (1) improve algorithm development strategies when approaching new problems, and (2) focus on open research questions revealed by this work. △ Less

Submitted 30 March, 2023; originally announced March 2023.

Comments: accepted to CVPR 2023

Additive manufacturing and performance of bioceramic scaffolds with different hollow strut geometries

Authors: Shumin Pang, Dongwei Wu, Aleksander Gurlo, Jens Kurreck, Dorian A H Hanaor

Abstract: Additively manufactured hollow strut bioceramic scaffolds present a promising strategy towards enhanced performance in patient-tailored bone tissue engineering. The channels in such scaffolds offer pathways for nutrient and cell transport and facilitate effective osseointegration and vascularization. In this study, we report an approach for the slurry based additive manufacturing of modified diops… ▽ More Additively manufactured hollow strut bioceramic scaffolds present a promising strategy towards enhanced performance in patient-tailored bone tissue engineering. The channels in such scaffolds offer pathways for nutrient and cell transport and facilitate effective osseointegration and vascularization. In this study, we report an approach for the slurry based additive manufacturing of modified diopside bioceramics that enables the production of hollow-strut scaffolds with diverse cross-sectional forms, distinguished by different configurations of channel and strut geometries. The prepared scaffolds exhibit levels of porosity and mechanical strength that are well suited for osteoporotic bone repair. Mechanical characterization in orthogonal orientations revealed that a square outer cross-section for hollow struts in woodpile scaffolds gives rise to levels of compressive strength that are higher than those of conventional solid cylindrical strut scaffolds despite a significantly lower density. Finite element analysis confirms that this improved strength arises from lower stress concentration in such geometries. It was shown that hollow struts in bioceramic scaffolds dramatically increase cell attachment and proliferation, potentially promoting new bone tissue formation within the scaffold channel. This work provides an easily controlled method for the extrusion-based 3D printing of hollow strut scaffolds. We show here how the production of hollow struts with controllable geometry can serve to enhance both the functional and mechanical performance of porous structures, with particular relevance for bone tissue engineering scaffolds. △ Less

Submitted 20 March, 2023; originally announced March 2023.

Journal ref: Biofabrication, 2023, 15, 025011

Enhanced mechanical performance and bioactivity in strontium/copper co-substituted diopside scaffolds

Authors: Shumin Pang, Dongwei Wu, Haotian Yang, Franz Kamutzki, Jens Kurreck, Aleksander Gurlo, Dorian A. H. Hanaor

Abstract: Effective scaffolds for bone tissue-engineering are those that combine adequate mechanical and chemical performance with osseointegrative, angiogenetic and anti-bacterial modes of bioactivity. To address these requirements via a combined approach, we additively manufactured square strut scaffolds by robocasting precipitation-derived strontium/copper co-substituted diopside. Microstructure, mechani… ▽ More Effective scaffolds for bone tissue-engineering are those that combine adequate mechanical and chemical performance with osseointegrative, angiogenetic and anti-bacterial modes of bioactivity. To address these requirements via a combined approach, we additively manufactured square strut scaffolds by robocasting precipitation-derived strontium/copper co-substituted diopside. Microstructure, mechanical performance, bioactivity, biocompatibility, and antibacterial activity were examined. The results show that the presence of strontium and copper in the diopside lattice reduces the grain size and increases the density of the ceramics. The compressive strength, hardness, and fracture toughness of the diopside showed improvement, attributed to a finer microstructure and improved sintering. Scaffolds had excellent compressive strength with a high porosity (68 to 72 %), which is attributed to the structure of the stacked square struts. All materials showed good in vitro bioactivity and favorable proliferation of osteogenic sarcoma cells, while strontium and copper co-doped materials exhibited the strongest anti-Escherichia coli activity. We show that across multiple indicators this system offers pathways towards high-performance bone substitutes. △ Less

Submitted 20 March, 2023; originally announced March 2023.

Journal ref: Biomaterials Advances, 2023,Volume 145, 213230

Biomedical image analysis competitions: The state of current participation practice

Authors: Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Patrick Godau, Veronika Cheplygina, Michal Kozubek, Sharib Ali, Anubha Gupta, Jan Kybic, Alison Noble, Carlos Ortiz de Solórzano, Samiksha Pachade, Caroline Petitjean, Daniel Sage, Donglai Wei, Elizabeth Wilden, Deepak Alapatt, Vincent Andrearczyk, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano , et al. (331 additional authors not shown)

Abstract: The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis,… ▽ More The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps. △ Less

Submitted 12 September, 2023; v1 submitted 16 December, 2022; originally announced December 2022.

Multi-particle quantum walks in one-dimensional lattice

Authors: Daer Feng, Shengshi Pang

Abstract: Quantum walk is a counterpart of classical random walk in the quantum regime that exhibits non-classical behaviors and outperforms classical random walk in various aspects. It has been known that the spatial probability distribution of a single-particle quantum walk can expand quadratically in time while a single-particle classical random walk can do only linearly. In this paper, we analytically s… ▽ More Quantum walk is a counterpart of classical random walk in the quantum regime that exhibits non-classical behaviors and outperforms classical random walk in various aspects. It has been known that the spatial probability distribution of a single-particle quantum walk can expand quadratically in time while a single-particle classical random walk can do only linearly. In this paper, we analytically study the discrete-time quantum walk of non-interacting multiple particles in a one-dimensional infinite lattice, and investigate the role of entanglement and exchange symmetry in the position distribution of the particles during the quantum walk. To analyze the position distribution of multi-particle quantum walk, we consider the relative distance between particles, and study how it changes with the number of walk steps. We compute the relative distance asymptotically for a large number of walk steps and find that the distance increases quadratically with the number of walk steps. We also study the extremal relative distances between the particles, and show the role of the exchange symmetry of the initial state in the distribution of the particles. Our study further shows the dependence of two-particle correlations, two-particle position distributions on the exchange symmetry, and find exponential decrement of the entanglement of the extremal state with the number of particles. △ Less

Submitted 11 December, 2022; originally announced December 2022.

Comparison Between Mean-Variance and Monotone Mean-Variance Preferences Under Jump Diffusion and Stochastic Factor Model

Authors: Yuchen Li, Zongxia Liang, Shunzhi Pang

Abstract: This paper compares the optimal investment problems based on monotone mean-variance (MMV) and mean-variance (MV) preferences in the Lévy market with an untradable stochastic factor. It is an open question proposed by Trybuła and Zawisza. Using the dynamic programming and Lagrange multiplier methods, we get the HJBI and HJB equations corresponding to the two investment problems. The equations are t… ▽ More This paper compares the optimal investment problems based on monotone mean-variance (MMV) and mean-variance (MV) preferences in the Lévy market with an untradable stochastic factor. It is an open question proposed by Trybuła and Zawisza. Using the dynamic programming and Lagrange multiplier methods, we get the HJBI and HJB equations corresponding to the two investment problems. The equations are transformed into a new-type parabolic equation, from which the optimal strategies under both preferences are derived. We prove that the two optimal strategies and value functions coincide if and only if an important market assumption holds. When the assumption violates, MMV investors act differently from MV investors. Thus, we conclude that the difference between continuous-time MMV and MV portfolio selections is due to the discontinuity of the market. In addition, we derive the efficient frontier and analyze the economic impact of the jump diffusion risky asset. We also provide empirical evidences to demonstrate the validity of the assumption in real financial market. △ Less

Submitted 6 November, 2023; v1 submitted 25 November, 2022; originally announced November 2022.

Continuous-Time Monotone Mean-Variance Portfolio Selection in Jump-Diffusion Model

Authors: Yuchen Li, Zongxia Liang, Shunzhi Pang

Abstract: We study continuous-time portfolio selection under monotone mean-variance (MMV) preferences in a jump-diffusion model, presenting an explicit solution different from that under classical mean-variance (MV) preferences in dynamic settings for the first time. We prove that the potential measures calculating MMV preferences can be restricted to non-negative Doléans-Dade exponentials. We find that MMV… ▽ More We study continuous-time portfolio selection under monotone mean-variance (MMV) preferences in a jump-diffusion model, presenting an explicit solution different from that under classical mean-variance (MV) preferences in dynamic settings for the first time. We prove that the potential measures calculating MMV preferences can be restricted to non-negative Doléans-Dade exponentials. We find that MMV can resolve the non-monotonicity and free cash flow stream problems of MV when the jump size can be larger than the inverse of the market price of risk. Such result is completely comparable to the earliest result by Dybvig and Ingersoll. Economically, we show that the essence of MMV lies in the pricing operator always remaining non-negative, with a value of zero assigned when the jump exceeds a certain threshold, avoiding the issue of non-monotonicity. As a result, MMV investors behave markedly different from MV investors. Furthermore, we validate the two-fund separation and establish the monotone capital asset pricing model (monotone CAPM) for MMV investors. We also study MMV in a constrained trading model and provide three specific numerical examples to show MMV's efficiency. Our finding can serve as a crucial theoretical foundation for future empirical tests of MMV and monotone CAPM's effectiveness. △ Less

Submitted 10 May, 2024; v1 submitted 22 November, 2022; originally announced November 2022.

Fault diagnosis for open-circuit faults in NPC inverter based on knowledge-driven and data-driven approaches

Authors: Lei Kou, Chuang Liu, Guo-wei Cai, Jia-ning Zhou, Quan-de Yuan, Si-miao Pang

Abstract: In this study, the open-circuit faults diagnosis and location issue of the neutral-point-clamped (NPC) inverters are analysed. A novel fault diagnosis approach based on knowledge driven and data driven was presented for the open-circuit faults in insulated-gate bipolar transistors (IGBTs) of NPC inverter, and Concordia transform (knowledge driven) and random forests (RFs) technique (data driven) a… ▽ More In this study, the open-circuit faults diagnosis and location issue of the neutral-point-clamped (NPC) inverters are analysed. A novel fault diagnosis approach based on knowledge driven and data driven was presented for the open-circuit faults in insulated-gate bipolar transistors (IGBTs) of NPC inverter, and Concordia transform (knowledge driven) and random forests (RFs) technique (data driven) are employed to improve the robustness performance of the fault diagnosis classifier. First, the fault feature data of AC in either normal state or open-circuit faults states of NPC inverter are analysed and extracted. Second, the Concordia transform is used to process the fault samples, and it has been verified that the slopes of current trajectories are not affected by different loads in this study, which can help the proposed method to reduce overdependence on fault data. Moreover, then the transformed fault samples are adopted to train the RFs fault diagnosis classifier, and the fault diagnosis results show that the classification accuracy and robustness performance of the fault diagnosis classifier are improved. Finally, the diagnosis results of online fault diagnosis experiments show that the proposed classifier can locate the open-circuit fault of IGBTs in NPC inverter under the conditions of different loads. △ Less

Submitted 31 October, 2022; originally announced October 2022.

Comments: IET Power Electronics

MSC Class: 68T05 ACM Class: I.2

Sparse Semantic Map-Based Monocular Localization in Traffic Scenes Using Learned 2D-3D Point-Line Correspondences

Authors: Xingyu Chen, Jianru Xue, Shanmin Pang

Abstract: Vision-based localization in a prior map is of crucial importance for autonomous vehicles. Given a query image, the goal is to estimate the camera pose corresponding to the prior map, and the key is the registration problem of camera images within the map. While autonomous vehicles drive on the road under occlusion (e.g., car, bus, truck) and changing environment appearance (e.g., illumination cha… ▽ More Vision-based localization in a prior map is of crucial importance for autonomous vehicles. Given a query image, the goal is to estimate the camera pose corresponding to the prior map, and the key is the registration problem of camera images within the map. While autonomous vehicles drive on the road under occlusion (e.g., car, bus, truck) and changing environment appearance (e.g., illumination changes, seasonal variation), existing approaches rely heavily on dense point descriptors at the feature level to solve the registration problem, entangling features with appearance and occlusion. As a result, they often fail to estimate the correct poses. To address these issues, we propose a sparse semantic map-based monocular localization method, which solves 2D-3D registration via a well-designed deep neural network. Given a sparse semantic map that consists of simplified elements (e.g., pole lines, traffic sign midpoints) with multiple semantic labels, the camera pose is then estimated by learning the corresponding features between the 2D semantic elements from the image and the 3D elements from the sparse semantic map. The proposed sparse semantic map-based localization approach is robust against occlusion and long-term appearance changes in the environments. Extensive experimental results show that the proposed method outperforms the state-of-the-art approaches. △ Less

Submitted 10 October, 2022; originally announced October 2022.

Journal ref: IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 11894-11901, Oct. 2022

Collapse and revival structure of information backflow for a central spin coupled to a finite spin bath

Authors: Jingyi Fan, Shengshi Pang

Abstract: The Markovianity of quantum dynamics is an important property of open quantum systems determined by various ingredients of the system and bath. Apart from the system-bath interaction, the initial state of the bath, etc., the dimension of the bath plays a critical role in determining the Markovianity of quantum dynamics, as a strict decay of the bath correlations requires an infinite dimension for… ▽ More The Markovianity of quantum dynamics is an important property of open quantum systems determined by various ingredients of the system and bath. Apart from the system-bath interaction, the initial state of the bath, etc., the dimension of the bath plays a critical role in determining the Markovianity of quantum dynamics, as a strict decay of the bath correlations requires an infinite dimension for the bath. In this work, we investigate the role of finite bath dimension in the Markovianity of quantum dynamics by considering a simple but nontrivial model in which a central spin is isotropically coupled to a finite number of bath spins, and show how the dynamics of the central spin transits from non-Markovian to Markovian as the number of the bath spins increases. The non-Markovianity is characterized by the information backflow from the bath to the system in terms of the trace distance of the system states. We derive the time evolution of the trace distance analytically, and find periodic collapse-revival patterns in the information flow. The mechanism underlying this phenomenon is investigated in detail, and it shows that the period of the collapse-revival pattern is determined by the competition between the number of the bath spins, the system-bath coupling strength, and the frequency detuning. When the number of bath spins is sufficiently large, the period of the collapse-revival structure as well as the respective collapse and revival times increase in proportion to the number of the bath spins, which characterizes how the information backflow decays with a large dimension of the bath. We also analyze the effect of the system-bath interaction strength and frequency detuning on the collapse-revival patterns of the information flow, and obtain the condition for the existence of the collapse-revival structure. The results are illustrated by numerical computation. △ Less

Submitted 2 March, 2023; v1 submitted 14 September, 2022; originally announced September 2022.

Comments: 21 pages, 10 figures. Typos corrected, close to the published version

Journal ref: Phys. Rev. A 107, 022209 (2023)

Data-driven Parametric Insurance Framework Using Bayesian Neural Networks

Authors: Subeen Pang, Chanyeol Choi

Abstract: As climate change poses new and more unpredictable challenges to society, insurance is an essential avenue to protect against loss caused by extreme events. Traditional insurance risk models employ statistical analyses that are inaccurate and are becoming increasingly flawed as climate change renders weather more erratic and extreme. Data-driven parametric insurance could provide necessary protect… ▽ More As climate change poses new and more unpredictable challenges to society, insurance is an essential avenue to protect against loss caused by extreme events. Traditional insurance risk models employ statistical analyses that are inaccurate and are becoming increasingly flawed as climate change renders weather more erratic and extreme. Data-driven parametric insurance could provide necessary protection to supplement traditional insurance. We use a technique referred to as the deep sigma point process, which is one of the Bayesian neural network approaches, for the data analysis portion of parametric insurance using residential internet connectivity dropout in US as a case study. We show that our model has significantly improved accuracy compared to traditional statistical models. We further demonstrate that each state in US has a unique weather factor that primarily influences dropout rates and that by combining multiple weather factors we can build highly accurate risk models for parametric insurance. We expect that our method can be applied to many types of risk to build parametric insurance options, particularly as climate change makes risk modeling more challenging. △ Less

Submitted 22 September, 2022; v1 submitted 12 September, 2022; originally announced September 2022.

Linear shrinkage receiver for slow fading channels under imperfect channel state information

Authors: Wenyi Shi, Shuqin Pang, Wenyi Zhang

Abstract: This paper studies receiver design in single-input multiple-output (SIMO) slow fading channels with imperfect channel state information (CSI) at the receiver only. Using generalized mutual information (GMI) as achievable rate, we study the outage behavior when the receiver employs certain generalized form of the nearest neighbor decoding rule. Our study reveals that linearly shrinking the linear m… ▽ More This paper studies receiver design in single-input multiple-output (SIMO) slow fading channels with imperfect channel state information (CSI) at the receiver only. Using generalized mutual information (GMI) as achievable rate, we study the outage behavior when the receiver employs certain generalized form of the nearest neighbor decoding rule. Our study reveals that linearly shrinking the linear minimum meansquared error (LMMSE) estimate of the CSI reduces the outage probability when the number of receive antennas is finite. Only in the asymptotic regime where the number of receive antennas grows without bound, the LMMSE estimate of the CSI minimizes the outage probability. Numerical results demonstrate that the proposed linear shrinkage receiver achieves evident outage probability reduction. △ Less

Submitted 18 August, 2022; originally announced August 2022.

Comments: 6 pages, 4 figures, IEEE ITW 2022

Beyond CNNs: Exploiting Further Inherent Symmetries in Medical Image Segmentation

Authors: Shuchao Pang, Anan Du, Mehmet A. Orgun, Yan Wang, Quan Z. Sheng, Shoujin Wang, Xiaoshui Huang, Zhenmei Yu

Abstract: Automatic tumor or lesion segmentation is a crucial step in medical image analysis for computer-aided diagnosis. Although the existing methods based on Convolutional Neural Networks (CNNs) have achieved the state-of-the-art performance, many challenges still remain in medical tumor segmentation. This is because, although the human visual system can detect symmetries in 2D images effectively, regul… ▽ More Automatic tumor or lesion segmentation is a crucial step in medical image analysis for computer-aided diagnosis. Although the existing methods based on Convolutional Neural Networks (CNNs) have achieved the state-of-the-art performance, many challenges still remain in medical tumor segmentation. This is because, although the human visual system can detect symmetries in 2D images effectively, regular CNNs can only exploit translation invariance, overlooking further inherent symmetries existing in medical images such as rotations and reflections. To solve this problem, we propose a novel group equivariant segmentation framework by encoding those inherent symmetries for learning more precise representations. First, kernel-based equivariant operations are devised on each orientation, which allows it to effectively address the gaps of learning symmetries in existing approaches. Then, to keep segmentation networks globally equivariant, we design distinctive group layers with layer-wise symmetry constraints. Finally, based on our novel framework, extensive experiments conducted on real-world clinical data demonstrate that a Group Equivariant Res-UNet (named GER-UNet) outperforms its regular CNN-based counterpart and the state-of-the-art segmentation methods in the tasks of hepatic tumor segmentation, COVID-19 lung infection segmentation and retinal vessel detection. More importantly, the newly built GER-UNet also shows potential in reducing the sample complexity and the redundancy of filters, upgrading current segmentation CNNs and delineating organs on other medical imaging modalities. △ Less

Submitted 29 July, 2022; originally announced July 2022.

Comments: this work was just accepted by IEEE Transactions on Cybernetics on 22 July 2022. arXiv admin note: substantial text overlap with arXiv:2005.03924

Deep learning-based identification of sub-nuclear structures in FIB-SEM images

Authors: Niraj Gupta, Eric J. Roberts, Song Pang, C. Shan Xu, Harald F. Hess, Fan Wu, Abby Dernburg, Danielle Jorgens, Petrus H. Zwart, Vignesh Kasinath

Abstract: Three-dimensional volumetric imaging of cells allows for in situ visualization, thus preserving contextual insights into cellular processes. Despite recent advances in machine learning methods, morphological analysis of sub-nuclear structures have proven challenging due to both the shallow contrast profile and the technical limitation in feature detection. Here, we present a convolutional neural n… ▽ More Three-dimensional volumetric imaging of cells allows for in situ visualization, thus preserving contextual insights into cellular processes. Despite recent advances in machine learning methods, morphological analysis of sub-nuclear structures have proven challenging due to both the shallow contrast profile and the technical limitation in feature detection. Here, we present a convolutional neural network, supervised deep learning-based approach which can identify sub-nuclear structures with 90% accuracy. We develop and apply this model to C. elegans gonads imaged using focused ion beam milling combined with scanning electron microscopy resulting in the accurate identification and segmentation of all sub-nuclear structures including entire chromosomes. We discuss in depth the architecture, parameterization, and optimization of the deep learning model, as well as provide evaluation metrics to assess the quality of the network prediction. Lastly, we highlight specific aspects of the model that can be optimized for its broad application to other volumetric imaging data as well as in situ cryo-electron tomography. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Comments: 15 pages, 10 figures, for eventual peer-reviewed journal publication

A statistical reconstruction algorithm for positronium lifetime imaging using time-of-flight positron emission tomography

Authors: Hsin-Hsiung Huang, Zheyuan Zhu, Slun Booppasiri, Zhuo Chen, Shuo Pang, Chien-Min Kao

Abstract: Positron emission tomography (PET) is an important modality for diagnosing diseases such as cancer and Alzheimer's disease, capable of revealing the uptake of radiolabeled molecules that target specific pathological markers of the diseases. Recently, positronium lifetime imaging (PLI) that adds to traditional PET the ability to explore properties of the tissue microenvironment beyond tracer uptake… ▽ More Positron emission tomography (PET) is an important modality for diagnosing diseases such as cancer and Alzheimer's disease, capable of revealing the uptake of radiolabeled molecules that target specific pathological markers of the diseases. Recently, positronium lifetime imaging (PLI) that adds to traditional PET the ability to explore properties of the tissue microenvironment beyond tracer uptake has been demonstrated with time-of-flight (TOF) PET and the use of non-pure positron emitters. However, achieving accurate reconstruction of lifetime images from data acquired by systems having a finite TOF resolution still presents a challenge. This paper focuses on the two-dimensional PLI, introducing a maximum likelihood estimation (MLE) method that employs an exponentially modified Gaussian (EMG) probability distribution that describes the positronium lifetime data produced by TOF PET. We evaluate the performance of our EMG-based MLE method against \st{traditional} approaches using exponential likelihood functions and penalized surrogate methods. Results from computer-simulated data reveal that the proposed EMG-MLE method can yield quantitatively accurate lifetime images. We also demonstrate that the proposed MLE formulation can be extended to handle PLI data containing multiple positron populations. △ Less

Submitted 9 May, 2024; v1 submitted 13 June, 2022; originally announced June 2022.

Comments: Submitted to IEEE-TPRMS

The $k$-apex trees with minimum augmented Zagreb index

Authors: Muhuo Liu, Shumei Pang, Francesco Belardo, Akbar Ali

Abstract: For a connected graph $G$ on at least three vertices, the augmented Zagreb index (AZI) of $G$ is defined as $$AZI(G)=\sum_{uv\in E(G)}\left(\frac{d(u)d(v)}{d(u)+d(v)-2}\right)^{3},$$ being a topological index well-correlated with the formation heat of heptanes and octanes. A $k$-apex tree $G$ is a connected graph admitting a $k$-subset $X\subset V(G)$ such that $G-X$ is a tree, while $G-S$ is not… ▽ More For a connected graph $G$ on at least three vertices, the augmented Zagreb index (AZI) of $G$ is defined as $$AZI(G)=\sum_{uv\in E(G)}\left(\frac{d(u)d(v)}{d(u)+d(v)-2}\right)^{3},$$ being a topological index well-correlated with the formation heat of heptanes and octanes. A $k$-apex tree $G$ is a connected graph admitting a $k$-subset $X\subset V(G)$ such that $G-X$ is a tree, while $G-S$ is not a tree for any $S\subset V(G)$ of cardinality less than $k$. By investigating some structural properties of $k$-apex trees, we identify the graphs minimizing the AZI among all $k$-apex trees on $n$ vertices for $k\ge 4$ and $n\ge 3(k+1)$. The latter solves an open problem posed in [K. Cheng, M. Liu, F. Belardo, {\em Appl. Math. Comput.}, {\bf402} (2021), 126139]. △ Less

Submitted 30 May, 2022; originally announced May 2022.

High performing additively manufactured bone scaffolds based on copper substituted diopside

Authors: Shumin Pang, Dongwei Wu, Franz Kamutzki, Jens Kurreck, Aleksander Gurlo, Dorian A. H. Hanaor

Abstract: The inclusion of small amounts of copper is often reported to enhance the mechanical and biointegrative performance of bioceramics towards tissue engineering applications. In this work, 3D scaffolds were additively manufactured by robocasting of precipitation derived copper doped diopside. Compositions were chosen in which magnesium sites in diopside were substituted by copper up to 3 at.%. Micros… ▽ More The inclusion of small amounts of copper is often reported to enhance the mechanical and biointegrative performance of bioceramics towards tissue engineering applications. In this work, 3D scaffolds were additively manufactured by robocasting of precipitation derived copper doped diopside. Compositions were chosen in which magnesium sites in diopside were substituted by copper up to 3 at.%. Microstructure, mechanical performance, bioactivity, biodegradability, drug release, biocompatibility, in vitro angiogenesis and antibacterial activity were studied. Results indicate that copper is incorporated in the diopside structure and improves materials fracture toughness. Scaffolds with more than 80% porosity exhibited compressive strengths exceeding that of cancellous bone. All compositions showed bioactivity and drug release functionalities. However, only samples with 0 to 1 at.% copper substitution showed favorable proliferation of osteogenic sarcoma cells, human umbilical vein endothelial cells and fibroblasts, while larger amounts of copper had cytotoxic behavior. In vitro angiogenesis was significantly enhanced by low levels of copper. Copper containing materials showed anti Escherichia coli activity, increasing with copper content. We show that across multiple indicators, copper substituted diopside of the composition CaMg0.99Cu0.01Si2O6, exhibits high performance as a synthetic bone substitute, comparing favorably with known bioceramics. These findings present a pathway for the enhancement of bioactivity and mechanical performance in printable bioceramics. △ Less

Submitted 23 May, 2022; originally announced May 2022.

Journal ref: Materials & Design Materials & Design (2022) Volume 215, 110480

Achieving Heisenberg Scaling on Measurement of A Three-Qubit System via Quantum Error Correction

Authors: Le Hu, Shengshi Pang, Andrew Jordan

Abstract: In many-body quantum systems, the quantum Fisher information an observer can obtain is susceptible to decoherence. Consequently, quantum enhanced metrology, such as Heisenberg scaling, cannot usually be achieved. We show, via two distinct methods, that by applying periodic quantum error corrections, we can achieve the Heisenberg scaling for an extended period of time on a three-qubit Tavis-Cumming… ▽ More In many-body quantum systems, the quantum Fisher information an observer can obtain is susceptible to decoherence. Consequently, quantum enhanced metrology, such as Heisenberg scaling, cannot usually be achieved. We show, via two distinct methods, that by applying periodic quantum error corrections, we can achieve the Heisenberg scaling for an extended period of time on a three-qubit Tavis-Cumming Model, where three two-level atoms interact with a single cavity mode, under certain approximations. The generalization to arbitrary number of atoms case is also discussed. △ Less

Submitted 2 December, 2022; v1 submitted 2 March, 2022; originally announced March 2022.

Comments: 8 pages, 10 figures

Journal ref: Phys. Rev. A 106, 052609 (2022)

Unified treatment of exact and approximate scalar electromagnetic wave scattering

Authors: Subeen Pang, George Barbastathis

Abstract: Under conditions of strong scattering, a dilemma often arises regarding the best numerical method to use. Main competitors are the Born series, the Beam Propagation Method, and direct solution of the Lippmann-Schwinger equation. However, analytical relationships between the three methods have not yet, to our knowledge, been explicitly stated. Here, we bridge this gap in the literature. In addition… ▽ More Under conditions of strong scattering, a dilemma often arises regarding the best numerical method to use. Main competitors are the Born series, the Beam Propagation Method, and direct solution of the Lippmann-Schwinger equation. However, analytical relationships between the three methods have not yet, to our knowledge, been explicitly stated. Here, we bridge this gap in the literature. In addition to overall insight about aspects of optical scattering that are best numerically captured by each method, our approach allows us to derive approximate error bounds to be expected under various scattering conditions. △ Less

Submitted 16 February, 2022; originally announced February 2022.

Variational principle for optimal quantum controls in quantum metrology

Authors: Jing Yang, Shengshi Pang, Zekai Chen, Andrew N. Jordan, Adolfo del Campo

Abstract: We develop a variational principle to determine the quantum controls and initial state which optimizes the quantum Fisher information, the quantity characterizing the precision in quantum metrology. When the set of available controls is limited, the exact optimal initial state and the optimal controls are in general dependent on the probe time, a feature missing in the unrestricted case. Yet, for… ▽ More We develop a variational principle to determine the quantum controls and initial state which optimizes the quantum Fisher information, the quantity characterizing the precision in quantum metrology. When the set of available controls is limited, the exact optimal initial state and the optimal controls are in general dependent on the probe time, a feature missing in the unrestricted case. Yet, for time-independent Hamiltonians with restricted controls, the problem can be approximately reduced to the unconstrained case via the Floquet engineering. In particular, we find for magnetometry with a time-independent spin chain containing three-body interactions, even when the controls are restricted to one and two-body interaction, that the Heisenberg scaling can still be approximately achieved. Our results open the door to investigate quantum metrology under a limited set of available controls, of relevance to many-body quantum metrology in realistic scenarios. △ Less

Submitted 26 April, 2022; v1 submitted 7 November, 2021; originally announced November 2021.

Comments: Close to the published version

Journal ref: Phys. Rev. Lett. 128, 160505 (2022)

Kiloton-scale xenon detectors for neutrinoless double beta decay and other new physics searches

Authors: A. Avasthi, T. W. Bowyer, C. Bray, T. Brunner, N. Catarineu, E. Church, R. Guenette, S. J. Haselschwardt, J. C. Hayes, M. Heffner, S. A. Hertel, P. H. Humble, A. Jamil, S. Kim, R. F. Lang, K. G. Leach, B. G. Lenardo, W. H. Lippincott, A. Marino, D. N. McKinsey, E. H. Miller, D. C. Moore, B. Mong, B. Monreal, M. E. Monzani , et al. (9 additional authors not shown)

Abstract: Large detectors employing xenon are a leading technology in existing and planned searches for new physics, including searches for neutrinoless double beta decay ($0νββ$) and dark matter. While upcoming detectors will employ target masses of a ton or more, further extending gas or liquid phase Xe detectors to the kton scale would enable extremely sensitive next-generation searches for rare phenomen… ▽ More Large detectors employing xenon are a leading technology in existing and planned searches for new physics, including searches for neutrinoless double beta decay ($0νββ$) and dark matter. While upcoming detectors will employ target masses of a ton or more, further extending gas or liquid phase Xe detectors to the kton scale would enable extremely sensitive next-generation searches for rare phenomena. The key challenge to extending this technology to detectors well beyond the ton scale is the acquisition of the Xe itself. We describe the motivation for extending Xe time projection chambers (TPCs) to the kton scale and possible avenues for Xe acquisition that avoid existing supply chains. If acquisition of Xe in the required quantities is successful, kton-scale detectors of this type could enable a new generation of experiments, including searches for $0νββ$ at half-life sensitivities as long as $10^{30}$ yr. △ Less

Submitted 21 December, 2021; v1 submitted 4 October, 2021; originally announced October 2021.

Comments: 19 pages, 10 figures; published version

Journal ref: Phys. Rev. D 104, 112007 (2021)

An Efficient Style Virtual Try on Network for Clothing Business Industry

Authors: Shanchen Pang, Xixi Tao, Neal N. Xiong, Yukun Dong

Abstract: With the increasing development of garment manufacturing industry, the method of combining neural network with industry to reduce product redundancy has been paid more and more attention.In order to reduce garment redundancy and achieve personalized customization, more researchers have appeared in the field of virtual trying on.They try to transfer the target clothing to the reference figure, and… ▽ More With the increasing development of garment manufacturing industry, the method of combining neural network with industry to reduce product redundancy has been paid more and more attention.In order to reduce garment redundancy and achieve personalized customization, more researchers have appeared in the field of virtual trying on.They try to transfer the target clothing to the reference figure, and then stylize the clothes to meet user's requirements for fashion.But the biggest problem of virtual try on is that the shape and motion blocking distort the clothes, causing the patterns and texture on the clothes to be impossible to restore. This paper proposed a new stylized virtual try on network, which can not only retain the authenticity of clothing texture and pattern, but also obtain the undifferentiated stylized try on. The network is divided into three sub-networks, the first is the user image, the front of the target clothing image, the semantic segmentation image and the posture heat map to generate a more detailed human parsing map. Second, UV position map and dense correspondence are used to map patterns and textures to the deformed silhouettes in real time, so that they can be retained in real time, and the rationality of spatial structure can be guaranteed on the basis of improving the authenticity of images. Third,Stylize and adjust the generated virtual try on image. Through the most subtle changes, users can choose the texture, color and style of clothing to improve the user's experience. △ Less

Submitted 30 May, 2021; v1 submitted 27 May, 2021; originally announced May 2021.

Comments: 10 pages,9 figures

Generalized Nearest Neighbor Decoding for MIMO Channels with Imperfect Channel State Information

Authors: Shuqin Pang, Wenyi Zhang

Abstract: Information transmission over a multiple-input-multiple-output (MIMO) fading channel with imperfect channel state information (CSI) is investigated, under a new receiver architecture which combines the recently proposed generalized nearest neighbor decoding rule (GNNDR) and a successive procedure in the spirit of successive interference cancellation (SIC). Recognizing that the channel input-output… ▽ More Information transmission over a multiple-input-multiple-output (MIMO) fading channel with imperfect channel state information (CSI) is investigated, under a new receiver architecture which combines the recently proposed generalized nearest neighbor decoding rule (GNNDR) and a successive procedure in the spirit of successive interference cancellation (SIC). Recognizing that the channel input-output relationship is a nonlinear mapping under imperfect CSI, the GNNDR is capable of extracting the information embedded in the joint observation of channel output and imperfect CSI more efficiently than the conventional linear scheme, as revealed by our achievable rate analysis via generalized mutual information (GMI). Numerical results indicate that the proposed scheme achieves performance close to the channel capacity with perfect CSI, and significantly outperforms the conventional pilot-assisted scheme, which first estimates the CSI and then uses the estimated CSI as the true one for coherent decoding. △ Less

Submitted 30 August, 2021; v1 submitted 15 May, 2021; originally announced May 2021.

Comments: 6 pages, 3 figures

Fixed-point iterative linear inverse solver with extended precision

Authors: Zheyuan Zhu, Andrew B. Klein, Guifang Li, Shuo Pang

Abstract: Solving linear systems is a ubiquitous task in science and engineering. Because directly inverting a large-scale linear system can be computationally expensive, iterative algorithms are often used to numerically find the inverse. To accommodate the dynamic range and precision requirements, these iterative algorithms are often carried out on floating-point processing units. Low-precision, fixed-poi… ▽ More Solving linear systems is a ubiquitous task in science and engineering. Because directly inverting a large-scale linear system can be computationally expensive, iterative algorithms are often used to numerically find the inverse. To accommodate the dynamic range and precision requirements, these iterative algorithms are often carried out on floating-point processing units. Low-precision, fixed-point processors require only a fraction of the energy per operation consumed by their floating-point counterparts, yet their current usages exclude iterative solvers due to the computational errors arising from fixed-point arithmetic. In this work, we show that for a simple iterative algorithm, such as Richardson iteration, using a fixed-point processor can provide the same rate of convergence and achieve high-precision solutions beyond its native precision limit when combined with residual iteration. These results indicate that power-efficient computing platform consisting of analog computing devices can be used to solve a broad range of problems without compromising the speed or precision. △ Less

Submitted 17 July, 2021; v1 submitted 5 May, 2021; originally announced May 2021.

Comments: Draft submission with corrected funding information

Quantum k-uniform states for heterogeneous systems from irredundant mixed orthogonal arrays

Authors: Shanqi Pang, Xiao Zhang, Shao-Ming Fei, Zhu-Jun Zheng

Abstract: Quantum multipartite entangled states play significant roles in quantum information processing. By using difference schemes and orthogonal partitions, we construct a series of infinite classes of irredundant mixed orthogonal arrays (IrMOAs) and thus provide positive answers to two open problems. The first is the extension of the method for constructing homogeneous systems from orthogonal arrays (O… ▽ More Quantum multipartite entangled states play significant roles in quantum information processing. By using difference schemes and orthogonal partitions, we construct a series of infinite classes of irredundant mixed orthogonal arrays (IrMOAs) and thus provide positive answers to two open problems. The first is the extension of the method for constructing homogeneous systems from orthogonal arrays (OAs) to heterogeneous multipartite systems with different individual levels. The second is the existence of $k$-uniform states in heterogeneous quantum systems. We present explicit constructions of two and three-uniform states for arbitrary heterogeneous multipartite systems with coprime individual levels, and characterize the entangled states in heterogeneous systems consisting of subsystems with nonprime power dimensions as well. Moreover, we obtain infinite classes of $k$-uniform states for heterogeneous multipartite systems for any $k\geq2$. The non-existence of a class of IrMOAs is also proved. △ Less

Submitted 29 April, 2021; originally announced April 2021.

Journal ref: Quant. Inform. Processing 20 (2021) 156

Super-Heisenberg scaling in Hamiltonian parameter estimation in the long-range Kitaev chain

Authors: Jing Yang, Shengshi Pang, Adolfo del Campo, Andrew N. Jordan

Abstract: In quantum metrology, nonlinear many-body interactions can enhance the precision of Hamiltonian parameter estimation to surpass the Heisenberg scaling. Here, we consider the estimation of the interaction strength in linear systems with long-range interactions and using the Kitaev chains as a case study, we establish a transition from the Heisenberg to super-Heisenberg scaling in the quantum Fisher… ▽ More In quantum metrology, nonlinear many-body interactions can enhance the precision of Hamiltonian parameter estimation to surpass the Heisenberg scaling. Here, we consider the estimation of the interaction strength in linear systems with long-range interactions and using the Kitaev chains as a case study, we establish a transition from the Heisenberg to super-Heisenberg scaling in the quantum Fisher information by varying the interaction range. We further show that quantum control can improve the prefactor of the quantum Fisher information. Our results explore the advantage of optimal quantum control and long-range interactions in many-body quantum metrology. △ Less

Submitted 1 November, 2021; v1 submitted 14 April, 2021; originally announced April 2021.

Comments: 15 pages, 3 figures

Journal ref: Phys. Rev. Research 4, 013133(2022)

IUP: An Intelligent Utility Prediction Scheme for Solid-State Fermentation in 5G IoT

Authors: Min Wang, Shanchen Pang, Tong Ding, Sibo Qiao, Xue Zhai, Shuo Wang, Neal N. Xiong, Zhengwen Huang

Abstract: At present, SOILD-STATE Fermentation (SSF) is mainly controlled by artificial experience, and the product quality and yield are not stable. Accurately predicting the quality and yield of SSF is of great significance for improving human food security and supply. In this paper, we propose an Intelligent Utility Prediction (IUP) scheme for SSF in 5G Industrial Internet of Things (IoT), including para… ▽ More At present, SOILD-STATE Fermentation (SSF) is mainly controlled by artificial experience, and the product quality and yield are not stable. Accurately predicting the quality and yield of SSF is of great significance for improving human food security and supply. In this paper, we propose an Intelligent Utility Prediction (IUP) scheme for SSF in 5G Industrial Internet of Things (IoT), including parameter collection and utility prediction of SSF process. This IUP scheme is based on the environmental perception and intelligent learning algorithms of the 5G Industrial IoT. We build a workflow model based on rewritable petri net to verify the correctness of the system model function and process. In addition, we design a utility prediction model for SSF based on the Generative Adversarial Networks (GAN) and Fully Connected Neural Network (FCNN). We design a GAN with constraint of mean square error (MSE-GAN) to solve the problem of few-shot learning of SSF, and then combine with the FCNN to realize the utility prediction (usually use the alcohol) of SSF. Based on the production of liquor in laboratory, the experiments show that the proposed method is more accurate than the other prediction methods in the utility prediction of SSF, and provide the basis for the numerical analysis of the proportion of preconfigured raw materials and the appropriate setting of cellar temperature. △ Less

Submitted 28 March, 2021; originally announced March 2021.

MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes

Authors: Zhikai Chen, Lingxi Xie, Shanmin Pang, Yong He, Bo Zhang

Abstract: Deepfakes raised serious concerns on the authenticity of visual contents. Prior works revealed the possibility to disrupt deepfakes by adding adversarial perturbations to the source data, but we argue that the threat has not been eliminated yet. This paper presents MagDR, a mask-guided detection and reconstruction pipeline for defending deepfakes from adversarial attacks. MagDR starts with a detec… ▽ More Deepfakes raised serious concerns on the authenticity of visual contents. Prior works revealed the possibility to disrupt deepfakes by adding adversarial perturbations to the source data, but we argue that the threat has not been eliminated yet. This paper presents MagDR, a mask-guided detection and reconstruction pipeline for defending deepfakes from adversarial attacks. MagDR starts with a detection module that defines a few criteria to judge the abnormality of the output of deepfakes, and then uses it to guide a learnable reconstruction procedure. Adaptive masks are extracted to capture the change in local facial regions. In experiments, MagDR defends three main tasks of deepfakes, and the learned reconstruction pipeline transfers across input data, showing promising performance in defending both black-box and white-box attacks. △ Less

Submitted 25 March, 2021; originally announced March 2021.

Comments: Accepted to CVPR2021