Showing 1–50 of 228 results for author: Su, Q

Achieving Peta-Ohm Resistance for Semi-Insulating 4H-SiC Devices by Atomic Layer Deposition

Authors: Yuying Xi, Helios Y. Li, Guohui Li, Qingmei Su, Kaili Mao, Bingshe Xu, Yuying Hao, Nicholas X. Fang, Yanxia Cui

Abstract: Growing demands for precise current measurements, such as atto-ampere-level measurement of cross-cellular biological current transduction, have spotlighted a pressing need for low-noise resistors with ultra-high resistance immune to voltage fluctuations. Traditional semi-insulating materials, however, struggle to provide consistent resistance across varying voltages. To bridge this gap, we introdu… ▽ More Growing demands for precise current measurements, such as atto-ampere-level measurement of cross-cellular biological current transduction, have spotlighted a pressing need for low-noise resistors with ultra-high resistance immune to voltage fluctuations. Traditional semi-insulating materials, however, struggle to provide consistent resistance across varying voltages. To bridge this gap, we introduce a design that integrates semi-insulating 4H-SiC with atomic-level metal oxide interlayers and electrodes. The strategic adjustment of surface states via atomic-scale metal oxide layers optimizes the work functions on 4H-SiC surfaces, validated through density functional theory simulations. This design transcends conventional limitations, establishing an ideal Ohmic behavior and maintains Peta-Ohm-level resistance, unaffected by voltage variations. These on-chip devices with fine-tuned resistance are compatible with integrated circuit manufacturing processes, making them ideally suited for applications in precision electronics. △ Less

Submitted 14 July, 2024; originally announced July 2024.

Token-Mol 1.0: Tokenized drug design with large language model

Authors: Jike Wang, Rui Qin, Mingyang Wang, Meijing Fang, Yangyang Zhang, Yuchen Zhu, Qun Su, Qiaolin Gou, Chao Shen, Odin Zhang, Zhenxing Wu, Dejun Jiang, Xujun Zhang, Huifeng Zhao, Xiaozhe Wan, Zhourui Wu, Liwei Liu, Yu Kang, Chang-Yu Hsieh, Tingjun Hou

Abstract: Significant interests have recently risen in leveraging sequence-based large language models (LLMs) for drug design. However, most current applications of LLMs in drug discovery lack the ability to comprehend three-dimensional (3D) structures, thereby limiting their effectiveness in tasks that explicitly involve molecular conformations. In this study, we introduced Token-Mol, a token-only 3D drug… ▽ More Significant interests have recently risen in leveraging sequence-based large language models (LLMs) for drug design. However, most current applications of LLMs in drug discovery lack the ability to comprehend three-dimensional (3D) structures, thereby limiting their effectiveness in tasks that explicitly involve molecular conformations. In this study, we introduced Token-Mol, a token-only 3D drug design model. This model encodes all molecular information, including 2D and 3D structures, as well as molecular property data, into tokens, which transforms classification and regression tasks in drug discovery into probabilistic prediction problems, thereby enabling learning through a unified paradigm. Token-Mol is built on the transformer decoder architecture and trained using random causal masking techniques. Additionally, we proposed the Gaussian cross-entropy (GCE) loss function to overcome the challenges in regression tasks, significantly enhancing the capacity of LLMs to learn continuous numerical values. Through a combination of fine-tuning and reinforcement learning (RL), Token-Mol achieves performance comparable to or surpassing existing task-specific methods across various downstream tasks, including pocket-based molecular generation, conformation generation, and molecular property prediction. Compared to existing molecular pre-trained models, Token-Mol exhibits superior proficiency in handling a wider range of downstream tasks essential for drug design. Notably, our approach improves regression task accuracy by approximately 30% compared to similar token-only methods. Token-Mol overcomes the precision limitations of token-only models and has the potential to integrate seamlessly with general models such as ChatGPT, paving the way for the development of a universal artificial intelligence drug design model that facilitates rapid and high-quality drug design by experts. △ Less

Submitted 10 July, 2024; originally announced July 2024.

Observation of topological transitions associated with a Weyl exceptional ring

Authors: Hao-Long Zhang, Pei-Rong Han, Xue-Jia Yu, Shou-Bang Yang, Jia-Hao Lü, Wen Ning, Fan Wu, Qi-Ping Su, Chui-Ping Yang, Zhen-Biao Yang, Shi-Biao Zheng

Abstract: The environment-induced dissipation of an open system, once thought as a nuisance, can actually lead to emergence of many intriguing phenomena that are absent in an isolated system. Among these, Weyl exceptional rings (WER), extended from point-like singularities, are particularly interesting. Theoretically, a WER was predicted to carry a topological charge with a nonzero Chern number, but it has… ▽ More The environment-induced dissipation of an open system, once thought as a nuisance, can actually lead to emergence of many intriguing phenomena that are absent in an isolated system. Among these, Weyl exceptional rings (WER), extended from point-like singularities, are particularly interesting. Theoretically, a WER was predicted to carry a topological charge with a nonzero Chern number, but it has not been measured so far. We here investigate this topology in a circuit, where the WER is synthesized with a superconducting qubit controllably coupled to a decaying resonator. The high flexibility of the system enables us to characterize its eigenvectors on different manifolds of parameter space. We extract both the quantized Berry phase and Chern number from these eigenvectors. Furthermore, we demonstrate a topological transition triggered by shrinking the size of the manifold$-$a unique feature of the WER. △ Less

Submitted 30 June, 2024; originally announced July 2024.

Comments: 16 pages, 10 figures

Quantum voting machine encoded with microwave photons

Authors: Yu Zhang, Chuiping Yang, Qiping Su, Yihao Kang, Wen Zheng, Shaoxiong Li, Yang Yu

Abstract: We propose a simple quantum voting machine using microwave photon qubit encoding, based on a setup comprising multiple microwave cavities and a coupled superconducting flux qutrit. This approach primarily relies on a multi-control single-target quantum phase gate. The scheme offers operational simplicity, requiring only a single step, while ensuring verifiability through the measurement of a singl… ▽ More We propose a simple quantum voting machine using microwave photon qubit encoding, based on a setup comprising multiple microwave cavities and a coupled superconducting flux qutrit. This approach primarily relies on a multi-control single-target quantum phase gate. The scheme offers operational simplicity, requiring only a single step, while ensuring verifiability through the measurement of a single qubit phase information to obtain the voting results. And it provides voter anonymity, as the voting outcome is solely tied to the total number of affirmative votes. Our quantum voting machine also has scalability in terms of the number of voters. Additionally, the physical realization of the quantum voting machine is general and not limited to circuit QED. Quantum voting machine can be implemented as long as the multi-control single-phase quantum phase gate is realized in other physical systems. Numerical simulations indicate the feasibility of this quantum voting machine within the current quantum technology. △ Less

Submitted 27 June, 2024; originally announced June 2024.

Comments: 14pages,4 figures. arXiv admin note: text overlap with arXiv:2306.02227

MSC Class: 81V99

Journal ref: Chin. Phys. Lett. 41 070302 (2024)

APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model Prompts

Authors: Honghua Dong, Qidong Su, Yubo Gao, Zhaoyu Li, Yangjun Ruan, Gennady Pekhimenko, Chris J. Maddison, Xujie Si

Abstract: Large Language Models (LLMs) have become increasingly capable of handling diverse tasks with the aid of well-crafted prompts and integration of external tools, but as task complexity rises, the workflow involving LLMs can be complicated and thus challenging to implement and maintain. To address this challenge, we propose APPL, A Prompt Programming Language that acts as a bridge between computer pr… ▽ More Large Language Models (LLMs) have become increasingly capable of handling diverse tasks with the aid of well-crafted prompts and integration of external tools, but as task complexity rises, the workflow involving LLMs can be complicated and thus challenging to implement and maintain. To address this challenge, we propose APPL, A Prompt Programming Language that acts as a bridge between computer programs and LLMs, allowing seamless embedding of prompts into Python functions, and vice versa. APPL provides an intuitive and Python-native syntax, an efficient parallelized runtime with asynchronous semantics, and a tracing module supporting effective failure diagnosis and replaying without extra costs. We demonstrate that APPL programs are intuitive, concise, and efficient through three representative scenarios: Chain-of-Thought with self-consistency (CoT-SC), ReAct tool use agent, and multi-agent chat. Experiments on three parallelizable workflows further show that APPL can effectively parallelize independent LLM calls, with a significant speedup ratio that almost matches the estimation. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Burn-in Test and Thermal Performance Evaluation of Silicon Photomultipliers for the JUNO-TAO Experiment

Authors: X. Chen, G. F. Cao, M. H. Qu, H. W. Wang, N. Anfimov, A. Rybnikov, J. Y. Xu, A. Q. Su, Z. L. Chen, J. Cao, Y. C. Li, M. Qi

Abstract: This study evaluates more than 4,000 tiles made of Hamamatsu visual-sensitive silicon photomultipier (SiPM), each with dimensions of 5 $\times$ 5 cm$^2$, intended for the central detector of the Taishan Anti-neutrino Observatory (TAO), a satellite experiment of the Jiangmen Underground Neutrino Observatory (JUNO) aimed at measuring the reactor anti-neutrino energy spectrum with unprecedented energ… ▽ More This study evaluates more than 4,000 tiles made of Hamamatsu visual-sensitive silicon photomultipier (SiPM), each with dimensions of 5 $\times$ 5 cm$^2$, intended for the central detector of the Taishan Anti-neutrino Observatory (TAO), a satellite experiment of the Jiangmen Underground Neutrino Observatory (JUNO) aimed at measuring the reactor anti-neutrino energy spectrum with unprecedented energy resolution. All SiPM tiles underwent a room temperature burn-in test in the dark for two weeks, while cryogenic testing analyzed the thermal dependence of parameters for some sampled SiPMs. Results from these comprehensive tests provide crucial insights into the long-term performance and stability of the 10 square meters of SiPMs operating at -50°C to detect scintillation photons in the TAO detector. Despite some anomalies awaiting further inspection, all SiPMs successfully passed the burn-in test over two weeks at room temperature, which is equivalent to 6.7 years at -50°C. Results are also used to guide optimal SiPM selection, configuration, and operation, ensuring reliability and sustainability in reactor neutrino measurements. This work also provides insights for a rapid and robust quality assessment in future experiments that employ large-scale SiPMs as detection systems. △ Less

Submitted 13 June, 2024; originally announced June 2024.

Comments: 15 pages, 15 figures, submitted to JINST

Report number: JUNO-doc-11626

Imperceptible Face Forgery Attack via Adversarial Semantic Mask

Authors: Decheng Liu, Qixuan Su, Chunlei Peng, Nannan Wang, Xinbo Gao

Abstract: With the great development of generative model techniques, face forgery detection draws more and more attention in the related field. Researchers find that existing face forgery models are still vulnerable to adversarial examples with generated pixel perturbations in the global image. These generated adversarial samples still can't achieve satisfactory performance because of the high detectability… ▽ More With the great development of generative model techniques, face forgery detection draws more and more attention in the related field. Researchers find that existing face forgery models are still vulnerable to adversarial examples with generated pixel perturbations in the global image. These generated adversarial samples still can't achieve satisfactory performance because of the high detectability. To address these problems, we propose an Adversarial Semantic Mask Attack framework (ASMA) which can generate adversarial examples with good transferability and invisibility. Specifically, we propose a novel adversarial semantic mask generative model, which can constrain generated perturbations in local semantic regions for good stealthiness. The designed adaptive semantic mask selection strategy can effectively leverage the class activation values of different semantic regions, and further ensure better attack transferability and stealthiness. Extensive experiments on the public face forgery dataset prove the proposed method achieves superior performance compared with several representative adversarial attack methods. The code is publicly available at https://github.com/clawerO-O/ASMA. △ Less

Submitted 16 June, 2024; originally announced June 2024.

Comments: The code is publicly available

Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation

Authors: Mingwang Xu, Hui Li, Qingkun Su, Hanlin Shang, Liwei Zhang, Ce Liu, Jingdong Wang, Yao Yao, Siyu Zhu

Abstract: The field of portrait image animation, driven by speech audio input, has experienced significant advancements in the generation of realistic and dynamic portraits. This research delves into the complexities of synchronizing facial movements and creating visually appealing, temporally consistent animations within the framework of diffusion-based methodologies. Moving away from traditional paradigms… ▽ More The field of portrait image animation, driven by speech audio input, has experienced significant advancements in the generation of realistic and dynamic portraits. This research delves into the complexities of synchronizing facial movements and creating visually appealing, temporally consistent animations within the framework of diffusion-based methodologies. Moving away from traditional paradigms that rely on parametric models for intermediate facial representations, our innovative approach embraces the end-to-end diffusion paradigm and introduces a hierarchical audio-driven visual synthesis module to enhance the precision of alignment between audio inputs and visual outputs, encompassing lip, expression, and pose motion. Our proposed network architecture seamlessly integrates diffusion-based generative models, a UNet-based denoiser, temporal alignment techniques, and a reference network. The proposed hierarchical audio-driven visual synthesis offers adaptive control over expression and pose diversity, enabling more effective personalization tailored to different identities. Through a comprehensive evaluation that incorporates both qualitative and quantitative analyses, our approach demonstrates obvious enhancements in image and video quality, lip synchronization precision, and motion diversity. Further visualization and access to the source code can be found at: https://fudan-generative-vision.github.io/hallo. △ Less

Submitted 16 June, 2024; v1 submitted 13 June, 2024; originally announced June 2024.

Comments: 20 pages

Predicting and Explaining Hearing Aid Usage Using Encoder-Decoder with Attention Mechanism and SHAP

Authors: Qiqi Su, Eleftheria Iliadou

Abstract: It is essential to understand the personal, behavioral, environmental, and other factors that correlate with optimal hearing aid fitting and hearing aid users' experiences in order to improve hearing loss patient satisfaction and quality of life, as well as reduce societal and financial burdens. This work proposes a novel framework that uses Encoder-decoder with attention mechanism (attn-ED) for p… ▽ More It is essential to understand the personal, behavioral, environmental, and other factors that correlate with optimal hearing aid fitting and hearing aid users' experiences in order to improve hearing loss patient satisfaction and quality of life, as well as reduce societal and financial burdens. This work proposes a novel framework that uses Encoder-decoder with attention mechanism (attn-ED) for predicting future hearing aid usage and SHAP to explain the factors contributing to this prediction. It has been demonstrated in experiments that attn-ED performs well at predicting future hearing aid usage, and that SHAP can be utilized to calculate the contribution of different factors affecting hearing aid usage. This framework aims to establish confidence that AI models can be utilized in the medical domain with the use of XAI methods. Moreover, the proposed framework can also assist clinicians in determining the nature of interventions. △ Less

Submitted 18 May, 2024; originally announced May 2024.

Journal ref: In 16th SITIS, pp. 308-315. IEEE, 2022

SQL-to-Schema Enhances Schema Linking in Text-to-SQL

Authors: Sun Yang, Qiong Su, Zhishuai Li, Ziyue Li, Hangyu Mao, Chenxi Liu, Rui Zhao

Abstract: In sophisticated existing Text-to-SQL methods exhibit errors in various proportions, including schema-linking errors (incorrect columns, tables, or extra columns), join errors, nested errors, and group-by errors. Consequently, there is a critical need to filter out unnecessary tables and columns, directing the language models attention to relevant tables and columns with schema-linking, to reduce… ▽ More In sophisticated existing Text-to-SQL methods exhibit errors in various proportions, including schema-linking errors (incorrect columns, tables, or extra columns), join errors, nested errors, and group-by errors. Consequently, there is a critical need to filter out unnecessary tables and columns, directing the language models attention to relevant tables and columns with schema-linking, to reduce errors during SQL generation. Previous approaches have involved sorting tables and columns based on their relevance to the question, selecting the top-ranked ones for sorting, or directly identifying the necessary tables and columns for SQL generation. However, these methods face challenges such as lengthy model training times, high consumption of expensive GPT-4 tokens in few-shot prompts, or suboptimal performance in schema linking. Therefore, we propose an inventive schema linking method in two steps: Firstly, generate an initial SQL query by utilizing the complete database schema. Subsequently, extract tables and columns from the initial SQL query to create a concise schema. Using CodeLlama-34B, when comparing the schemas obtained by mainstream methods with ours for SQL generation, our schema performs optimally. Leveraging GPT4, our SQL generation method achieved results that are comparable to mainstream Text-to-SQL methods on the Spider dataset. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Tomur: Traffic-Aware Performance Prediction of On-NIC Network Functions with Multi-Resource Contention

Authors: Shaofeng Wu, Qiang Su, Zhixiong Niu, Hong Xu

Abstract: Network function (NF) offloading on SmartNICs has been widely used in modern data centers, offering benefits in host resource saving and programmability. Co-running NFs on the same SmartNICs can cause performance interference due to onboard resource contention. Therefore, to meet performance SLAs while ensuring efficient resource management, operators need mechanisms to predict NF performance unde… ▽ More Network function (NF) offloading on SmartNICs has been widely used in modern data centers, offering benefits in host resource saving and programmability. Co-running NFs on the same SmartNICs can cause performance interference due to onboard resource contention. Therefore, to meet performance SLAs while ensuring efficient resource management, operators need mechanisms to predict NF performance under such contention. However, existing solutions lack SmartNIC-specific knowledge and exhibit limited traffic awareness, leading to poor accuracy for on-NIC NFs. This paper proposes Tomur, a novel performance predictive system for on-NIC NFs. Tomur builds upon the key observation that co-located NFs contend for multiple resources, including onboard accelerators and the memory subsystem. It also facilitates traffic awareness according to the behaviors of individual resources to maintain accuracy as the external traffic attributes vary. Evaluation using BlueField-2 SmartNIC shows that Tomur improves the prediction accuracy by 78.8% and reduces SLA violations by 92.2% compared to state-of-the-art approaches, and enables new practical usecases. △ Less

Submitted 31 May, 2024; v1 submitted 8 May, 2024; originally announced May 2024.

Comments: Correct the typos in evaluation and appendix

Implementation of a Mesh refinement algorithm into the quasi-static PIC code QuickPIC

Authors: Q. Su, F. Li, W. An, V. Decyk, Y. Zhao, L. Hildebrand, T. N. Dalichaouch, S. Zhou, E. P. Alves, A. S. Almgren, W. B. Mori

Abstract: Plasma-based acceleration (PBA) has emerged as a promising candidate for the accelerator technology used to build a future linear collider and/or an advanced light source. In PBA, a trailing or witness particle beam is accelerated in the plasma wave wakefield (WF) created by a laser or particle beam driver. The distance over which the drive beam evolves is several orders of magnitude larger than t… ▽ More Plasma-based acceleration (PBA) has emerged as a promising candidate for the accelerator technology used to build a future linear collider and/or an advanced light source. In PBA, a trailing or witness particle beam is accelerated in the plasma wave wakefield (WF) created by a laser or particle beam driver. The distance over which the drive beam evolves is several orders of magnitude larger than the wake wavelength. This large disparity in length scales is amenable to the quasi-static approach. Three-dimensional (3D), quasi-static (QS), particle-in-cell (PIC) codes, e.g., QuickPIC, have been shown to provide high fidelity simulation capability with 2-4 orders of magnitude speedup over 3D fully explicit PIC codes. We describe a mesh refinement scheme that has been implemented into the 3D QS PIC code, QuickPIC. We use a very fine (high) resolution in a small spatial region that includes the witness beam and progressively coarser resolutions in the rest of the simulation domain. A fast multigrid Poisson solver has been implemented for the field solve on the refined meshes and a Fast Fourier Transform (FFT) based Poisson solver is used for the coarse mesh. The code has been parallelized with both MPI and OpenMP, and the parallel scalability has also been improved by using pipelining. A preliminary adaptive mesh refinement technique is described to optimize the computational time for simulations with an evolving witness beam size. Several test problems are used to verify that the mesh refinement algorithm provides accurate results. The results are also compared to highly resolved simulations with near azimuthal symmetry using a new hybrid QS PIC code QPAD that uses a PIC description in the coordinates ($r$, $ct-z$) and a gridless description in the azimuthal angle, $φ$. △ Less

Submitted 1 May, 2024; originally announced May 2024.

Rigorous Formalization of Orbital Functionals: Addressing the Noninteracting $v$-Representability Problem

Authors: Neil Qiang Su

Abstract: Functionals that explicitly depend on occupied, unoccupied, or fractionally-occupied orbitals are rigorously formalized using Clifford algebras, and a variational principle is established that facilitates orbital (and occupation) optimization as a formal implementation method. Theoretically, these methodologies circumvent the limitations encountered in the original Kohn-Sham and related methods, p… ▽ More Functionals that explicitly depend on occupied, unoccupied, or fractionally-occupied orbitals are rigorously formalized using Clifford algebras, and a variational principle is established that facilitates orbital (and occupation) optimization as a formal implementation method. Theoretically, these methodologies circumvent the limitations encountered in the original Kohn-Sham and related methods, particularly when the interacting system's electron density does not match that of any noninteracting reference system. This work redefines orbital (and occupation) functionals from a novel perspective, positioning them not merely as extensions of traditional density functionals, but as superior, rigorous alternatives. △ Less

Submitted 24 April, 2024; originally announced April 2024.

A Survey on Deep Learning for Theorem Proving

Authors: Zhaoyu Li, Jialiang Sun, Logan Murphy, Qidong Su, Zenan Li, Xian Zhang, Kaiyu Yang, Xujie Si

Abstract: Theorem proving is a fundamental aspect of mathematics, spanning from informal reasoning in mathematical language to rigorous derivations in formal systems. In recent years, the advancement of deep learning, especially the emergence of large language models, has sparked a notable surge of research exploring these techniques to enhance the process of theorem proving. This paper presents a pioneerin… ▽ More Theorem proving is a fundamental aspect of mathematics, spanning from informal reasoning in mathematical language to rigorous derivations in formal systems. In recent years, the advancement of deep learning, especially the emergence of large language models, has sparked a notable surge of research exploring these techniques to enhance the process of theorem proving. This paper presents a pioneering comprehensive survey of deep learning for theorem proving by offering i) a thorough review of existing approaches across various tasks such as autoformalization, premise selection, proofstep generation, and proof search; ii) a meticulous summary of available datasets and strategies for data generation; iii) a detailed analysis of evaluation metrics and the performance of state-of-the-art; and iv) a critical discussion on the persistent challenges and the promising avenues for future exploration. Our survey aims to serve as a foundational reference for deep learning approaches in theorem proving, seeking to catalyze further research endeavors in this rapidly growing field. △ Less

Submitted 15 April, 2024; originally announced April 2024.

CHisIEC: An Information Extraction Corpus for Ancient Chinese History

Authors: Xuemei Tang, Zekun Deng, Qi Su, Hao Yang, Jun Wang

Abstract: Natural Language Processing (NLP) plays a pivotal role in the realm of Digital Humanities (DH) and serves as the cornerstone for advancing the structural analysis of historical and cultural heritage texts. This is particularly true for the domains of named entity recognition (NER) and relation extraction (RE). In our commitment to expediting ancient history and culture, we present the ``Chinese Hi… ▽ More Natural Language Processing (NLP) plays a pivotal role in the realm of Digital Humanities (DH) and serves as the cornerstone for advancing the structural analysis of historical and cultural heritage texts. This is particularly true for the domains of named entity recognition (NER) and relation extraction (RE). In our commitment to expediting ancient history and culture, we present the ``Chinese Historical Information Extraction Corpus''(CHisIEC). CHisIEC is a meticulously curated dataset designed to develop and evaluate NER and RE tasks, offering a resource to facilitate research in the field. Spanning a remarkable historical timeline encompassing data from 13 dynasties spanning over 1830 years, CHisIEC epitomizes the extensive temporal range and text heterogeneity inherent in Chinese historical documents. The dataset encompasses four distinct entity types and twelve relation types, resulting in a meticulously labeled dataset comprising 14,194 entities and 8,609 relations. To establish the robustness and versatility of our dataset, we have undertaken comprehensive experimentation involving models of various sizes and paradigms. Additionally, we have evaluated the capabilities of Large Language Models (LLMs) in the context of tasks related to ancient Chinese history. The dataset and code are available at \url{https://github.com/tangxuemei1995/CHisIEC}. △ Less

Submitted 20 April, 2024; v1 submitted 22 March, 2024; originally announced March 2024.

Comments: 11 pages, 6 tables, 3 figures

MM-Diff: High-Fidelity Image Personalization via Multi-Modal Condition Integration

Authors: Zhichao Wei, Qingkun Su, Long Qin, Weizhi Wang

Abstract: Recent advances in tuning-free personalized image generation based on diffusion models are impressive. However, to improve subject fidelity, existing methods either retrain the diffusion model or infuse it with dense visual embeddings, both of which suffer from poor generalization and efficiency. Also, these methods falter in multi-subject image generation due to the unconstrained cross-attention… ▽ More Recent advances in tuning-free personalized image generation based on diffusion models are impressive. However, to improve subject fidelity, existing methods either retrain the diffusion model or infuse it with dense visual embeddings, both of which suffer from poor generalization and efficiency. Also, these methods falter in multi-subject image generation due to the unconstrained cross-attention mechanism. In this paper, we propose MM-Diff, a unified and tuning-free image personalization framework capable of generating high-fidelity images of both single and multiple subjects in seconds. Specifically, to simultaneously enhance text consistency and subject fidelity, MM-Diff employs a vision encoder to transform the input image into CLS and patch embeddings. CLS embeddings are used on the one hand to augment the text embeddings, and on the other hand together with patch embeddings to derive a small number of detail-rich subject embeddings, both of which are efficiently integrated into the diffusion model through the well-designed multimodal cross-attention mechanism. Additionally, MM-Diff introduces cross-attention map constraints during the training phase, ensuring flexible multi-subject image sampling during inference without any predefined inputs (e.g., layout). Extensive experiments demonstrate the superior performance of MM-Diff over other leading methods. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance

Authors: Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Qingkun Su, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, Siyu Zhu

Abstract: In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human generative techniques. The methodology utilizes the SMPL(Skinned Multi-Person Linear) model as the 3D human parametric model to establish a unified representation of body shape and pose. Thi… ▽ More In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human generative techniques. The methodology utilizes the SMPL(Skinned Multi-Person Linear) model as the 3D human parametric model to establish a unified representation of body shape and pose. This facilitates the accurate capture of intricate human geometry and motion characteristics from source videos. Specifically, we incorporate rendered depth images, normal maps, and semantic maps obtained from SMPL sequences, alongside skeleton-based motion guidance, to enrich the conditions to the latent diffusion model with comprehensive 3D shape and detailed pose attributes. A multi-layer motion fusion module, integrating self-attention mechanisms, is employed to fuse the shape and motion latent representations in the spatial domain. By representing the 3D human parametric model as the motion guidance, we can perform parametric shape alignment of the human body between the reference image and the source video motion. Experimental evaluations conducted on benchmark datasets demonstrate the methodology's superior ability to generate high-quality human animations that accurately capture both pose and shape variations. Furthermore, our approach also exhibits superior generalization capabilities on the proposed in-the-wild dataset. Project page: https://fudan-generative-vision.github.io/champ. △ Less

Submitted 1 June, 2024; v1 submitted 21 March, 2024; originally announced March 2024.

The FAST Galactic Plane Pulsar Snapshot Survey -- V. PSR J1901+0658 in a double neutron star system

Authors: W. Q. Su, J. L. Han, Z. L. Yang, P. F. Wang, J. P. Yuan, C. Wang, D. J. Zhou, T. Wang, Y. Yan, W. C. Jing, N. N. Cai, L. Xie, J. Xu, H. G. Wang, R. X. Xu, X. P. You

Abstract: Double neutron star (DNS) systems offer excellent opportunities to test gravity theories. We report the timing results of PSR J1901+0658, the first pulsar discovered in the FAST Galactic Plane Pulsar Snapshot (GPPS) Survey. Based on timing observations by FAST over 5 yr, we obtain the phase-coherent timing solutions and derive the precise measurements of its position, spin parameters, orbital para… ▽ More Double neutron star (DNS) systems offer excellent opportunities to test gravity theories. We report the timing results of PSR J1901+0658, the first pulsar discovered in the FAST Galactic Plane Pulsar Snapshot (GPPS) Survey. Based on timing observations by FAST over 5 yr, we obtain the phase-coherent timing solutions and derive the precise measurements of its position, spin parameters, orbital parameters, and dispersion measure. It has a period of 75.7 ms, a period derivative of 2.169(6)$\times 10^{-19}$ s s$^{-1}$, and a characteristic age of 5.5 Gyr. This pulsar is in an orbit with a period of 14.45 d and an eccentricity of 0.366. One post-Keplerian parameter, periastron advance, has been well-measured as being 0.00531(9) deg yr$^{-1}$, from which the total mass of this system is derived to be 2.79(7) M$_{\odot}$. The pulsar has the mass upper limit of 1.68 M$_{\odot}$, so the lower limit for the companion mass is 1.11 M$_{\odot}$. Because PSR J1901+0658 is a partially recycled pulsar in an eccentric binary orbit with such a large companion mass, it should be in a DNS system according to the evolution history of the binary system. △ Less

Submitted 24 April, 2024; v1 submitted 18 March, 2024; originally announced March 2024.

Comments: 6 pages, 6 figures

Journal ref: Monthly Notices of the Royal Astronomical Society, Volume 530, Issue 2, May 2024, Pages 1506-1511

Restoring Ancient Ideograph: A Multimodal Multitask Neural Network Approach

Authors: Siyu Duan, Jun Wang, Qi Su

Abstract: Cultural heritage serves as the enduring record of human thought and history. Despite significant efforts dedicated to the preservation of cultural relics, many ancient artefacts have been ravaged irreversibly by natural deterioration and human actions. Deep learning technology has emerged as a valuable tool for restoring various kinds of cultural heritages, including ancient text restoration. Pre… ▽ More Cultural heritage serves as the enduring record of human thought and history. Despite significant efforts dedicated to the preservation of cultural relics, many ancient artefacts have been ravaged irreversibly by natural deterioration and human actions. Deep learning technology has emerged as a valuable tool for restoring various kinds of cultural heritages, including ancient text restoration. Previous research has approached ancient text restoration from either visual or textual perspectives, often overlooking the potential of synergizing multimodal information. This paper proposes a novel Multimodal Multitask Restoring Model (MMRM) to restore ancient texts, particularly emphasising the ideograph. This model combines context understanding with residual visual information from damaged ancient artefacts, enabling it to predict damaged characters and generate restored images simultaneously. We tested the MMRM model through experiments conducted on both simulated datasets and authentic ancient inscriptions. The results show that the proposed method gives insightful restoration suggestions in both simulation experiments and real-world scenarios. To the best of our knowledge, this work represents the pioneering application of multimodal deep learning in ancient text restoration, which will contribute to the understanding of ancient society and culture in digital humanities fields. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: Accept by Lrec-Coling 2024

Small Language Model Is a Good Guide for Large Language Model in Chinese Entity Relation Extraction

Authors: Xuemei Tang, Jun Wang, Qi Su

Abstract: Recently, large language models (LLMs) have been successful in relational extraction (RE) tasks, especially in the few-shot learning. An important problem in the field of RE is long-tailed data, while not much attention is currently paid to this problem using LLM approaches. Therefore, in this paper, we propose SLCoLM, a model collaboration framework, to mitigate the data long-tail problem. In our… ▽ More Recently, large language models (LLMs) have been successful in relational extraction (RE) tasks, especially in the few-shot learning. An important problem in the field of RE is long-tailed data, while not much attention is currently paid to this problem using LLM approaches. Therefore, in this paper, we propose SLCoLM, a model collaboration framework, to mitigate the data long-tail problem. In our framework, We use the ``\textit{Training-Guide-Predict}'' strategy to combine the strengths of pre-trained language models (PLMs) and LLMs, where a task-specific PLM framework acts as a tutor, transfers task knowledge to the LLM, and guides the LLM in performing RE tasks. Our experiments on a RE dataset rich in relation types show that the approach in this paper facilitates RE of long-tail relation types. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: 12 pages, 5 tables, 3 figures

An Effective Incorporating Heterogeneous Knowledge Curriculum Learning for Sequence Labeling

Authors: Xuemei Tang, Qi Su

Abstract: Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for training a high-performing model. To address this challenge, we propose a two-stage curriculum learning (TCL) framework specifically designed for sequence labeling tasks. The TCL frame… ▽ More Sequence labeling models often benefit from incorporating external knowledge. However, this practice introduces data heterogeneity and complicates the model with additional modules, leading to increased expenses for training a high-performing model. To address this challenge, we propose a two-stage curriculum learning (TCL) framework specifically designed for sequence labeling tasks. The TCL framework enhances training by gradually introducing data instances from easy to hard, aiming to improve both performance and training speed. Furthermore, we explore different metrics for assessing the difficulty levels of sequence labeling tasks. Through extensive experimentation on six Chinese word segmentation (CWS) and Part-of-speech tagging (POS) datasets, we demonstrate the effectiveness of our model in enhancing the performance of sequence labeling models. Additionally, our analysis indicates that TCL accelerates training and alleviates the slow training problem associated with complex models. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Comments: 10 pages, 9 tables, 3 figures

Enhancing Reduced Density Matrix Functional Theory Calculations by Coupling Orbital and Occupation Optimizations

Authors: Yi-Fan Yao, Neil Qiang Su

Abstract: Reduced density matrix functional theory (RDMFT) calculations are usually implemented in a decoupled manner, where the orbital and occupation optimizations are repeated alternately. Typically, orbital updates are performed using the unitary optimization method, while occupations are optimized through the explicit-by-implicit (EBI) method. The EBI method addresses explicit constraints by incorporat… ▽ More Reduced density matrix functional theory (RDMFT) calculations are usually implemented in a decoupled manner, where the orbital and occupation optimizations are repeated alternately. Typically, orbital updates are performed using the unitary optimization method, while occupations are optimized through the explicit-by-implicit (EBI) method. The EBI method addresses explicit constraints by incorporating implicit functions, effectively transforming constrained optimization scenarios into unconstrained minimizations. Although the unitary and EBI methods individually achieve robust performance in optimizing orbitals and occupations, respectively, the decoupled optimization methods often suffer from slow convergence and require dozens of alternations between the orbital and occupation optimizations. To address this issue, this work proposes a coupled optimization method that combines unitary and EBI optimizations to update orbitals and occupations simultaneously at each step. To achieve favorable convergence in coupled optimization using a simple first-order algorithm, an effective and efficient preconditioner and line search are further introduced. The superiority of the new method is demonstrated through numerous tests on different molecules, random initial guesses, different basis sets and different functionals. It outperforms all decoupled optimization methods in terms of convergence speed, convergence results and convergence stability. Even a large system like $\mathrm{C_{60}}$ can converge to $10^{-8}$ au in 154 iterations, which shows that the coupled optimization method can make RDMFT more practical and facilitate its wider application and further development. △ Less

Submitted 25 June, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Measuring topological invariants for higher-order exceptional points in quantum multipartite systems

Authors: Pei-Rong Han, Wen Ning, Xin-Jie Huang, Ri-Hua Zheng, Shou-Bang Yang, Fan Wu, Zhen-Biao Yang, Qi-Ping Su, Chui-Ping Yang, Shi-Biao Zheng

Abstract: Owing to the presence of exceptional points (EPs), non-Hermitian (NH) systems can display intriguing topological phenomena without Hermitian analogs. However, experimental characteristics of exceptional topological invariants have been restricted to second-order EPs (EP2s) in classical or semiclassical systems. We here propose an NH multi-qubit model with higher-order EPs, each of which is underla… ▽ More Owing to the presence of exceptional points (EPs), non-Hermitian (NH) systems can display intriguing topological phenomena without Hermitian analogs. However, experimental characteristics of exceptional topological invariants have been restricted to second-order EPs (EP2s) in classical or semiclassical systems. We here propose an NH multi-qubit model with higher-order EPs, each of which is underlain by a multifold-degenerate multipartite entangled eigenstate. We implement the three-qubit model by controllably coupling a superconducting qubit to two microwave resonators, one serving as a Hermitian photonic qubit while the other as an NH qubit. We experimentally quantify the topological invariant for an EP3, by mapping out the complex eigenspectra along a loop surrounding this EP3 in the parameter space. The nonclassicality of the realized topology is manifested by the observed quantum correlations in the corresponding eigenstates. Our results extend research of exceptional topology to fully quantum-mechanical models with multi-partite entangled eigenstates. We further demonstrate the non-reciprocal transmission of a single photon, during which the photon is nonlocally shared by three individual elements. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Meili: Enabling SmartNIC as a Service in the Cloud

Authors: Qiang Su, Shaofeng Wu, Zhixiong Niu, Ran Shu, Peng Cheng, Yongqiang Xiong, Chun Jason Xue, Zaoxing Liu, Hong Xu

Abstract: SmartNICs are touted as an attractive substrate for network application offloading, offering benefits in programmability, host resource saving, and energy efficiency. The current usage restricts offloading to local hosts and confines SmartNIC ownership to individual application teams, resulting in poor resource efficiency and scalability. This paper presents Meili, a novel system that realizes Sma… ▽ More SmartNICs are touted as an attractive substrate for network application offloading, offering benefits in programmability, host resource saving, and energy efficiency. The current usage restricts offloading to local hosts and confines SmartNIC ownership to individual application teams, resulting in poor resource efficiency and scalability. This paper presents Meili, a novel system that realizes SmartNIC as a service to address these issues. Meili organizes heterogeneous SmartNIC resources as a pool and offers a unified one-NIC abstraction to application developers. This allows developers to focus solely on the application logic while dynamically optimizing their performance needs. Our evaluation on NVIDIA BlueField series and AMD Pensando SmartNICs demonstrates that Meili achieves scalable single-flow throughput with a maximum 8 μs latency overhead and enhances resource efficiency by 3.07$\times$ compared to standalone deployments and 1.44$\times$ compared to state-of-the-art microservice deployments. △ Less

Submitted 24 February, 2024; v1 submitted 19 December, 2023; originally announced December 2023.

Knowledge-Aware Artifact Image Synthesis with LLM-Enhanced Prompting and Multi-Source Supervision

Authors: Shengguang Wu, Zhenglun Chen, Qi Su

Abstract: Ancient artifacts are an important medium for cultural preservation and restoration. However, many physical copies of artifacts are either damaged or lost, leaving a blank space in archaeological and historical studies that calls for artifact image generation techniques. Despite the significant advancements in open-domain text-to-image synthesis, existing approaches fail to capture the important d… ▽ More Ancient artifacts are an important medium for cultural preservation and restoration. However, many physical copies of artifacts are either damaged or lost, leaving a blank space in archaeological and historical studies that calls for artifact image generation techniques. Despite the significant advancements in open-domain text-to-image synthesis, existing approaches fail to capture the important domain knowledge presented in the textual description, resulting in errors in recreated images such as incorrect shapes and patterns. In this paper, we propose a novel knowledge-aware artifact image synthesis approach that brings lost historical objects accurately into their visual forms. We use a pretrained diffusion model as backbone and introduce three key techniques to enhance the text-to-image generation framework: 1) we construct prompts with explicit archaeological knowledge elicited from large language models (LLMs); 2) we incorporate additional textual guidance to correlated historical expertise in a contrastive manner; 3) we introduce further visual-semantic constraints on edge and perceptual features that enable our model to learn more intricate visual details of the artifacts. Compared to existing approaches, our proposed model produces higher-quality artifact images that align better with the implicit details and historical knowledge contained within written documents, thus achieving significant improvements across automatic metrics and in human evaluation. Our code and data are available at https://github.com/danielwusg/artifact_diffusion. △ Less

Submitted 13 December, 2023; originally announced December 2023.

DiffuVST: Narrating Fictional Scenes with Global-History-Guided Denoising Models

Authors: Shengguang Wu, Mei Yuan, Qi Su

Abstract: Recent advances in image and video creation, especially AI-based image synthesis, have led to the production of numerous visual scenes that exhibit a high level of abstractness and diversity. Consequently, Visual Storytelling (VST), a task that involves generating meaningful and coherent narratives from a collection of images, has become even more challenging and is increasingly desired beyond rea… ▽ More Recent advances in image and video creation, especially AI-based image synthesis, have led to the production of numerous visual scenes that exhibit a high level of abstractness and diversity. Consequently, Visual Storytelling (VST), a task that involves generating meaningful and coherent narratives from a collection of images, has become even more challenging and is increasingly desired beyond real-world imagery. While existing VST techniques, which typically use autoregressive decoders, have made significant progress, they suffer from low inference speed and are not well-suited for synthetic scenes. To this end, we propose a novel diffusion-based system DiffuVST, which models the generation of a series of visual descriptions as a single conditional denoising process. The stochastic and non-autoregressive nature of DiffuVST at inference time allows it to generate highly diverse narratives more efficiently. In addition, DiffuVST features a unique design with bi-directional text history guidance and multimodal adapter modules, which effectively improve inter-sentence coherence and image-to-text fidelity. Extensive experiments on the story generation task covering four fictional visual-story datasets demonstrate the superiority of DiffuVST over traditional autoregressive models in terms of both text quality and inference speed. △ Less

Submitted 12 December, 2023; originally announced December 2023.

Comments: EMNLP 2023 Findings

RINAS: Training with Dataset Shuffling Can Be General and Fast

Authors: Tianle Zhong, Jiechen Zhao, Xindi Guo, Qiang Su, Geoffrey Fox

Abstract: Deep learning datasets are expanding at an unprecedented pace, creating new challenges for data processing in model training pipelines. A crucial aspect of these pipelines is dataset shuffling, which significantly improves unbiased learning and convergence accuracy by adhering to the principles of random sampling. However, loading shuffled data for large datasets incurs significant overhead in the… ▽ More Deep learning datasets are expanding at an unprecedented pace, creating new challenges for data processing in model training pipelines. A crucial aspect of these pipelines is dataset shuffling, which significantly improves unbiased learning and convergence accuracy by adhering to the principles of random sampling. However, loading shuffled data for large datasets incurs significant overhead in the deep learning pipeline and severely impacts the end-to-end training throughput. To mitigate this, current deep learning systems often resort to partial dataset shuffling, sacrificing global randomness to maintain acceptable training throughput on large datasets, still leaving global shuffling efficiency issues not fully explored. In this work, we present RINAS, a data loading framework that systematically addresses the performance bottleneck of loading global shuffled datasets. Our key contribution is to offer an intra-batch unordered data fetching approach, which unleashes unexplored parallelism of data loading. We implement RINAS under the PyTorch framework for common dataset libraries HuggingFace and TorchVision. Our experimental results show that RINAS improves the throughput of general language model training and vision model training by up to 59% and 89%, respectively. △ Less

Submitted 4 December, 2023; originally announced December 2023.

An Ultra-fast Quantum Random Number Generation Scheme Based on Laser Phase Noise

Authors: Jie Yang, Mei Wu, Yichen Zhang, Jinlu Liu, Fan Fan, Yang Li, Wei Huang, Heng Wang, Yan Pan, Qi Su, Yiming Bian, Haoyuan Jiang, Jiayi Dou, Song Yu, Bingjie Xu, Bin Luoand Hong Guo

Abstract: Based on the intrinsic random property of quantum mechanics, quantum random number generators allow for access of truly unpredictable random sequence and are now heading towards high performance and small miniaturization, among which a popular scheme is based on the laser phase noise. However, this scheme is generally limited in speed and implementation complexity, especially for chip integration.… ▽ More Based on the intrinsic random property of quantum mechanics, quantum random number generators allow for access of truly unpredictable random sequence and are now heading towards high performance and small miniaturization, among which a popular scheme is based on the laser phase noise. However, this scheme is generally limited in speed and implementation complexity, especially for chip integration. In this work, a general physical model based on wiener process for such schemes is introduced, which provides an approach to clearly explain the limitation on the generation rate and comprehensively optimize the system performance. We present an insight to exploit the potential bandwidth of the quantum entropy source that contains plentiful quantum randomness with a simple spectral filtering method and experimentally boost the bandwidth of the corresponding quantum entropy source to 20 GHz, based on which an ultra-fast generation rate of 218 Gbps is demonstrated, setting a new record for laser phase noise based schemes by one order of magnitude. Our proposal significantly enhances the ceiling speed of such schemes without requiring extra complex hardware, thus effectively benefits the corresponding chip integration with high performance and low implementation cost, which paves the way for its large-scale applications. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Comments: 25 pages, 7 figures

FocusLearn: Fully-Interpretable, High-Performance Modular Neural Networks for Time Series

Authors: Qiqi Su, Christos Kloukinas, Artur d'Avila Garcez

Abstract: Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes" or non-interpretable. This paper proposes a novel modular neural network model for multivariate time series prediction that is interpretable by construction. A r… ▽ More Multivariate time series have many applications, from healthcare and meteorology to life science. Although deep learning models have shown excellent predictive performance for time series, they have been criticised for being "black-boxes" or non-interpretable. This paper proposes a novel modular neural network model for multivariate time series prediction that is interpretable by construction. A recurrent neural network learns the temporal dependencies in the data while an attention-based feature selection component selects the most relevant features and suppresses redundant features used in the learning of the temporal dependencies. A modular deep network is trained from the selected features independently to show the users how features influence outcomes, making the model interpretable. Experimental results show that this approach can outperform state-of-the-art interpretable Neural Additive Models (NAM) and variations thereof in both regression and classification of time series tasks, achieving a predictive performance that is comparable to the top non-interpretable methods for time series, LSTM and XGBoost. △ Less

Submitted 3 May, 2024; v1 submitted 28 November, 2023; originally announced November 2023.

Self-Evolved Diverse Data Sampling for Efficient Instruction Tuning

Authors: Shengguang Wu, Keming Lu, Benfeng Xu, Junyang Lin, Qi Su, Chang Zhou

Abstract: Enhancing the instruction-following ability of Large Language Models (LLMs) primarily demands substantial instruction-tuning datasets. However, the sheer volume of these imposes a considerable computational burden and annotation cost. To investigate a label-efficient instruction tuning method that allows the model itself to actively sample subsets that are equally or even more effective, we introd… ▽ More Enhancing the instruction-following ability of Large Language Models (LLMs) primarily demands substantial instruction-tuning datasets. However, the sheer volume of these imposes a considerable computational burden and annotation cost. To investigate a label-efficient instruction tuning method that allows the model itself to actively sample subsets that are equally or even more effective, we introduce a self-evolving mechanism DiverseEvol. In this process, a model iteratively augments its training subset to refine its own performance, without requiring any intervention from humans or more advanced LLMs. The key to our data sampling technique lies in the enhancement of diversity in the chosen subsets, as the model selects new data points most distinct from any existing ones according to its current embedding space. Extensive experiments across three datasets and benchmarks demonstrate the effectiveness of DiverseEvol. Our models, trained on less than 8% of the original dataset, maintain or improve performance compared with finetuning on full data. We also provide empirical evidence to analyze the importance of diversity in instruction data and the iterative scheme as opposed to one-time sampling. Our code is publicly available at https://github.com/OFA-Sys/DiverseEvol.git. △ Less

Submitted 14 November, 2023; originally announced November 2023.

TorchProbe: Fuzzing Dynamic Deep Learning Compilers

Authors: Qidong Su, Chuqin Geng, Gennady Pekhimenko, Xujie Si

Abstract: Static and dynamic computational graphs represent two distinct approaches to constructing deep learning frameworks. The former prioritizes compiler-based optimizations, while the latter focuses on programmability and user-friendliness. The recent release of PyTorch 2.0, which supports compiling arbitrary deep learning programs in Python, signifies a new direction in the evolution of deep learning… ▽ More Static and dynamic computational graphs represent two distinct approaches to constructing deep learning frameworks. The former prioritizes compiler-based optimizations, while the latter focuses on programmability and user-friendliness. The recent release of PyTorch 2.0, which supports compiling arbitrary deep learning programs in Python, signifies a new direction in the evolution of deep learning infrastructure to incorporate compiler techniques in a more dynamic manner and support more dynamic language features like dynamic control flows and closures. Given PyTorch's seamless integration with Python, its compiler aims to support arbitrary deep learning code written in Python. However, the inherent dynamism of Python poses challenges to the completeness and robustness of the compiler. While recent research has introduced fuzzing to test deep learning compilers, there is still a lack of comprehensive analysis on how to test dynamic features. To address this issue, we propose several code transformations to generate test cases involving dynamic features. These transformations preserve the program's semantics, ensuring that any discrepancy between the transformed and original programs indicates the presence of a bug. Through our approach, we have successfully identified twenty previously unknown bugs in the PyTorch compiler and its underlying tensor compiler Triton. △ Less

Submitted 30 October, 2023; originally announced October 2023.

The Synergy of Speculative Decoding and Batching in Serving Large Language Models

Authors: Qidong Su, Christina Giannoula, Gennady Pekhimenko

Abstract: Large Language Models (LLMs) like GPT are state-of-the-art text generation models that provide significant assistance in daily routines. However, LLM execution is inherently sequential, since they only produce one token at a time, thus incurring low hardware utilization on modern GPUs. Batching and speculative decoding are two techniques to improve GPU hardware utilization in LLM inference. To stu… ▽ More Large Language Models (LLMs) like GPT are state-of-the-art text generation models that provide significant assistance in daily routines. However, LLM execution is inherently sequential, since they only produce one token at a time, thus incurring low hardware utilization on modern GPUs. Batching and speculative decoding are two techniques to improve GPU hardware utilization in LLM inference. To study their synergy, we implement a prototype implementation and perform an extensive characterization analysis on various LLM models and GPU architectures. We observe that the optimal speculation length depends on the batch size used. We analyze the key observation and build a quantitative model to explain it. Based on our analysis, we propose a new adaptive speculative decoding strategy that chooses the optimal speculation length for different batch sizes. Our evaluations show that our proposed method can achieve equal or better performance than the state-of-the-art speculation decoding schemes with fixed speculation length. △ Less

Submitted 28 October, 2023; originally announced October 2023.

Adaptive Gating in Mixture-of-Experts based Language Models

Authors: Jiamin Li, Qiang Su, Yitao Yang, Yimin Jiang, Cong Wang, Hong Xu

Abstract: Large language models, such as OpenAI's ChatGPT, have demonstrated exceptional language understanding capabilities in various NLP tasks. Sparsely activated mixture-of-experts (MoE) has emerged as a promising solution for scaling models while maintaining a constant number of computational operations. Existing MoE model adopts a fixed gating network where each token is computed by the same number of… ▽ More Large language models, such as OpenAI's ChatGPT, have demonstrated exceptional language understanding capabilities in various NLP tasks. Sparsely activated mixture-of-experts (MoE) has emerged as a promising solution for scaling models while maintaining a constant number of computational operations. Existing MoE model adopts a fixed gating network where each token is computed by the same number of experts. However, this approach contradicts our intuition that the tokens in each sequence vary in terms of their linguistic complexity and, consequently, require different computational costs. Little is discussed in prior research on the trade-off between computation per token and model performance. This paper introduces adaptive gating in MoE, a flexible training strategy that allows tokens to be processed by a variable number of experts based on expert probability distribution. The proposed framework preserves sparsity while improving training efficiency. Additionally, curriculum learning is leveraged to further reduce training time. Extensive experiments on diverse NLP tasks show that adaptive gating reduces at most 22.5% training time while maintaining inference quality. Moreover, we conduct a comprehensive analysis of the routing decisions and present our insights when adaptive gating is used. △ Less

Submitted 11 October, 2023; originally announced October 2023.

ReFlow-TTS: A Rectified Flow Model for High-fidelity Text-to-Speech

Authors: Wenhao Guan, Qi Su, Haodong Zhou, Shiyu Miao, Xingjia Xie, Lin Li, Qingyang Hong

Abstract: The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous sampling steps, resulting in prolonged sampling time required to synthesize high-quality speech. This drawback hinders its practical applicability in real-world sc… ▽ More The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous sampling steps, resulting in prolonged sampling time required to synthesize high-quality speech. This drawback hinders its practical applicability in real-world scenarios. In this paper, we introduce ReFlow-TTS, a novel rectified flow based method for speech synthesis with high-fidelity. Specifically, our ReFlow-TTS is simply an Ordinary Differential Equation (ODE) model that transports Gaussian distribution to the ground-truth Mel-spectrogram distribution by straight line paths as much as possible. Furthermore, our proposed approach enables high-quality speech synthesis with a single sampling step and eliminates the need for training a teacher model. Our experiments on LJSpeech Dataset show that our ReFlow-TTS method achieves the best performance compared with other diffusion based models. And the ReFlow-TTS with one step sampling achieves competitive performance compared with existing one-step TTS models. △ Less

Submitted 31 January, 2024; v1 submitted 29 September, 2023; originally announced September 2023.

Comments: Accepted at ICASSP2024

PSR J1953+1844 probably being the descendant of an Ultra-compact X-ray binary

Authors: Z. L. Yang, J. L. Han, W. C. Jing, W. Q. Su

Abstract: PSR J1953+1844 (i.e., M71E) is a millisecond pulsar (MSP)in a 53 minute binary orbit discovered by the Five-hundred-meter Aperture Spherical radio Telescope. The mass function from pulsar timing is $2.3\times10^{-7}$ $M_\odot$. The possible redback origin of this system has been discussed by Pan et al. We discuss here an alternative evolution track for this binary system, namely that PSR J1953+184… ▽ More PSR J1953+1844 (i.e., M71E) is a millisecond pulsar (MSP)in a 53 minute binary orbit discovered by the Five-hundred-meter Aperture Spherical radio Telescope. The mass function from pulsar timing is $2.3\times10^{-7}$ $M_\odot$. The possible redback origin of this system has been discussed by Pan et al. We discuss here an alternative evolution track for this binary system, namely that PSR J1953+1844 is a descendant of an ultra-compact X-ray binary (UCXB), which has a hydrogen-poor donor accreting onto a neutron star (NS) with an orbital period of $\leq1$ hr. We noticed that some of UCXB systems hold an accreting millisecond X-ray pulsars (AMXPs) and a donor with a mass of about 0.01 M$_\odot$. M71E has a very similar orbit to those of AMXPs, indicating that it might be evolved from a UCXB similar to PSR J1653--0158. The companion star of M71E should be significantly bloated and it most probably has a carbon and oxygen composition, otherwise a low inclination angle of the orbit is required for a helium companion. The discovery of this M71E binary system may shed light on when and how an NS in a UCXBs turns into a radio pulsar. △ Less

Submitted 21 October, 2023; v1 submitted 28 September, 2023; originally announced September 2023.

Comments: Accepted for publication in ApJL. 5 pages, 2 figures

Journal ref: ApJL 956 L39 (2023)

Mapping tidal flat topography using time-series Sentinel-2 images and ICESat-2 data: A case study in Cixi City

Authors: Xiucheng Zheng, Bin Zhou, Hui Lei, Qianqian Su, Yuxuan Jin

Abstract: Tidal flat topography provides crucial insights for understanding tidal flats and their dynamic evolution. However, the wide-ranging and rapidly changing nature of tidal flats, which are periodically submerged in shallow water, pose challenges for many current monitoring methods in terms of both efficiency and precision. In this study, we considered the dynamic process of tidal flat submergence an… ▽ More Tidal flat topography provides crucial insights for understanding tidal flats and their dynamic evolution. However, the wide-ranging and rapidly changing nature of tidal flats, which are periodically submerged in shallow water, pose challenges for many current monitoring methods in terms of both efficiency and precision. In this study, we considered the dynamic process of tidal flat submergence and utilized time-series Sentinel-2 images on Google Earth Engine (GEE) to calculate the tidal flat exposure frequency. This information was used to determine the spatial extent of the tidal flats, and subsequently, by employing ICESat-2 data, we established a 1D-linear regression model based on elevation and frequency values, which realizes the inversion of the tidal flat elevation within Cixi City. The study shows the following: (1) the tidal flat exposure frequency and ICESat-2 elevation data exhibit a strong positive correlation (R2=0.85); (2) the tidal flat area within Cixi City is 115.81 km2, and the overall accuracy is 95.36%; and (3) the elevation range of the tidal flats in the study area is between -0.42 and 2.73 m, and the mean absolute error (MAE) is 0.24 m. Additionally, we consider that the temporal resolution of remote sensing imagery plays a crucial role in determining the accuracy of the elevation inversion, and we found that higher tidal flats exhibit better inversion accuracy than lower tidal flats. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Delete: Deep Lead Optimization Enveloped in Protein Pocket through Unified Deleting Strategies and a Structure-aware Network

Authors: Haotian Zhang, Huifeng Zhao, Xujun Zhang, Qun Su, Hongyan Du, Chao Shen, Zhe Wang, Dan Li, Peichen Pan, Guangyong Chen, Yu Kang, Chang-yu Hsieh, Tingjun Hou

Abstract: Drug discovery is a highly complicated process, and it is unfeasible to fully commit it to the recently developed molecular generation methods. Deep learning-based lead optimization takes expert knowledge as a starting point, learning from numerous historical cases about how to modify the structure for better drug-forming properties. However, compared with the more established de novo generation s… ▽ More Drug discovery is a highly complicated process, and it is unfeasible to fully commit it to the recently developed molecular generation methods. Deep learning-based lead optimization takes expert knowledge as a starting point, learning from numerous historical cases about how to modify the structure for better drug-forming properties. However, compared with the more established de novo generation schemes, lead optimization is still an area that requires further exploration. Previously developed models are often limited to resolving one (or few) certain subtask(s) of lead optimization, and most of them can only generate the two-dimensional structures of molecules while disregarding the vital protein-ligand interactions based on the three-dimensional binding poses. To address these challenges, we present a novel tool for lead optimization, named Delete (Deep lead optimization enveloped in protein pocket). Our model can handle all subtasks of lead optimization involving fragment growing, linking, and replacement through a unified deleting (masking) strategy, and is aware of the intricate pocket-ligand interactions through the geometric design of networks. Statistical evaluations and case studies conducted on individual subtasks demonstrate that Delete has a significant ability to produce molecules with superior binding affinities to protein targets and reasonable drug-likeness from given fragments or atoms. This feature may assist medicinal chemists in developing not only me-too/me-better products from existing drugs but also hit-to-lead for first-in-class drugs in a highly efficient manner. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Verifiable Data Sharing Scheme for Dynamic Multi-Owner Setting

Authors: Jing Zhao, Qianqian Su

Abstract: One of scenarios in data-sharing applications is that files are managed by multiple owners, and the list of file owners may change dynamically. However, most existing solutions to this problem rely on trusted third parties and have complicated signature permission processes, resulting in additional overhead. Therefore, we propose a verifiable data-sharing scheme (VDS-DM) that can support dynamic m… ▽ More One of scenarios in data-sharing applications is that files are managed by multiple owners, and the list of file owners may change dynamically. However, most existing solutions to this problem rely on trusted third parties and have complicated signature permission processes, resulting in additional overhead. Therefore, we propose a verifiable data-sharing scheme (VDS-DM) that can support dynamic multi-owner scenarios. We introduce a management entity that combines linear secret-sharing technology, multi-owner signature generation, and an aggregation technique to allow multi-owner file sharing. Without the help of trusted third parties, VDS-DM can update file signatures for dynamically changing file owners, which helps save communication overhead. Moreover, users independently verify the integrity of files without resorting to a third party. We analyse the security of VDS-DM through a security game. Finally, we conduct enough simulation experiments and the outcomes of experimental demonstrate the feasibility of VDS-DM. △ Less

Submitted 31 July, 2023; originally announced August 2023.

Automatic lobe segmentation using attentive cross entropy and end-to-end fissure generation

Authors: Qi Su, Na Wang, Jiawen Xie, Yinan Chen, Xiaofan Zhang

Abstract: The automatic lung lobe segmentation algorithm is of great significance for the diagnosis and treatment of lung diseases, however, which has great challenges due to the incompleteness of pulmonary fissures in lung CT images and the large variability of pathological features. Therefore, we propose a new automatic lung lobe segmentation framework, in which we urge the model to pay attention to the a… ▽ More The automatic lung lobe segmentation algorithm is of great significance for the diagnosis and treatment of lung diseases, however, which has great challenges due to the incompleteness of pulmonary fissures in lung CT images and the large variability of pathological features. Therefore, we propose a new automatic lung lobe segmentation framework, in which we urge the model to pay attention to the area around the pulmonary fissure during the training process, which is realized by a task-specific loss function. In addition, we introduce an end-to-end pulmonary fissure generation method in the auxiliary pulmonary fissure segmentation task, without any additional network branch. Finally, we propose a registration-based loss function to alleviate the convergence difficulty of the Dice loss supervised pulmonary fissure segmentation task. We achieve 97.83% and 94.75% dice scores on our private dataset STLB and public LUNA16 dataset respectively. △ Less

Submitted 24 July, 2023; originally announced July 2023.

Comments: 5 pages, 3 figures, published to 'IEEE International Symposium on Biomedical Imaging (ISBI) 2023'

Deep Directly-Trained Spiking Neural Networks for Object Detection

Authors: Qiaoyi Su, Yuhong Chou, Yifan Hu, Jianing Li, Shijie Mei, Ziyang Zhang, Guoqi Li

Abstract: Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode information in spatiotemporal dynamics. Recently, deep SNNs trained directly have shown great success in achieving high performance on classification tasks with very few time steps. However, how to design a directly-trained SNN for the regression task of object detection still remains a challenging problem. To ad… ▽ More Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode information in spatiotemporal dynamics. Recently, deep SNNs trained directly have shown great success in achieving high performance on classification tasks with very few time steps. However, how to design a directly-trained SNN for the regression task of object detection still remains a challenging problem. To address this problem, we propose EMS-YOLO, a novel directly-trained SNN framework for object detection, which is the first trial to train a deep SNN with surrogate gradients for object detection rather than ANN-SNN conversion strategies. Specifically, we design a full-spike residual block, EMS-ResNet, which can effectively extend the depth of the directly-trained SNN with low power consumption. Furthermore, we theoretically analyze and prove the EMS-ResNet could avoid gradient vanishing or exploding. The results demonstrate that our approach outperforms the state-of-the-art ANN-SNN conversion methods (at least 500 time steps) in extremely fewer time steps (only 4 time steps). It is shown that our model could achieve comparable performance to the ANN with the same architecture while consuming 5.83 times less energy on the frame-based COCO Dataset and the event-based Gen1 Dataset. △ Less

Submitted 26 July, 2023; v1 submitted 21 July, 2023; originally announced July 2023.

Comments: Accepted by ICCV2023

FAST pulsar database: I. Polarization profiles of 682 pulsars

Authors: P. F. Wang, J. L. Han, J. Xu, C. Wang, Y. Yan, W. C. Jing, W. Q. Su, D. J. Zhou, T. Wang

Abstract: Pulsar polarization profiles are very basic database for understanding the emission processes in pulsar magnetosphere. After careful polarization calibration of the 19-beam L-band receiver and verification of beam-offset observation results, we obtain polarization profiles of 682 pulsars from observations by the Five-hundred-meter Aperture Spherical radio Telescope (FAST) during the survey tests f… ▽ More Pulsar polarization profiles are very basic database for understanding the emission processes in pulsar magnetosphere. After careful polarization calibration of the 19-beam L-band receiver and verification of beam-offset observation results, we obtain polarization profiles of 682 pulsars from observations by the Five-hundred-meter Aperture Spherical radio Telescope (FAST) during the survey tests for the Galactic Plan Pulsar Snapshot (GPPS) survey and other normal FAST projects. Among them, polarization profiles of about 460 pulsars are observed for the first time. The profiles exhibit diverse features. Some pulsars have a polarization position angle curve with a good S-shaped swing, and some with orthogonal modes; some have components with highly linearly components or strong circularly polarized components; some have a very wide profile, coming from an aligned rotator, and some have an interpulse from a perpendicular rotator; some wide profiles are caused by interstellar scattering. We derive geometry parameters for 190 pulsars from the S-shaped position angle curves or with orthogonal modes. We find that the linear and circular polarization or the widths of pulse profiles have various frequency dependencies. Pulsars with large fraction of linear polarization are more likely to have a large Edot. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Comments: 38 pages, 23 figures. All the polarized pulse profiles presented in this paper are available on the webpage http://zmtt.bao.ac.cn/psr-fast/

Fine-grained Text-Video Retrieval with Frozen Image Encoders

Authors: Zuozhuo Dai, Fangtao Shao, Qingkun Su, Zilong Dong, Siyu Zhu

Abstract: State-of-the-art text-video retrieval (TVR) methods typically utilize CLIP and cosine similarity for efficient retrieval. Meanwhile, cross attention methods, which employ a transformer decoder to compute attention between each text query and all frames in a video, offer a more comprehensive interaction between text and videos. However, these methods lack important fine-grained spatial information… ▽ More State-of-the-art text-video retrieval (TVR) methods typically utilize CLIP and cosine similarity for efficient retrieval. Meanwhile, cross attention methods, which employ a transformer decoder to compute attention between each text query and all frames in a video, offer a more comprehensive interaction between text and videos. However, these methods lack important fine-grained spatial information as they directly compute attention between text and video-level tokens. To address this issue, we propose CrossTVR, a two-stage text-video retrieval architecture. In the first stage, we leverage existing TVR methods with cosine similarity network for efficient text/video candidate selection. In the second stage, we propose a novel decoupled video text cross attention module to capture fine-grained multimodal information in spatial and temporal dimensions. Additionally, we employ the frozen CLIP model strategy in fine-grained retrieval, enabling scalability to larger pre-trained vision models like ViT-G, resulting in improved retrieval performance. Experiments on text video retrieval datasets demonstrate the effectiveness and scalability of our proposed CrossTVR compared to state-of-the-art approaches. △ Less

Submitted 13 July, 2023; originally announced July 2023.

Strong and weak pulsar radio emission due to thunderstorms and raindrops of particles in the magnetosphere

Authors: X. Chen, Y. Yan, J. L. Han, C. Wang, P. F. Wang, W. C. Jing, K. J. Lee, B. Zhang, R. X. Xu, T. Wang, Z. L. Yang, W. Q. Su, N. N. Cai, W. Y. Wang, G. J. Qiao, J. Xu, D. J. Zhou

Abstract: Pulsars radiate radio signals when they rotate. However, some old pulsars often stop radiating for some periods. The underlying mechanism remains unknown, while the magnetosphere during nulling phases is hard to probe due to the absence of emission measurement. Here we report the detection and accurate polarization measurements of sporadic weak narrow dwarf pulses detected in the ordinary nulling… ▽ More Pulsars radiate radio signals when they rotate. However, some old pulsars often stop radiating for some periods. The underlying mechanism remains unknown, while the magnetosphere during nulling phases is hard to probe due to the absence of emission measurement. Here we report the detection and accurate polarization measurements of sporadic weak narrow dwarf pulses detected in the ordinary nulling state of pulsar B2111+46 via the Five-Hundred-Meter Aperture Spherical radio Telescope (FAST). Further analysis shows that their polarization angles follow the average polarization angle curve of normal pulses, suggesting no change of magnetic field structure in the emission region in the two emission states. Whereas radio emission of normal individual pulses is radiated by a thunderstorm of particles produced by copious discharges in regularly formed gaps, dwarf pulses are produced by one or a few raindrops of particles generated by pair production in a fragile gap of this near-death pulsar. △ Less

Submitted 17 August, 2023; v1 submitted 21 June, 2023; originally announced June 2023.

Comments: 37 pages, 15 figures. Authors version. Great FAST pulsar data. Share full-text access: https://rdcu.be/djLSL

Journal ref: Published online by nature astronomy: 17 August 2023

Quantum simulation of Hofstadter butterfly with synthetic gauge fields on two-dimensional superconducting-qubit lattices

Authors: Wei Feng, Dexi Shao, Guo-Qiang Zhang, Qi-Ping Su, Jun-Xiang Zhang, Chui-Ping Yang

Abstract: Motivated by recent realizations of two-dimensional (2D) superconducting-qubit lattices, we propose a protocol to simulate Hofstadter butterfly with synthetic gauge fields in superconducting circuits. Based on the existing 2D superconducting-qubit lattices, we construct a generalized Hofstadter model on zigzag lattices, which has a fractal energy spectrum similar to the original Hofstadter butterf… ▽ More Motivated by recent realizations of two-dimensional (2D) superconducting-qubit lattices, we propose a protocol to simulate Hofstadter butterfly with synthetic gauge fields in superconducting circuits. Based on the existing 2D superconducting-qubit lattices, we construct a generalized Hofstadter model on zigzag lattices, which has a fractal energy spectrum similar to the original Hofstadter butterfly. By periodically modulating the resonant frequencies of qubits, we engineer a synthetic gauge field to mimic the generalized Hofstadter Hamiltonian. A spectroscopic method is used to demonstrate the Hofstadter butterfly from the time evolutions of experimental observables. We numerically simulate the dynamics of the system with realistic parameters, and the results show a butterfly spectrum clearly. Our proposal provides a promising way to realize the Hofstadter butterfly on the latest 2D superconducting-qubit lattices and will stimulate the quantum simulation of novel properties induced by magnetic fields in superconducting circuits. △ Less

Submitted 19 June, 2023; originally announced June 2023.

FLSL: Feature-level Self-supervised Learning

Authors: Qing Su, Anton Netchaev, Hai Li, Shihao Ji

Abstract: Current self-supervised learning (SSL) methods (e.g., SimCLR, DINO, VICReg,MOCOv3) target primarily on representations at instance level and do not generalize well to dense prediction tasks, such as object detection and segmentation.Towards aligning SSL with dense predictions, this paper demonstrates for the first time the underlying mean-shift clustering process of Vision Transformers (ViT), whic… ▽ More Current self-supervised learning (SSL) methods (e.g., SimCLR, DINO, VICReg,MOCOv3) target primarily on representations at instance level and do not generalize well to dense prediction tasks, such as object detection and segmentation.Towards aligning SSL with dense predictions, this paper demonstrates for the first time the underlying mean-shift clustering process of Vision Transformers (ViT), which aligns well with natural image semantics (e.g., a world of objects and stuffs). By employing transformer for joint embedding and clustering, we propose a two-level feature clustering SSL method, coined Feature-Level Self-supervised Learning (FLSL). We present the formal definition of the FLSL problem and construct the objectives from the mean-shift and k-means perspectives. We show that FLSL promotes remarkable semantic cluster representations and learns an embedding scheme amenable to intra-view and inter-view feature clustering. Experiments show that FLSL yields significant improvements in dense prediction tasks, achieving 44.9 (+2.8)% AP and 46.5% AP in object detection, as well as 40.8 (+2.3)% AP and 42.1% AP in instance segmentation on MS-COCO, using Mask R-CNN with ViT-S/16 and ViT-S/8 as backbone, respectively. FLSL consistently outperforms existing SSL methods across additional benchmarks, including UAV17 object detection on UAVDT, and video instance segmentation on DAVIS 2017.We conclude by presenting visualization and various ablation studies to better understand the success of FLSL. The source code is available at https://github.com/ISL-CV/FLSL. △ Less

Submitted 6 November, 2023; v1 submitted 9 June, 2023; originally announced June 2023.

Comments: Published as a main conference paper at NeurIPS 2023

Simple realization of a hybrid controlled-controlled-Z gate with photonic control qubits encoded via eigenstates of the photon-number parity operator

Authors: Qi-Ping Su, Liang Bin, Yu Zhang, Chui-Ping Yang

Abstract: We propose a simple method to realize a hybrid controlled-controlled-Z (CCZ) gate with two photonic qubits simultaneously controlling a superconducting (SC) target qubit, by employing two microwave cavities coupled to a SC ququart (a four-level quantum system). In this proposal, each control qubit is a photonic qubit, which is encoded by two arbitrary orthogonal eigenstates (with eigenvalues 1 and… ▽ More We propose a simple method to realize a hybrid controlled-controlled-Z (CCZ) gate with two photonic qubits simultaneously controlling a superconducting (SC) target qubit, by employing two microwave cavities coupled to a SC ququart (a four-level quantum system). In this proposal, each control qubit is a photonic qubit, which is encoded by two arbitrary orthogonal eigenstates (with eigenvalues 1 and -1, respectively) of the photon-number parity operator. Since the two arbitrary encoding states can take various quantum states, this proposal can be applied to realize the hybrid CCZ gate, for which the two control photonic qubits can have various encodings. The gate realization is quite simple because only a basic operation is needed. During the gate operation, the higher energy intermediate levels of the ququart are not occupied, and, thus, decoherence from these levels is greatly suppressed. We further discuss how to apply this gate to generate a hybrid Greenberger-Horne-Zeilinger (GHZ) entangled state of a SC qubit and two photonic qubits, which takes a general form. As an example, our numerical simulation demonstrates that high-fidelity generation of a cat-cat-spin hybrid GHZ state is feasible within current circuit QED technology. This proposal is quite general, which can be applied to realize the hybrid CCZ gate as well as to prepare various hybrid GHZ states of a matter qubit and two photonic qubits in other physical systems, such as two microwave or optical cavities coupled to a four-level natural or artificial atom. △ Less

Submitted 3 June, 2023; originally announced June 2023.

Comments: 7 pages, 4 figures, 1 table

Journal ref: Appl. Phys. Lett. 122, 114001 (2023)

One-step implementation of a multi-target-qubit controlled-phase gate with photonic qubits encoded via eigenstates of the photon-number parity operator

Authors: Qi-Ping Su, Liang Bin, Yu Zhang, Chui-Ping Yang

Abstract: In recent years, quantum state engineering and quantum information processing using microwave fields and photons have received increasing attention. In addition, multiqubit gates play an important role in quantum information processing. In this work, we propose to encode a photonic qubit via two arbitrary orthogonal eigenstates (with eigenvalues 1 and -1, respectively) of the photon-number parity… ▽ More In recent years, quantum state engineering and quantum information processing using microwave fields and photons have received increasing attention. In addition, multiqubit gates play an important role in quantum information processing. In this work, we propose to encode a photonic qubit via two arbitrary orthogonal eigenstates (with eigenvalues 1 and -1, respectively) of the photon-number parity operator. With such encoding, we then present a single-step method to realize a multi-target-qubit controlled-phase gate with one photonic qubit simultaneously controlling n-1 target photonic qubits, by employing n microwave cavities coupled to one superconducting flux qutrit. This proposal can be applied not only to implement nonhybrid multi-target-qubit controlled-phase gates using photonic qubits with various encodings, but also to realize hybrid multi-target-qubit controlled-phase gates using photonic qubits with different encodings. The gate realization requires only a single-step operation. The gate operation time does not increase with the number of target qubits. Because the qutrit remains in the ground state during the entire operation, decoherence from the qutrit is greatly suppressed. As an application, we show how to apply this gate to generate a multicavity Greenberger-Horne-Zeilinger (GHZ) entangled state with general expression. Depending on the specific encodings, we further discuss the preparation of several nonhybrid and hybrid GHZ entangled states of multiple cavities. We numerically investigate the circuit-QED experimental feasibility of creating a three-cavity spin-coherent hybrid GHZ state. This proposal can be extended to accomplish the same tasks in a wide range of physical systems, such as multiple microwave or optical cavities coupled to a three-level natural or artificial atom. △ Less

Submitted 3 June, 2023; originally announced June 2023.

Comments: 14 pages, 7 figures, 1 table

Journal ref: Physical Review A 107, 032616 (2023)

Incorporating Deep Syntactic and Semantic Knowledge for Chinese Sequence Labeling with GCN

Authors: Xuemei Tang, Jun Wang, Qi Su

Abstract: Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded in syntactic and semantic features for Chinese sequence labeling tasks. In this paper, we propose a novel framework to encode syntactic structure features and semantic information… ▽ More Recently, it is quite common to integrate Chinese sequence labeling results to enhance syntactic and semantic parsing. However, little attention has been paid to the utility of hierarchy and structure information encoded in syntactic and semantic features for Chinese sequence labeling tasks. In this paper, we propose a novel framework to encode syntactic structure features and semantic information for Chinese sequence labeling tasks with graph convolutional networks (GCN). Experiments on five benchmark datasets, including Chinese word segmentation and part-of-speech tagging, demonstrate that our model can effectively improve the performance of Chinese labeling tasks. △ Less

Submitted 3 June, 2023; originally announced June 2023.

Comments: 10 pages,3 Figures, 6 Tables

The FAST Galactic Plane Pulsar Snapshot Survey: III. Timing results of 30 FAST-GPPS discovered pulsars

Authors: W. Q. Su, J. L. Han, P. F. Wang, J. P. Yuan, Chen Wang, D. J. Zhou, Tao Wang, Yi Yan, W. C. Jing, Z. L. Yang, N. N. Cai, Xue Chen, Jun Xu, Lang Xie, H. G. Wang, R. X. Xu, X. P. You

Abstract: Timing observations are crucial for determining the basic parameters of newly discovered pulsars. Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST) with the L-band 19-beam receiver covering the frequency range of 1.0--1.5 GHz, the FAST Galactic Plane Pulsar Snapshot (GPPS) Survey has discovered more than 600 faint pulsars with flux densities of only a few or a few tens of $μ$J… ▽ More Timing observations are crucial for determining the basic parameters of newly discovered pulsars. Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST) with the L-band 19-beam receiver covering the frequency range of 1.0--1.5 GHz, the FAST Galactic Plane Pulsar Snapshot (GPPS) Survey has discovered more than 600 faint pulsars with flux densities of only a few or a few tens of $μ$Jy at 1.25 GHz. To obtain accurate position, spin parameters and dispersion measure of a pulsar, and to calculate derived parameters such as the characteristic age and surface magnetic field, we collect available FAST pulsar data obtained either through targeted follow-up observations or through coincidental survey observations with one of the 19 beams of the receiver. From these data we obtain time of arrival (TOA) measurements for 30 newly discovered pulsars as well as for 13 known pulsars. We demonstrate that the TOA measurements acquired by the FAST from any beams of the receiver in any observation mode (e.g. the tracking mode or the snapshot mode) can be combined to get timing solutions. We update the ephemerides of 13 previously known pulsars and obtain the first phase-coherent timing results for 30 isolated pulsars discovered in the FAST GPPS Survey. Notably, PSR J1904+0853 is an isolated millisecond pulsar, PSR J1906+0757 is a disrupted recycled pulsar, and PSR J1856+0211 has a long period of 9.89 s that can constrain pulsar death lines. Based on these timing solutions, all available FAST data have been added together to obtain the best pulse profiles for these pulsars. △ Less

Submitted 11 October, 2023; v1 submitted 26 May, 2023; originally announced May 2023.

Journal ref: Monthly Notices of the Royal Astronomical Society, Volume 526, Issue 2, December 2023, Pages 2645-2656

Learning Summary-Worthy Visual Representation for Abstractive Summarization in Video

Authors: Zenan Xu, Xiaojun Meng, Yasheng Wang, Qinliang Su, Zexuan Qiu, Xin Jiang, Qun Liu

Abstract: Multimodal abstractive summarization for videos (MAS) requires generating a concise textual summary to describe the highlights of a video according to multimodal resources, in our case, the video content and its transcript. Inspired by the success of the large-scale generative pre-trained language model (GPLM) in generating high-quality textual content (e.g., summary), recent MAS methods have prop… ▽ More Multimodal abstractive summarization for videos (MAS) requires generating a concise textual summary to describe the highlights of a video according to multimodal resources, in our case, the video content and its transcript. Inspired by the success of the large-scale generative pre-trained language model (GPLM) in generating high-quality textual content (e.g., summary), recent MAS methods have proposed to adapt the GPLM to this task by equipping it with the visual information, which is often obtained through a general-purpose visual feature extractor. However, the generally extracted visual features may overlook some summary-worthy visual information, which impedes model performance. In this work, we propose a novel approach to learning the summary-worthy visual representation that facilitates abstractive summarization. Our method exploits the summary-worthy information from both the cross-modal transcript data and the knowledge that distills from the pseudo summary. Extensive experiments on three public multimodal datasets show that our method outperforms all competing baselines. Furthermore, with the advantages of summary-worthy visual information, our model can have a significant improvement on small datasets or even datasets with limited training data. △ Less

Submitted 8 May, 2023; originally announced May 2023.

Comments: Accepted by IJCAI-2023