Showing 1–43 of 43 results for author: Xing, B

A simple model for short-range ordering kinetics in multi-principal element alloys

Authors: Anas Abu-Odeh, Bin Xing, Penghui Cao, Blas Pedro Uberuaga, Mark Asta

Abstract: Short-range ordering (SRO) in multi-principal element alloys influences material properties such as strength and corrosion. While some degree of SRO is expected at equilibrium, predicting the kinetics of its formation is challenging. We present a simplified isothermal concentration-wave (CW) model to estimate an effective relaxation time of SRO formation. Estimates from the CW model agree to withi… ▽ More Short-range ordering (SRO) in multi-principal element alloys influences material properties such as strength and corrosion. While some degree of SRO is expected at equilibrium, predicting the kinetics of its formation is challenging. We present a simplified isothermal concentration-wave (CW) model to estimate an effective relaxation time of SRO formation. Estimates from the CW model agree to within a factor of five with relaxation times obtained from kinetic Monte Carlo (kMC) simulations when above the highest ordering instability temperature. The advantage of the CW model is that it only requires mobility and thermodynamic parameters, which are readily obtained from alloy mobility databases and Metropolis Monte Carlo simulations, respectively. The simple parameterization of the CW model and its analytical nature make it an attractive tool for the design of processing conditions to promote or suppress SRO in multicomponent alloys. △ Less

Submitted 30 June, 2024; originally announced July 2024.

Comments: 12 pages, 4 figures, 2 tables

Journal ref: Scripta Materialia, Volume 252, 2024, 116224

MaIL: Improving Imitation Learning with Mamba

Authors: Xiaogang Jia, Qian Wang, Atalay Donat, Bowen Xing, Ge Li, Hongyi Zhou, Onur Celik, Denis Blessing, Rudolf Lioutikov, Gerhard Neumann

Abstract: This work introduces Mamba Imitation Learning (MaIL), a novel imitation learning (IL) architecture that offers a computationally efficient alternative to state-of-the-art (SoTA) Transformer policies. Transformer-based policies have achieved remarkable results due to their ability in handling human-recorded data with inherently non-Markovian behavior. However, their high performance comes with the… ▽ More This work introduces Mamba Imitation Learning (MaIL), a novel imitation learning (IL) architecture that offers a computationally efficient alternative to state-of-the-art (SoTA) Transformer policies. Transformer-based policies have achieved remarkable results due to their ability in handling human-recorded data with inherently non-Markovian behavior. However, their high performance comes with the drawback of large models that complicate effective training. While state space models (SSMs) have been known for their efficiency, they were not able to match the performance of Transformers. Mamba significantly improves the performance of SSMs and rivals against Transformers, positioning it as an appealing alternative for IL policies. MaIL leverages Mamba as a backbone and introduces a formalism that allows using Mamba in the encoder-decoder structure. This formalism makes it a versatile architecture that can be used as a standalone policy or as part of a more advanced architecture, such as a diffuser in the diffusion process. Extensive evaluations on the LIBERO IL benchmark and three real robot experiments show that MaIL: i) outperforms Transformers in all LIBERO tasks, ii) achieves good performance even with small datasets, iii) is able to effectively process multi-modal sensory inputs, iv) is more robust to input noise compared to Transformers. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Paths towards time evolution with larger neural-network quantum states

Authors: Wenxuan Zhang, Bo Xing, Xiansong Xu, Dario Poletti

Abstract: In recent years, the neural-network quantum states method has been investigated to study the ground state and the time evolution of many-body quantum systems. Here we expand on the investigation and consider a quantum quench from the paramagnetic to the anti-ferromagnetic phase in the tilted Ising model. We use two types of neural networks, a restricted Boltzmann machine and a feed-forward neural… ▽ More In recent years, the neural-network quantum states method has been investigated to study the ground state and the time evolution of many-body quantum systems. Here we expand on the investigation and consider a quantum quench from the paramagnetic to the anti-ferromagnetic phase in the tilted Ising model. We use two types of neural networks, a restricted Boltzmann machine and a feed-forward neural network. We show that for both types of networks, the projected time-dependent variational Monte Carlo (p-tVMC) method performs better than the non-projected approach. We further demonstrate that one can use K-FAC or minSR in conjunction with p-tVMC to reduce the computational complexity of the stochastic reconfiguration approach, thus allowing the use of these techniques for neural networks with more parameters. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 13 pages, 7 figures,

Identity-free Artificial Emotional Intelligence via Micro-Gesture Understanding

Authors: Rong Gao, Xin Liu, Bohao Xing, Zitong Yu, Bjorn W. Schuller, Heikki Kälviäinen

Abstract: In this work, we focus on a special group of human body language -- the micro-gesture (MG), which differs from the range of ordinary illustrative gestures in that they are not intentional behaviors performed to convey information to others, but rather unintentional behaviors driven by inner feelings. This characteristic introduces two novel challenges regarding micro-gestures that are worth rethin… ▽ More In this work, we focus on a special group of human body language -- the micro-gesture (MG), which differs from the range of ordinary illustrative gestures in that they are not intentional behaviors performed to convey information to others, but rather unintentional behaviors driven by inner feelings. This characteristic introduces two novel challenges regarding micro-gestures that are worth rethinking. The first is whether strategies designed for other action recognition are entirely applicable to micro-gestures. The second is whether micro-gestures, as supplementary data, can provide additional insights for emotional understanding. In recognizing micro-gestures, we explored various augmentation strategies that take into account the subtle spatial and brief temporal characteristics of micro-gestures, often accompanied by repetitiveness, to determine more suitable augmentation methods. Considering the significance of temporal domain information for micro-gestures, we introduce a simple and efficient plug-and-play spatiotemporal balancing fusion method. We not only studied our method on the considered micro-gesture dataset but also conducted experiments on mainstream action datasets. The results show that our approach performs well in micro-gesture recognition and on other datasets, achieving state-of-the-art performance compared to previous micro-gesture recognition methods. For emotional understanding based on micro-gestures, we construct complex emotional reasoning scenarios. Our evaluation, conducted with large language models, shows that micro-gestures play a significant and positive role in enhancing comprehensive emotional understanding. The scenarios we developed can be extended to other micro-gesture-based tasks such as deception detection and interviews. We confirm that our new insights contribute to advancing research in micro-gesture and emotional artificial intelligence. △ Less

Submitted 21 May, 2024; originally announced May 2024.

HC$^2$L: Hybrid and Cooperative Contrastive Learning for Cross-lingual Spoken Language Understanding

Authors: Bowen Xing, Ivor W. Tsang

Abstract: State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data. However, it ignores the precious intent/slot labels, whose label information is promising to help capture the label-aware semantics structure and then leverage su… ▽ More State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data. However, it ignores the precious intent/slot labels, whose label information is promising to help capture the label-aware semantics structure and then leverage supervised contrastive learning to improve both source and target languages' semantics. In this paper, we propose Hybrid and Cooperative Contrastive Learning to address this problem. Apart from cross-lingual unsupervised contrastive learning, we design a holistic approach that exploits source language supervised contrastive learning, cross-lingual supervised contrastive learning and multilingual supervised contrastive learning to perform label-aware semantics alignments in a comprehensive manner. Each kind of supervised contrastive learning mechanism includes both single-task and joint-task scenarios. In our model, one contrastive learning mechanism's input is enhanced by others. Thus the total four contrastive learning mechanisms are cooperative to learn more consistent and discriminative representations in the virtuous cycle during the training process. Experiments show that our model obtains consistent improvements over 9 languages, achieving new state-of-the-art performance. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Comments: Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). arXiv admin note: text overlap with arXiv:2312.03716

Enhancing Micro Gesture Recognition for Emotion Understanding via Context-aware Visual-Text Contrastive Learning

Authors: Deng Li, Bohao Xing, Xin Liu

Abstract: Psychological studies have shown that Micro Gestures (MG) are closely linked to human emotions. MG-based emotion understanding has attracted much attention because it allows for emotion understanding through nonverbal body gestures without relying on identity information (e.g., facial and electrocardiogram data). Therefore, it is essential to recognize MG effectively for advanced emotion understan… ▽ More Psychological studies have shown that Micro Gestures (MG) are closely linked to human emotions. MG-based emotion understanding has attracted much attention because it allows for emotion understanding through nonverbal body gestures without relying on identity information (e.g., facial and electrocardiogram data). Therefore, it is essential to recognize MG effectively for advanced emotion understanding. However, existing Micro Gesture Recognition (MGR) methods utilize only a single modality (e.g., RGB or skeleton) while overlooking crucial textual information. In this letter, we propose a simple but effective visual-text contrastive learning solution that utilizes text information for MGR. In addition, instead of using handcrafted prompts for visual-text contrastive learning, we propose a novel module called Adaptive prompting to generate context-aware prompts. The experimental results show that the proposed method achieves state-of-the-art performance on two public datasets. Furthermore, based on an empirical study utilizing the results of MGR for emotion understanding, we demonstrate that using the textual results of MGR significantly improves performance by 6%+ compared to directly using video as input. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Comments: accepted by IEEE Signal Processing Letters

Journal ref: IEEE Signal Processing Letters (2024)

EALD-MLLM: Emotion Analysis in Long-sequential and De-identity videos with Multi-modal Large Language Model

Authors: Deng Li, Xin Liu, Bohao Xing, Baiqiang Xia, Yuan Zong, Bihan Wen, Heikki Kälviäinen

Abstract: Emotion AI is the ability of computers to understand human emotional states. Existing works have achieved promising progress, but two limitations remain to be solved: 1) Previous studies have been more focused on short sequential video emotion analysis while overlooking long sequential video. However, the emotions in short sequential videos only reflect instantaneous emotions, which may be deliber… ▽ More Emotion AI is the ability of computers to understand human emotional states. Existing works have achieved promising progress, but two limitations remain to be solved: 1) Previous studies have been more focused on short sequential video emotion analysis while overlooking long sequential video. However, the emotions in short sequential videos only reflect instantaneous emotions, which may be deliberately guided or hidden. In contrast, long sequential videos can reveal authentic emotions; 2) Previous studies commonly utilize various signals such as facial, speech, and even sensitive biological signals (e.g., electrocardiogram). However, due to the increasing demand for privacy, developing Emotion AI without relying on sensitive signals is becoming important. To address the aforementioned limitations, in this paper, we construct a dataset for Emotion Analysis in Long-sequential and De-identity videos called EALD by collecting and processing the sequences of athletes' post-match interviews. In addition to providing annotations of the overall emotional state of each video, we also provide the Non-Facial Body Language (NFBL) annotations for each player. NFBL is an inner-driven emotional expression and can serve as an identity-free clue to understanding the emotional state. Moreover, we provide a simple but effective baseline for further research. More precisely, we evaluate the Multimodal Large Language Models (MLLMs) with de-identification signals (e.g., visual, speech, and NFBLs) to perform emotion analysis. Our experimental results demonstrate that: 1) MLLMs can achieve comparable, even better performance than the supervised single-modal models, even in a zero-shot scenario; 2) NFBL is an important cue in long sequential emotion analysis. EALD will be available on the open-source platform. △ Less

Submitted 1 May, 2024; originally announced May 2024.

Sub-Adjacent Transformer: Improving Time Series Anomaly Detection with Reconstruction Error from Sub-Adjacent Neighborhoods

Authors: Wenzhen Yue, Xianghua Ying, Ruohao Guo, DongDong Chen, Ji Shi, Bowei Xing, Yuqing Zhu, Taiyan Chen

Abstract: In this paper, we present the Sub-Adjacent Transformer with a novel attention mechanism for unsupervised time series anomaly detection. Unlike previous approaches that rely on all the points within some neighborhood for time point reconstruction, our method restricts the attention to regions not immediately adjacent to the target points, termed sub-adjacent neighborhoods. Our key observation is th… ▽ More In this paper, we present the Sub-Adjacent Transformer with a novel attention mechanism for unsupervised time series anomaly detection. Unlike previous approaches that rely on all the points within some neighborhood for time point reconstruction, our method restricts the attention to regions not immediately adjacent to the target points, termed sub-adjacent neighborhoods. Our key observation is that owing to the rarity of anomalies, they typically exhibit more pronounced differences from their sub-adjacent neighborhoods than from their immediate vicinities. By focusing the attention on the sub-adjacent areas, we make the reconstruction of anomalies more challenging, thereby enhancing their detectability. Technically, our approach concentrates attention on the non-diagonal areas of the attention matrix by enlarging the corresponding elements in the training stage. To facilitate the implementation of the desired attention matrix pattern, we adopt linear attention because of its flexibility and adaptability. Moreover, a learnable mapping function is proposed to improve the performance of linear attention. Empirically, the Sub-Adjacent Transformer achieves state-of-the-art performance across six real-world anomaly detection benchmarks, covering diverse fields such as server monitoring, space exploration, and water treatment. △ Less

Submitted 27 April, 2024; originally announced April 2024.

Comments: IJCAI 2024

Tensor-Networks-based Learning of Probabilistic Cellular Automata Dynamics

Authors: Heitor P. Casagrande, Bo Xing, William J. Munro, Chu Guo, Dario Poletti

Abstract: Algorithms developed to solve many-body quantum problems, like tensor networks, can turn into powerful quantum-inspired tools to tackle problems in the classical domain. In this work, we focus on matrix product operators, a prominent numerical technique to study many-body quantum systems, especially in one dimension. It has been previously shown that such a tool can be used for classification, lea… ▽ More Algorithms developed to solve many-body quantum problems, like tensor networks, can turn into powerful quantum-inspired tools to tackle problems in the classical domain. In this work, we focus on matrix product operators, a prominent numerical technique to study many-body quantum systems, especially in one dimension. It has been previously shown that such a tool can be used for classification, learning of deterministic sequence-to-sequence processes and of generic quantum processes. We further develop a matrix product operator algorithm to learn probabilistic sequence-to-sequence processes and apply this algorithm to probabilistic cellular automata. This new approach can accurately learn probabilistic cellular automata processes in different conditions, even when the process is a probabilistic mixture of different chaotic rules. In addition, we find that the ability to learn these dynamics is a function of the bit-wise difference between the rules and whether one is much more likely than the other. △ Less

Submitted 17 April, 2024; originally announced April 2024.

Comments: 9 pages, 7 figures

A note on higher structures on the complexes associated to quiver algebras with applications to toupie algebras

Authors: Yuming Liu, Bohan Xing

Abstract: In this paper, we summarize a general method of transforming DG structures into higher structures on the various complexes related to the reduced bar resolution of a given quiver algebra using algebraic Morse theory. As an application, we describe the $A_\infty$-structures of toupie algebras. Additionally, for certain special toupie algebras, we also prove that their double homological duals are i… ▽ More In this paper, we summarize a general method of transforming DG structures into higher structures on the various complexes related to the reduced bar resolution of a given quiver algebra using algebraic Morse theory. As an application, we describe the $A_\infty$-structures of toupie algebras. Additionally, for certain special toupie algebras, we also prove that their double homological duals are isomorphic to their associated graded algebras. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Comments: 17pages

MSC Class: 16E45; 18G15

Exploiting Contextual Target Attributes for Target Sentiment Classification

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Existing PTLM-based models for TSC can be categorized into two groups: 1) fine-tuning-based models that adopt PTLM as the context encoder; 2) prompting-based models that transfer the classification task to the text/word generation task. In this paper, we present a new perspective of leveraging PTLM for TSC: simultaneously leveraging the merits of both language modeling and explicit target-context… ▽ More Existing PTLM-based models for TSC can be categorized into two groups: 1) fine-tuning-based models that adopt PTLM as the context encoder; 2) prompting-based models that transfer the classification task to the text/word generation task. In this paper, we present a new perspective of leveraging PTLM for TSC: simultaneously leveraging the merits of both language modeling and explicit target-context interactions via contextual target attributes. Specifically, we design the domain- and target-constrained cloze test, which can leverage the PTLMs' strong language modeling ability to generate the given target's attributes pertaining to the review context. The attributes contain the background and property information of the target, which can help to enrich the semantics of the review context and the target. To exploit the attributes for tackling TSC, we first construct a heterogeneous information graph by treating the attributes as nodes and combining them with (1) the syntax graph automatically produced by the off-the-shelf dependency parser and (2) the semantics graph of the review context, which is derived from the self-attention mechanism. Then we propose a heterogeneous information gated graph convolutional network to model the interactions among the attribute information, the syntactic information, and the contextual information. The experimental results on three benchmark datasets demonstrate the superiority of our model, which achieves new state-of-the-art performance. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: Accepted by Journal of Artificial Intelligence Research (JAIR)

Co-guiding for Multi-intent Spoken Language Understanding

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Recent graph-based models for multi-intent SLU have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the unidirectional guidance from intent to slot, while there are bidirectional inter-correlations between intent and slot; (2) adopt homogeneous graphs to model the interactions between… ▽ More Recent graph-based models for multi-intent SLU have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the unidirectional guidance from intent to slot, while there are bidirectional inter-correlations between intent and slot; (2) adopt homogeneous graphs to model the interactions between the slot semantics nodes and intent label nodes, which limit the performance. In this paper, we propose a novel model termed Co-guiding Net, which implements a two-stage framework achieving the mutual guidances between the two tasks. In the first stage, the initial estimated labels of both tasks are produced, and then they are leveraged in the second stage to model the mutual guidances. Specifically, we propose two heterogeneous graph attention networks working on the proposed two heterogeneous semantics label graphs, which effectively represent the relations among the semantics nodes and label nodes. Besides, we further propose Co-guiding-SCL Net, which exploits the single-task and dual-task semantics contrastive relations. For the first stage, we propose single-task supervised contrastive learning, and for the second stage, we propose co-guiding supervised contrastive learning, which considers the two tasks' mutual guidances in the contrastive learning procedure. Experiment results on multi-intent SLU show that our model outperforms existing models by a large margin, obtaining a relative improvement of 21.3% over the previous best model on MixATIS dataset in overall accuracy. We also evaluate our model on the zero-shot cross-lingual scenario and the results show that our model can relatively improve the state-of-the-art model by 33.5% on average in terms of overall accuracy for the total 9 languages. △ Less

Submitted 22 November, 2023; originally announced December 2023.

Comments: Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). arXiv admin note: substantial text overlap with arXiv:2210.10375

Interactions and integrability in weakly monitored Hamiltonian systems

Authors: Bo Xing, Xhek Turkeshi, Marco Schiró, Rosario Fazio, Dario Poletti

Abstract: Interspersing unitary dynamics with local measurements results in measurement-induced phases and transitions in many-body quantum systems. When the evolution is driven by a local Hamiltonian, two types of transitions have been observed, characterized by an abrupt change in the system size scaling of entanglement entropy. The critical point separates the strongly monitored area-law phase from a vol… ▽ More Interspersing unitary dynamics with local measurements results in measurement-induced phases and transitions in many-body quantum systems. When the evolution is driven by a local Hamiltonian, two types of transitions have been observed, characterized by an abrupt change in the system size scaling of entanglement entropy. The critical point separates the strongly monitored area-law phase from a volume law or a sub-extensive, typically logarithmic-like one at low measurement rates. Identifying the key ingredients responsible for the entanglement scaling in the weakly monitored phase is the key purpose of this work. For this purpose, we consider prototypical one-dimensional spin chains with local monitoring featuring the presence/absence of U(1) symmetry, integrability, and interactions. Using exact numerical methods, the system sizes studied reveal that the presence of interaction is always correlated to a volume-law weakly monitored phase. In contrast, non-interacting systems present sub-extensive scaling of entanglement. Other characteristics, namely integrability or U(1) symmetry, do not play a role in the character of the entanglement phase. △ Less

Submitted 17 August, 2023; originally announced August 2023.

Comments: 4 pages, 4 figures

Journal ref: Phys. Rev. B 109, L060302 (2024)

Attractive Su-Schrieffer-Heeger-Hubbard Model on a Square Lattice Away from Half-Filling

Authors: Bo Xing, Chunhan Feng, Richard Scalettar, G. George Batrouni, Dario Poletti

Abstract: The Su-Schrieffer-Heeger (SSH) model, with bond phonons modulating electron tunneling, is a paradigmatic electron-phonon model that hosts an antiferromagnetic order to bond order transition at half-filling. In the presence of repulsive Hubbard interaction, the antiferromagnetic phase is enhanced, but the phase transition remains first-order. Here we explore the physics of the SSH model with attrac… ▽ More The Su-Schrieffer-Heeger (SSH) model, with bond phonons modulating electron tunneling, is a paradigmatic electron-phonon model that hosts an antiferromagnetic order to bond order transition at half-filling. In the presence of repulsive Hubbard interaction, the antiferromagnetic phase is enhanced, but the phase transition remains first-order. Here we explore the physics of the SSH model with attractive Hubbard interaction, which hosts an interesting interplay among charge order, s-wave pairing, and bond order. Using the numerically exact determinant quantum Monte Carlo method, we show that both charge order, present at weak electron-phonon coupling, and bond order, at large coupling, give way to s-wave pairing when the system is doped. Furthermore, we demonstrate that the SSH electron-phonon interaction competes with the attractive Hubbard interaction and reduces the s-wave pairing correlation. △ Less

Submitted 7 August, 2023; originally announced August 2023.

Comments: 5 pages, 4 figures

Journal ref: Phys. Rev. B 108, L161103 (2023)

Generalized parallel paths method for computing the first Hochschild cohomology groups with applications to Brauer graph algebras

Authors: Yuming Liu, Bohan Xing

Abstract: We use algebraic Morse theory to generalize the parallel paths method for computing the first Hochschild cohomology groups. As an application, we describe and compare the Lie structures of the first Hochschild cohomology groups of Brauer graph algebras and their associated graded algebras. We use algebraic Morse theory to generalize the parallel paths method for computing the first Hochschild cohomology groups. As an application, we describe and compare the Lie structures of the first Hochschild cohomology groups of Brauer graph algebras and their associated graded algebras. △ Less

Submitted 20 July, 2023; v1 submitted 25 June, 2023; originally announced June 2023.

Comments: 34 pages

MSC Class: 16E40; 16Gxx

Relational Temporal Graph Reasoning for Dual-task Dialogue Language Understanding

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Dual-task dialog language understanding aims to tackle two correlative dialog language understanding tasks simultaneously via leveraging their inherent correlations. In this paper, we put forward a new framework, whose core is relational temporal graph reasoning.We propose a speaker-aware temporal graph (SATG) and a dual-task relational temporal graph (DRTG) to facilitate relational temporal model… ▽ More Dual-task dialog language understanding aims to tackle two correlative dialog language understanding tasks simultaneously via leveraging their inherent correlations. In this paper, we put forward a new framework, whose core is relational temporal graph reasoning.We propose a speaker-aware temporal graph (SATG) and a dual-task relational temporal graph (DRTG) to facilitate relational temporal modeling in dialog understanding and dual-task reasoning. Besides, different from previous works that only achieve implicit semantics-level interactions, we propose to model the explicit dependencies via integrating prediction-level interactions. To implement our framework, we first propose a novel model Dual-tAsk temporal Relational rEcurrent Reasoning network (DARER), which first generates the context-, speaker- and temporal-sensitive utterance representations through relational temporal modeling of SATG, then conducts recurrent dual-task relational temporal graph reasoning on DRTG, in which process the estimated label distributions act as key clues in prediction-level interactions. And the relational temporal modeling in DARER is achieved by relational convolutional networks (RGCNs). Then we further propose Relational Temporal Transformer (ReTeFormer), which achieves fine-grained relational temporal modeling via Relation- and Structure-aware Disentangled Multi-head Attention. Accordingly, we propose DARER with ReTeFormer (DARER2), which adopts two variants of ReTeFormer to achieve the relational temporal modeling of SATG and DTRG, respectively. The extensive experiments on different scenarios verify that our models outperform state-of-the-art models by a large margin. Remarkably, on the dialog sentiment classification task in the Mastodon dataset, DARER and DARER2 gain relative improvements of about 28% and 34% over the previous best model in terms of F1. △ Less

Submitted 15 June, 2023; originally announced June 2023.

Comments: Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE TPAMI). arXiv admin note: substantial text overlap with arXiv:2203.03856

Co-evolving Graph Reasoning Network for Emotion-Cause Pair Extraction

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Emotion-Cause Pair Extraction (ECPE) aims to extract all emotion clauses and their corresponding cause clauses from a document. Existing approaches tackle this task through multi-task learning (MTL) framework in which the two subtasks provide indicative clues for ECPE. However, the previous MTL framework considers only one round of multi-task reasoning and ignores the reverse feedbacks from ECPE t… ▽ More Emotion-Cause Pair Extraction (ECPE) aims to extract all emotion clauses and their corresponding cause clauses from a document. Existing approaches tackle this task through multi-task learning (MTL) framework in which the two subtasks provide indicative clues for ECPE. However, the previous MTL framework considers only one round of multi-task reasoning and ignores the reverse feedbacks from ECPE to the subtasks. Besides, its multi-task reasoning only relies on semantics-level interactions, which cannot capture the explicit dependencies, and both the encoder sharing and multi-task hidden states concatenations can hardly capture the causalities. To solve these issues, we first put forward a new MTL framework based on Co-evolving Reasoning. It (1) models the bidirectional feedbacks between ECPE and its subtasks; (2) allows the three tasks to evolve together and prompt each other recurrently; (3) integrates prediction-level interactions to capture explicit dependencies. Then we propose a novel multi-task relational graph (MRG) to sufficiently exploit the causal relations. Finally, we propose a Co-evolving Graph Reasoning Network (CGR-Net) that implements our MTL framework and conducts Co-evolving Reasoning on MRG. Experimental results show that our model achieves new state-of-the-art performance, and further analysis confirms the advantages of our method. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Comments: Accepted by ECML-PKDD 2023

Complexity of spin configurations dynamics due to unitary evolution and periodic projective measurements

Authors: Heitor P. Casagrande, Bo Xing, Marcello Dalmonte, Alex Rodriguez, Vinitha Balachandran, Dario Poletti

Abstract: We study the Hamiltonian dynamics of a many-body quantum system subjected to periodic projective measurements which leads to probabilistic cellular automata dynamics. Given a sequence of measured values, we characterize their dynamics by performing a principal component analysis. The number of principal components required for an almost complete description of the system, which is a measure of com… ▽ More We study the Hamiltonian dynamics of a many-body quantum system subjected to periodic projective measurements which leads to probabilistic cellular automata dynamics. Given a sequence of measured values, we characterize their dynamics by performing a principal component analysis. The number of principal components required for an almost complete description of the system, which is a measure of complexity we refer to as PCA complexity, is studied as a function of the Hamiltonian parameters and measurement intervals. We consider different Hamiltonians that describe interacting, non-interacting, integrable, and non-integrable systems, including random local Hamiltonians and translational invariant random local Hamiltonians. In all these scenarios, we find that the PCA complexity grows rapidly in time before approaching a plateau. The dynamics of the PCA complexity can vary quantitatively and qualitatively as a function of the Hamiltonian parameters and measurement protocol. Importantly, the dynamics of PCA complexity present behavior that is considerably less sensitive to the specific system parameters for models which lack simple local dynamics, as is often the case in non-integrable models. In particular, we point out a figure of merit that considers the local dynamics and the measurement direction to predict the sensitivity of the PCA complexity dynamics to the system parameters. △ Less

Submitted 18 May, 2023; v1 submitted 5 May, 2023; originally announced May 2023.

Comments: 9 pages, 8 figures

Journal ref: Phys. Rev. E 108, 044128 (2023)

Neural Network Kinetics for Exploring Diffusion Multiplicity and Chemical Ordering in Compositionally Complex Materials

Authors: Bin Xing, Timothy J. Rupert, Xiaoqing Pan, Penghui Cao

Abstract: Diffusion involving atom transport from one location to another governs many important processes and behaviors such as precipitation and phase nucleation. Local chemical complexity in compositionally complex alloys poses challenges for modeling atomic diffusion and the resulting formation of chemically ordered structures. Here, we introduce a neural network kinetics (NNK) scheme that predicts and… ▽ More Diffusion involving atom transport from one location to another governs many important processes and behaviors such as precipitation and phase nucleation. Local chemical complexity in compositionally complex alloys poses challenges for modeling atomic diffusion and the resulting formation of chemically ordered structures. Here, we introduce a neural network kinetics (NNK) scheme that predicts and simulates diffusion-induced chemical and structural evolution in complex concentrated chemical environments. The framework is grounded on efficient on-lattice structure and chemistry representation combined with neural networks, enabling precise prediction of all path-dependent migration barriers and individual atom jumps. Using this method, we study the temperature-dependent local chemical ordering in a refractory Nb-Mo-Ta alloy and reveal a critical temperature at which the B2 order reaches a maximum. Our atomic jump randomness map exhibits the highest diffusion heterogeneity (multiplicity) in the vicinity of this characteristic temperature, which is closely related to chemical ordering and B2 structure formation. The scalable NNK framework provides a promising new avenue to exploring diffusion-related properties in the vast compositional space within which extraordinary properties are hidden. △ Less

Submitted 6 April, 2024; v1 submitted 6 April, 2023; originally announced April 2023.

Journal ref: Nat Commun 15, 3879 (2024)

Co-guiding Net: Achieving Mutual Guidances between Multiple Intent Detection and Slot Filling via Heterogeneous Semantics-Label Graphs

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Recent graph-based models for joint multiple intent detection and slot filling have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the \textit{unidirectional guidance} from intent to slot; (2) adopt \textit{homogeneous graphs} to model the interactions between the slot semantics nodes… ▽ More Recent graph-based models for joint multiple intent detection and slot filling have obtained promising results through modeling the guidance from the prediction of intents to the decoding of slot filling. However, existing methods (1) only model the \textit{unidirectional guidance} from intent to slot; (2) adopt \textit{homogeneous graphs} to model the interactions between the slot semantics nodes and intent label nodes, which limit the performance. In this paper, we propose a novel model termed Co-guiding Net, which implements a two-stage framework achieving the \textit{mutual guidances} between the two tasks. In the first stage, the initial estimated labels of both tasks are produced, and then they are leveraged in the second stage to model the mutual guidances. Specifically, we propose two \textit{heterogeneous graph attention networks} working on the proposed two \textit{heterogeneous semantics-label graphs}, which effectively represent the relations among the semantics nodes and label nodes. Experiment results show that our model outperforms existing models by a large margin, obtaining a relative improvement of 19.3\% over the previous best model on MixATIS dataset in overall accuracy. △ Less

Submitted 4 November, 2022; v1 submitted 19 October, 2022; originally announced October 2022.

Comments: Accepted as Oral Presentation at EMNLP 2022

Group is better than individual: Exploiting Label Topologies and Label Relations for Joint Multiple Intent Detection and Slot Filling

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Recent joint multiple intent detection and slot filling models employ label embeddings to achieve the semantics-label interactions. However, they treat all labels and label embeddings as uncorrelated individuals, ignoring the dependencies among them. Besides, they conduct the decoding for the two tasks independently, without leveraging the correlations between them. Therefore, in this paper, we fi… ▽ More Recent joint multiple intent detection and slot filling models employ label embeddings to achieve the semantics-label interactions. However, they treat all labels and label embeddings as uncorrelated individuals, ignoring the dependencies among them. Besides, they conduct the decoding for the two tasks independently, without leveraging the correlations between them. Therefore, in this paper, we first construct a Heterogeneous Label Graph (HLG) containing two kinds of topologies: (1) statistical dependencies based on labels' co-occurrence patterns and hierarchies in slot labels; (2) rich relations among the label nodes. Then we propose a novel model termed ReLa-Net. It can capture beneficial correlations among the labels from HLG. The label correlations are leveraged to enhance semantic-label interactions. Moreover, we also propose the label-aware inter-dependent decoding mechanism to further exploit the label correlations for decoding. Experiment results show that our ReLa-Net significantly outperforms previous models. Remarkably, ReLa-Net surpasses the previous best model by over 20\% in terms of overall accuracy on MixATIS dataset. △ Less

Submitted 4 November, 2022; v1 submitted 19 October, 2022; originally announced October 2022.

Comments: Accepted to EMNLP 2022 Main Conference

Inorganic Crystal Structure Prototype Database based on Unsupervised Learning of Local Atomic Environments

Authors: Shulin Luo, Bangyu Xing, Muhammad Faizan, Jiahao Xie, Kun Zhou, Ruoting Zhao, Tianshu Li, Xinjiang Wang, Yuhao Fu, Xin He, Jian Lv, Lijun Zhang

Abstract: Recognition of structure prototypes from tremendous known inorganic crystal structures has been an important subject beneficial for material science research and new materials design. The existing databases of inorganic crystal structure prototypes were mostly constructed by classifying materials in terms of the crystallographic space group information. Herein, we employed a distinct strategy to c… ▽ More Recognition of structure prototypes from tremendous known inorganic crystal structures has been an important subject beneficial for material science research and new materials design. The existing databases of inorganic crystal structure prototypes were mostly constructed by classifying materials in terms of the crystallographic space group information. Herein, we employed a distinct strategy to construct the inorganic crystal structure prototype database, relying on the classification of materials in terms of local atomic environments (LAE) accompanied by unsupervised machine learning method. Specifically, we adopted a hierarchical clustering approach onto all experimentally known inorganic crystal structures data to identify structure prototypes. The criterion for hierarchical clustering is the LAE represented by the state-of-the-art structure fingerprints of the improved bond-orientational order parameters and the smooth overlap of atomic positions. This allows us to build up a LAE-based Inorganic Crystal Structure Prototype Database (LAE-ICSPD) containing 15,613 structure prototypes with defined stoichiometries. In addition, we have developed a Structure Prototype Generator Infrastructure (SPGI) package, which is a useful toolkit for structure prototype generation. Our developed SPGI toolkit and LAE-ICSPD are beneficial for investigating inorganic materials in a global way as well as accelerating materials discovery process in the data-driven mode. △ Less

Submitted 8 June, 2022; originally announced June 2022.

Comments: 27 pages, 4 figures, with Supporting Information

Journal ref: J. Phys. Chem. A 126, 4300 (2022)

Neural Subgraph Explorer: Reducing Noisy Information via Target-Oriented Syntax Graph Pruning

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Recent years have witnessed the emerging success of leveraging syntax graphs for the target sentiment classification task. However, we discover that existing syntax-based models suffer from two issues: noisy information aggregation and loss of distant correlations. In this paper, we propose a novel model termed Neural Subgraph Explorer, which (1) reduces the noisy information via pruning target-ir… ▽ More Recent years have witnessed the emerging success of leveraging syntax graphs for the target sentiment classification task. However, we discover that existing syntax-based models suffer from two issues: noisy information aggregation and loss of distant correlations. In this paper, we propose a novel model termed Neural Subgraph Explorer, which (1) reduces the noisy information via pruning target-irrelevant nodes on the syntax graph; (2) introduces beneficial first-order connections between the target and its related words into the obtained graph. Specifically, we design a multi-hop actions score estimator to evaluate the value of each word regarding the specific target. The discrete action sequence is sampled through Gumble-Softmax and then used for both of the syntax graph and the self-attention graph. To introduce the first-order connections between the target and its relevant words, the two pruned graphs are merged. Finally, graph convolution is conducted on the obtained unified graph to update the hidden states. And this process is stacked with multiple layers. To our knowledge, this is the first attempt of target-oriented syntax graph pruning in this task. Experimental results demonstrate the superiority of our model, which achieves new state-of-the-art performance. △ Less

Submitted 22 May, 2022; originally announced May 2022.

Comments: To appear in IJCAI 2022

Room-temperature printing of ultrathin Quasi-2D GaN semiconductor via liquid metal gallium surface confined nitridation reaction

Authors: Qian Li, Bang-Deng Du, Jian-Ye Gao, Bao-Yu Xing, Dian-Kai Wang, Ji-Fei Ye, Jing Liu

Abstract: Outstanding wide-bandgap semiconductor material such as gallium nitride (GaN) has been extensively utilized in power electronics, radiofrequency amplifiers, and harsh environment devices. Due to its quantum confinement effect in enabling desired deep-ultraviolet emission, excitonic impact, and electronic transport features, two-dimensional (2D) or ultrathin quasi-2D GaN semiconductors have been on… ▽ More Outstanding wide-bandgap semiconductor material such as gallium nitride (GaN) has been extensively utilized in power electronics, radiofrequency amplifiers, and harsh environment devices. Due to its quantum confinement effect in enabling desired deep-ultraviolet emission, excitonic impact, and electronic transport features, two-dimensional (2D) or ultrathin quasi-2D GaN semiconductors have been one of the most remarkable candidates for future growth of microelectronic devices. Here, for the first time, we reported a large area, wide bandgap, and room-temperature quasi-2D GaN synthesis and printing strategy through introducing the plasma medicated liquid metal gallium surface-confined nitridation reaction mechanism. The developed direct fabrication and compositional process is consistent with various electronics manufacturing approaches and thus opens an easy going way for cost-effective growth of the third-generation semiconductor. In particular, the fully printed field-effect transistors relying on the GaN thus made show p-type switching with an on/off ratio greater than 105, maximum field-effect hole mobility of 53 cm2/(V*s), and a small sub-threshold swing. As it was demonstrated, the present method allows to produce at room temperature the GaN with thickness spanning from 1nm to nanometers. This basic method can be further extended, generalized, and utilized for making various electronic and photoelectronic devices in the coming time. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Comments: 26 pages, 12 figures

Convolutional neural networks enable high-fidelity prediction of path-dependent diffusion barrier spectra in multi-principal element alloys

Authors: Zhao Fan, Bin Xing, Penghui Cao

Abstract: The emergent multi-principal element alloys (MPEAs) provide a vast compositional space to search for novel materials for technological advances. However, how to efficiently identify optimal compositions from such a large design space for targeted properties is a grand challenge in material science. Here we developed a convolutional neural network (CNN) model that can accurately and efficiently pre… ▽ More The emergent multi-principal element alloys (MPEAs) provide a vast compositional space to search for novel materials for technological advances. However, how to efficiently identify optimal compositions from such a large design space for targeted properties is a grand challenge in material science. Here we developed a convolutional neural network (CNN) model that can accurately and efficiently predict path-dependent vacancy migration energy barriers, which are critical to diffusion behaviors and many high-temperature properties, of MPEAs at any compositions and with different chemical short-range orders within a given alloy system. The success of the CNN model makes it promising for developing a database of diffusion barriers for different MPEA systems, which would accelerate alloy screening for the discovery of new compositions with desirable properties. Besides, the length scale of local configurations relevant to migration energy barriers is uncovered, and the implications of this success to other aspects of materials science are discussed. △ Less

Submitted 23 March, 2022; v1 submitted 12 March, 2022; originally announced March 2022.

Comments: 32 pages, 5 figures in the main text and 9 supplementary figures

DARER: Dual-task Temporal Relational Recurrent Reasoning Network for Joint Dialog Sentiment Classification and Act Recognition

Authors: Bowen Xing, Ivor W. Tsang

Abstract: The task of joint dialog sentiment classification (DSC) and act recognition (DAR) aims to simultaneously predict the sentiment label and act label for each utterance in a dialog. In this paper, we put forward a new framework which models the explicit dependencies via integrating \textit{prediction-level interactions} other than semantics-level interactions, more consistent with human intuition. Be… ▽ More The task of joint dialog sentiment classification (DSC) and act recognition (DAR) aims to simultaneously predict the sentiment label and act label for each utterance in a dialog. In this paper, we put forward a new framework which models the explicit dependencies via integrating \textit{prediction-level interactions} other than semantics-level interactions, more consistent with human intuition. Besides, we propose a speaker-aware temporal graph (SATG) and a dual-task relational temporal graph (DRTG) to introduce \textit{temporal relations} into dialog understanding and dual-task reasoning. To implement our framework, we propose a novel model dubbed DARER, which first generates the context-, speaker- and temporal-sensitive utterance representations via modeling SATG, then conducts recurrent dual-task relational reasoning on DRTG, in which process the estimated label distributions act as key clues in prediction-level interactions. Experiment results show that DARER outperforms existing models by large margins while requiring much less computation resource and costing less training time. Remarkably, on DSC task in Mastodon, DARER gains a relative improvement of about 25% over previous best model in terms of F1, with less than 50% parameters and about only 60% required GPU memory. △ Less

Submitted 8 March, 2022; originally announced March 2022.

Comments: Long paper; ACL 2022 (Findings)

DigNet: Digging Clues from Local-Global Interactive Graph for Aspect-level Sentiment Classification

Authors: Bowen Xing, Ivor Tsang

Abstract: In aspect-level sentiment classification (ASC), state-of-the-art models encode either syntax graph or relation graph to capture the local syntactic information or global relational information. Despite the advantages of syntax and relation graphs, they have respective shortages which are neglected, limiting the representation power in the graph modeling process. To resolve their limitations, we de… ▽ More In aspect-level sentiment classification (ASC), state-of-the-art models encode either syntax graph or relation graph to capture the local syntactic information or global relational information. Despite the advantages of syntax and relation graphs, they have respective shortages which are neglected, limiting the representation power in the graph modeling process. To resolve their limitations, we design a novel local-global interactive graph, which marries their advantages by stitching the two graphs via interactive edges. To model this local-global interactive graph, we propose a novel neural network termed DigNet, whose core module is the stacked local-global interactive (LGI) layers performing two processes: intra-graph message passing and cross-graph message passing. In this way, the local syntactic and global relational information can be reconciled as a whole in understanding the aspect-level sentiment. Concretely, we design two variants of local-global interactive graphs with different kinds of interactive edges and three variants of LGI layers. We conduct experiments on several public benchmark datasets and the results show that we outperform previous best scores by 3\%, 2.32\%, and 6.33\% in terms of Macro-F1 on Lap14, Res14, and Res15 datasets, respectively, confirming the effectiveness and superiority of the proposed local-global interactive graph and DigNet. △ Less

Submitted 2 May, 2022; v1 submitted 4 January, 2022; originally announced January 2022.

Comments: submitted to Journal of Artificial Intelligence Research (JAIR)

Phase Diagram of the Su-Schrieffer-Heeger-Hubbard model on a square lattice

Authors: Chunhan Feng, Bo Xing, Dario Poletti, Richard Scalettar, George Batrouni

Abstract: The Hubbard and Su-Schrieffer-Heeger Hamiltonians (SSH) are iconic models for understanding the qualitative effects of electron-electron and electron-phonon interactions respectively. In the two-dimensional square lattice Hubbard model at half filling, the on-site Coulomb repulsion, $U$, between up and down electrons induces antiferromagnetic (AF) order and a Mott insulating phase. On the other ha… ▽ More The Hubbard and Su-Schrieffer-Heeger Hamiltonians (SSH) are iconic models for understanding the qualitative effects of electron-electron and electron-phonon interactions respectively. In the two-dimensional square lattice Hubbard model at half filling, the on-site Coulomb repulsion, $U$, between up and down electrons induces antiferromagnetic (AF) order and a Mott insulating phase. On the other hand, for the SSH model, there is an AF phase when the electron-phonon coupling $λ$ is less than a critical value $λ_c$ and a bond order wave when $λ> λ_c$. In this work, we perform numerical studies on the square lattice optical Su-Schrieffer-Heeger-Hubbard Hamiltonian (SSHH), which combines both interactions. We use the determinant quantum Monte Carlo (DQMC) method which does not suffer from the fermionic sign problem at half filling. We map out the phase diagram and find that it exhibits a direct first-order transition between an antiferromagnetic phase and a bond-ordered wave as $λ$ increases. The AF phase is characterized by two different regions. At smaller $λ$ the behavior is similar to that of the pure Hubbard model; the other region, while maintaining long range AF order, exhibits larger kinetic energies and double occupancy, i.e. larger quantum fluctuations, similar to the AF phase found in the pure SSH model. △ Less

Submitted 7 March, 2022; v1 submitted 19 September, 2021; originally announced September 2021.

Thermopower in a boundary driven bosonic ladder in the presence of a gauge field

Authors: Bo Xing, Xiansong Xu, Vinitha Balachandran, Dario Poletti

Abstract: We consider a bosonic two-legged ladder whose two-band energy spectrum can be tuned in the presence of a uniform gauge field, to four distinct scenarios: degenerate or non-degenerate ground states with gapped or gapless energy bands. We couple the ladder to two baths at different temperatures and chemical potentials and analyze the efficiency and power generated in the linear as well as nonlinear… ▽ More We consider a bosonic two-legged ladder whose two-band energy spectrum can be tuned in the presence of a uniform gauge field, to four distinct scenarios: degenerate or non-degenerate ground states with gapped or gapless energy bands. We couple the ladder to two baths at different temperatures and chemical potentials and analyze the efficiency and power generated in the linear as well as nonlinear response regime. Our results, obtained with the Green's function method, show that the maximum performance efficiency and generated power are strongly dependent on the type of the underlying energy spectrum. We also show that the ideal scenario for efficient energy conversion, as well as power generation, corresponds to the case in which the spectrum has a gap between the bands, and the ground state is degenerate. △ Less

Submitted 18 March, 2022; v1 submitted 24 August, 2021; originally announced August 2021.

Comments: 9 pages, 10 figures

Journal ref: Phys. Rev. B 105, 115429 (2022)

Understand me, if you refer to Aspect Knowledge: Knowledge-aware Gated Recurrent Memory Network

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Aspect-level sentiment classification (ASC) aims to predict the fine-grained sentiment polarity towards a given aspect mentioned in a review. Despite recent advances in ASC, enabling machines to preciously infer aspect sentiments is still challenging. This paper tackles two challenges in ASC: (1) due to lack of aspect knowledge, aspect representation derived in prior works is inadequate to represe… ▽ More Aspect-level sentiment classification (ASC) aims to predict the fine-grained sentiment polarity towards a given aspect mentioned in a review. Despite recent advances in ASC, enabling machines to preciously infer aspect sentiments is still challenging. This paper tackles two challenges in ASC: (1) due to lack of aspect knowledge, aspect representation derived in prior works is inadequate to represent aspect's exact meaning and property information; (2) prior works only capture either local syntactic information or global relational information, thus missing either one of them leads to insufficient syntactic information. To tackle these challenges, we propose a novel ASC model which not only end-to-end embeds and leverages aspect knowledge but also marries the two kinds of syntactic information and lets them compensate for each other. Our model includes three key components: (1) a knowledge-aware gated recurrent memory network recurrently integrates dynamically summarized aspect knowledge; (2) a dual syntax graph network combines both kinds of syntactic information to comprehensively capture sufficient syntactic information; (3) a knowledge integrating gate re-enhances the final representation with further needed aspect knowledge; (4) an aspect-to-context attention mechanism aggregates the aspect-related semantics from all hidden states into the final representation. Experimental results on several benchmark datasets demonstrate the effectiveness of our model, which overpass previous state-of-the-art models by large margins in terms of both Accuracy and Macro-F1. △ Less

Submitted 1 March, 2022; v1 submitted 4 August, 2021; originally announced August 2021.

Comments: Accepted by IEEE Transactions on Emerging Topics in Computational Intelligence (TETCI) 2022

Out of Context: A New Clue for Context Modeling of Aspect-based Sentiment Analysis

Authors: Bowen Xing, Ivor W. Tsang

Abstract: Aspect-based sentiment analysis (ABSA) aims to predict the sentiment expressed in a review with respect to a given aspect. The core of ABSA is to model the interaction between the context and given aspect to extract the aspect-related information. In prior work, attention mechanisms and dependency graph networks are commonly adopted to capture the relations between the context and given aspect. An… ▽ More Aspect-based sentiment analysis (ABSA) aims to predict the sentiment expressed in a review with respect to a given aspect. The core of ABSA is to model the interaction between the context and given aspect to extract the aspect-related information. In prior work, attention mechanisms and dependency graph networks are commonly adopted to capture the relations between the context and given aspect. And the weighted sum of context hidden states is used as the final representation fed to the classifier. However, the information related to the given aspect may be already discarded and adverse information may be retained in the context modeling processes of existing models. This problem cannot be solved by subsequent modules and there are two reasons: first, their operations are conducted on the encoder-generated context hidden states, whose value cannot change after the encoder; second, existing encoders only consider the context while not the given aspect. To address this problem, we argue the given aspect should be considered as a new clue out of context in the context modeling process. As for solutions, we design several aspect-aware context encoders based on different backbones: an aspect-aware LSTM and three aspect-aware BERTs. They are dedicated to generate aspect-aware hidden states which are tailored for ABSA task. In these aspect-aware context encoders, the semantics of the given aspect is used to regulate the information flow. Consequently, the aspect-related information can be retained and aspect-irrelevant information can be excluded in the generated hidden states. We conduct extensive experiments on several benchmark datasets with empirical analysis, demonstrating the efficacies and advantages of our proposed aspect-aware context encoders. △ Less

Submitted 21 April, 2022; v1 submitted 20 June, 2021; originally announced June 2021.

Comments: Accepted by Journal of Artificial Intelligence Research (JAIR) 2022

JAMIP: an artificial-intelligence aided data-driven infrastructure for computational materials informatics

Authors: Xin-Gang Zhao, Kun zhou, Bangyu Xing, Ruoting Zhao, Shulin Luo, Tianshu Li, Yuanhui Sun, Guangren Na, Jiahao Xie, Xiaoyu yang, Xinjiang Wang, Xiaoyu Wang, Xin He, Jian Lv, Yuhao Fu, Lijun Zhang

Abstract: Materials informatics has emerged as a promisingly new paradigm for accelerating materials discovery and design. It exploits the intelligent power of machine learning methods in massive materials data from experiments or simulations to seek for new materials, functionality, principles, etc. Developing specialized facility to generate, collect, manage, learn and mine large-scale materials data is c… ▽ More Materials informatics has emerged as a promisingly new paradigm for accelerating materials discovery and design. It exploits the intelligent power of machine learning methods in massive materials data from experiments or simulations to seek for new materials, functionality, principles, etc. Developing specialized facility to generate, collect, manage, learn and mine large-scale materials data is crucial to materials informatics. We herein developed an artificial-intelligence-aided data-driven infrastructure named Jilin Artificial-intelligence aided Materials-design Integrated Package (JAMIP), which is an open-source Python framework to meet the research requirements of computational materials informatics. It is integrated by materials production factory, high-throughput first-principles calculations engine, automatic tasks submission and monitoring progress, data extraction, management and storage system, and artificial intelligence machine learning based data mining functions. We have integrated specific features such as inorganic crystal structure prototype database to facilitate high-throughput calculations and essential modules associated with machine learning studies of functional materials. We demonstrated how our developed code is useful in exploring materials informatics of optoelectronic semiconductors by taking halide perovskites as typical case. By obeying the principles of automation, extensibility, reliability and intelligence, the JAMIP code is a promisingly powerful tool contributing to the fast-growing field of computational materials informatics. △ Less

Submitted 14 March, 2021; originally announced March 2021.

Comments: 11 pages, 7 figures, preliminary version

Spatially Correlated Patterns in Adversarial Images

Authors: Nandish Chattopadhyay, Lionell Yip En Zhi, Bryan Tan Bing Xing, Anupam Chattopadhyay

Abstract: Adversarial attacks have proved to be the major impediment in the progress on research towards reliable machine learning solutions. Carefully crafted perturbations, imperceptible to human vision, can be added to images to force misclassification by an otherwise high performing neural network. To have a better understanding of the key contributors of such structured attacks, we searched for and stu… ▽ More Adversarial attacks have proved to be the major impediment in the progress on research towards reliable machine learning solutions. Carefully crafted perturbations, imperceptible to human vision, can be added to images to force misclassification by an otherwise high performing neural network. To have a better understanding of the key contributors of such structured attacks, we searched for and studied spatially co-located patterns in the distribution of pixels in the input space. In this paper, we propose a framework for segregating and isolating regions within an input image which are particularly critical towards either classification (during inference), or adversarial vulnerability or both. We assert that during inference, the trained model looks at a specific region in the image, which we call Region of Importance (RoI); and the attacker looks at a region to alter/modify, which we call Region of Attack (RoA). The success of this approach could also be used to design a post-hoc adversarial defence method, as illustrated by our observations. This uses the notion of blocking out (we call neutralizing) that region of the image which is highly vulnerable to adversarial attacks but is not important for the task of classification. We establish the theoretical setup for formalising the process of segregation, isolation and neutralization and substantiate it through empirical analysis on standard benchmarking datasets. The findings strongly indicate that mapping features into the input space preserves the significant patterns typically observed in the feature-space while adding major interpretability and therefore simplifies potential defensive mechanisms. △ Less

Submitted 21 November, 2020; originally announced November 2020.

Comments: Submitted for review

Heat, particle and chiral currents in a boundary driven bosonic ladders in presence of gauge fields

Authors: Bo Xing, Xiansong Xu, Vinitha Balachandran, Dario Poletti

Abstract: Quantum systems can undergo phase transitions and show distinct features in different phases. The corresponding transport properties can also vary significantly due to the underlying quantum phase. We investigate the transport behaviour of a two-legged bosonic ladder in a uniform gauge field, which is known to have a Meissner-like phase and a vortex phase in the absence of dissipation. The ladder… ▽ More Quantum systems can undergo phase transitions and show distinct features in different phases. The corresponding transport properties can also vary significantly due to the underlying quantum phase. We investigate the transport behaviour of a two-legged bosonic ladder in a uniform gauge field, which is known to have a Meissner-like phase and a vortex phase in the absence of dissipation. The ladder is coupled to bosonic baths at different temperatures, and we study it using the non-equilibrium Green's function method. In particular, we show the presence of a chiral current and how it is affected by the temperature bias and the dissipation strength. We also demonstrate that the opening of a gap between the lower and upper energy band results in the possibility of tuning heat and particle transport through the ladder. We show that for system parameters for which the ground state is in a vortex phase, the system is more sensitive to external perturbations. △ Less

Submitted 7 October, 2020; originally announced October 2020.

Comments: 10 pages, 11 figures

Journal ref: Phys. Rev. B 102, 245433 (2020)

Quantum Monte Carlo Simulations of the 2D Su-Schrieffer-Heeger Model

Authors: Bo Xing, Wei-ting Chiu, Dario Poletti, Richard T. Scalettar, George G. Batrouni

Abstract: Over the last several years, a new generation of quantum simulations has greatly expanded our understanding of charge density wave phase transitions in Hamiltonians with coupling between local phonon modes and the on-site charge density. A quite different, and interesting, case is one in which the phonons live on the bonds, and hence modulate the electron hopping. This situation, described by the… ▽ More Over the last several years, a new generation of quantum simulations has greatly expanded our understanding of charge density wave phase transitions in Hamiltonians with coupling between local phonon modes and the on-site charge density. A quite different, and interesting, case is one in which the phonons live on the bonds, and hence modulate the electron hopping. This situation, described by the Su-Schrieffer-Heeger (SSH) Hamiltonian, has so far only been studied with quantum Monte Carlo in one dimension. Here we present results for the 2D SSH model, and show that a bond ordered wave (BOW) insulator is present in the ground state at half-filling, and argue that a critical value of the electron-phonon coupling is required for its onset, in contradistinction with the 1D case where BOW exists for any nonzero coupling. We determine the precise nature of the bond ordering pattern, which has hitherto been controversial, and the critical transition temperature, which is associated with a spontaneous breaking of ${\cal Z}_4$ symmetry. △ Less

Submitted 24 June, 2020; v1 submitted 19 May, 2020; originally announced May 2020.

Comments: 5 pages, 7 figures

Journal ref: Phys. Rev. Lett. 126, 017601 (2021)

Earlier Attention? Aspect-Aware LSTM for Aspect-Based Sentiment Analysis

Authors: Bowen Xing, Lejian Liao, Dandan Song, Jingang Wang, Fuzheng Zhang, Zhongyuan Wang, Heyan Huang

Abstract: Aspect-based sentiment analysis (ABSA) aims to predict fine-grained sentiments of comments with respect to given aspect terms or categories. In previous ABSA methods, the importance of aspect has been realized and verified. Most existing LSTM-based models take aspect into account via the attention mechanism, where the attention weights are calculated after the context is modeled in the form of con… ▽ More Aspect-based sentiment analysis (ABSA) aims to predict fine-grained sentiments of comments with respect to given aspect terms or categories. In previous ABSA methods, the importance of aspect has been realized and verified. Most existing LSTM-based models take aspect into account via the attention mechanism, where the attention weights are calculated after the context is modeled in the form of contextual vectors. However, aspect-related information may be already discarded and aspect-irrelevant information may be retained in classic LSTM cells in the context modeling process, which can be improved to generate more effective context representations. This paper proposes a novel variant of LSTM, termed as aspect-aware LSTM (AA-LSTM), which incorporates aspect information into LSTM cells in the context modeling stage before the attention mechanism. Therefore, our AA-LSTM can dynamically produce aspect-aware contextual representations. We experiment with several representative LSTM-based models by replacing the classic LSTM cells with the AA-LSTM cells. Experimental results on SemEval-2014 Datasets demonstrate the effectiveness of AA-LSTM. △ Less

Submitted 7 July, 2019; v1 submitted 19 May, 2019; originally announced May 2019.

Comments: accepted by IJCAI 2019

Creativity and Artificial Intelligence: A Digital Art Perspective

Authors: Bo Xing, Tshilidzi Marwala

Abstract: This paper describes the application of artificial intelligence to the creation of digital art. AI is a computational paradigm that codifies intelligence into machines. There are generally three types of artificial intelligence and these are machine learning, evolutionary programming and soft computing. Machine learning is the statistical approach to building intelligent systems. Evolutionary prog… ▽ More This paper describes the application of artificial intelligence to the creation of digital art. AI is a computational paradigm that codifies intelligence into machines. There are generally three types of artificial intelligence and these are machine learning, evolutionary programming and soft computing. Machine learning is the statistical approach to building intelligent systems. Evolutionary programming is the use of natural evolutionary systems to design intelligent machines. Some of the evolutionary programming systems include genetic algorithm which is inspired by the principles of evolution and swarm optimization which is inspired by the swarming of birds, fish, ants etc. Soft computing includes techniques such as agent based modelling and fuzzy logic. Opportunities on the applications of these to digital art are explored. △ Less

Submitted 21 July, 2018; originally announced July 2018.

Comments: 5 pages

Blockchain and Artificial Intelligence

Authors: Tshilidzi Marwala, Bo Xing

Abstract: It is undeniable that artificial intelligence (AI) and blockchain concepts are spreading at a phenomenal rate. Both technologies have distinct degree of technological complexity and multi-dimensional business implications. However, a common misunderstanding about blockchain concept, in particular, is that blockchain is decentralized and is not controlled by anyone. But the underlying development o… ▽ More It is undeniable that artificial intelligence (AI) and blockchain concepts are spreading at a phenomenal rate. Both technologies have distinct degree of technological complexity and multi-dimensional business implications. However, a common misunderstanding about blockchain concept, in particular, is that blockchain is decentralized and is not controlled by anyone. But the underlying development of a blockchain system is still attributed to a cluster of core developers. Take smart contract as an example, it is essentially a collection of codes (or functions) and data (or states) that are programmed and deployed on a blockchain (say, Ethereum) by different human programmers. It is thus, unfortunately, less likely to be free of loopholes and flaws. In this article, through a brief overview about how artificial intelligence could be used to deliver bug-free smart contract so as to achieve the goal of blockchain 2.0, we to emphasize that the blockchain implementation can be assisted or enhanced via various AI techniques. The alliance of AI and blockchain is expected to create numerous possibilities. △ Less

Submitted 23 October, 2018; v1 submitted 12 February, 2018; originally announced February 2018.

Period-doubling in period-$1$ steady states

Authors: Reuben R. W. Wang, Bo Xing, Gabriel G. Carlo, Dario Poletti

Abstract: Nonlinear classical dissipative systems present a rich phenomenology in their "route to chaos", including period-doubling, i.e. the system evolves with a period which is twice that of the driving. However, typically the attractor of a periodically driven quantum open system evolves with a period which exactly matches that of the driving. Here we analyze a manybody open quantum system whose classic… ▽ More Nonlinear classical dissipative systems present a rich phenomenology in their "route to chaos", including period-doubling, i.e. the system evolves with a period which is twice that of the driving. However, typically the attractor of a periodically driven quantum open system evolves with a period which exactly matches that of the driving. Here we analyze a manybody open quantum system whose classical correspondent presents period-doubling. We show that by analysing the spectrum of the periodic propagator and by studying the dynamical correlations, it is possible to show the occurrence of period-doubling in the quantum (period-$1$) steady state. We also discuss that such systems are natural candidates for clean Floquet time crystals. △ Less

Submitted 29 August, 2017; originally announced August 2017.

Comments: 5 pages, 4 figures

Journal ref: Phys. Rev. E 97, 020202 (2018)

Implications of the Fourth Industrial Age on Higher Education

Authors: Bo Xing, Tshilidzi Marwala

Abstract: Higher education in the fourth industrial revolution, HE 4.0, is a complex, dialectical and exciting opportunity which can potentially transform society for the better. The fourth industrial revolution is powered by artificial intelligence and it will transform the workplace from tasks based characteristics to the human centred characteristics. Because of the convergence of man and machine, it wil… ▽ More Higher education in the fourth industrial revolution, HE 4.0, is a complex, dialectical and exciting opportunity which can potentially transform society for the better. The fourth industrial revolution is powered by artificial intelligence and it will transform the workplace from tasks based characteristics to the human centred characteristics. Because of the convergence of man and machine, it will reduce the subject distance between humanities and social science as well as science and technology. This will necessarily require much more interdisciplinary teaching, research and innovation. This paper explores the impact of HE 4.0 on the mission of a university which is teaching, research (including innovation) and service. △ Less

Submitted 17 March, 2017; originally announced March 2017.

Comments: Submitted to The Thinker

Extraordinarily bound quasi-one-dimensional trions in two-dimensional phosphorene atomic semiconductors

Authors: Shuang Zhang, Renjing Xu, Fan Wang, Jiong Yang, Zhu Wang, Jiajie Pei, Ye Win Myint, Bobin Xing, Zongfu Yu, Lan Fu, Qinghua Qin, Yuerui Lu

Abstract: The anisotropic nature of the new two-dimensional (2D) material phosphorene, in contrast to other 2D materials such as graphene and transition metal dichalcogenide (TMD) semiconductors, allows excitons to be confined in a quasi-one-dimensional (1D) space predicted in theory, leading to remarkable phenomena arising from the reduced dimensionality and screening. Here, we report a trion (charged exci… ▽ More The anisotropic nature of the new two-dimensional (2D) material phosphorene, in contrast to other 2D materials such as graphene and transition metal dichalcogenide (TMD) semiconductors, allows excitons to be confined in a quasi-one-dimensional (1D) space predicted in theory, leading to remarkable phenomena arising from the reduced dimensionality and screening. Here, we report a trion (charged exciton) binding energy of 190 meV in few-layer phosphorene at room temperature, which is nearly one to two orders of magnitude larger than those in 2D TMD semiconductors (20-30 meV) and quasi-2D quantum wells (1-5 meV). Such a large binding energy has only been observed in truly 1D materials such as carbon nanotubes, whose optoelectronic applications have been severely hurdled by their intrinsically small optical cross-sections. Phosphorene offers an elegant way to overcome this hurdle by enabling quasi-1D excitonic and trionic behaviors in a large 2D area, allowing optoelectronic integration. We experimentally validated the quasi-1D nature of excitonic and trionic dynamics in phospherene by demonstrating completely linearly polarized light emission from excitons and trions. The implications of the extraordinarily large trion binding energy in a higher-than-one-dimensional material are far-reaching. It provides a room-temperature 2D platform to observe the fundamental many-body interactions in the quasi-1D region. The strong photoluminescence emission in phosphorene has been electrically tuned over a large spectral range at room temperature, which opens a new route for tunable light sources. △ Less

Submitted 22 November, 2014; originally announced November 2014.

Soft Computing in Product Recovery: A Survey Focusing on Remanufacturing System

Authors: Bo Xing, Wen-Jing Gao, Fulufhelo V. Nelwamondo, Kimberly Battle, Tshilidzi Marwala

Abstract: This paper focuses on the application of soft computing in remanufacturing system, in which end-of-life products are disassembled into basic components and then remanufactured for both economic and environmental reasons. The disassembly activities include disassembly sequencing and planning, while the remanufacturing process is composed of product design, production planning & scheduling, and inve… ▽ More This paper focuses on the application of soft computing in remanufacturing system, in which end-of-life products are disassembled into basic components and then remanufactured for both economic and environmental reasons. The disassembly activities include disassembly sequencing and planning, while the remanufacturing process is composed of product design, production planning & scheduling, and inventory management. This paper presents a review of the related articles and suggests the corresponding further research directions. △ Less

Submitted 5 June, 2012; originally announced June 2012.

Artificial Intelligence in Reverse Supply Chain Management: The State of the Art

Authors: Bo Xing, Wen-Jing Gao, Kimberly Battle, Tshildzi Marwala, Fulufhelo V. Nelwamondo

Abstract: Product take-back legislation forces manufacturers to bear the costs of collection and disposal of products that have reached the end of their useful lives. In order to reduce these costs, manufacturers can consider reuse, remanufacturing and/or recycling of components as an alternative to disposal. The implementation of such alternatives usually requires an appropriate reverse supply chain manage… ▽ More Product take-back legislation forces manufacturers to bear the costs of collection and disposal of products that have reached the end of their useful lives. In order to reduce these costs, manufacturers can consider reuse, remanufacturing and/or recycling of components as an alternative to disposal. The implementation of such alternatives usually requires an appropriate reverse supply chain management. With the concepts of reverse supply chain are gaining popularity in practice, the use of artificial intelligence approaches in these areas is also becoming popular. As a result, the purpose of this paper is to give an overview of the recent publications concerning the application of artificial intelligence techniques to reverse supply chain with emphasis on certain types of product returns. △ Less

Submitted 17 December, 2010; originally announced December 2010.

Comments: Proceedings of the Twenty-First Annual Symposium of the Pattern Recognition Association of South Africa 22-23 November 2010 Stellenbosch, South Africa, pp. 305-310