Showing 1–44 of 44 results for author: Kuang, J

Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation

Authors: Zhe Xu, Daoyuan Chen, Jiayi Kuang, Zihao Yi, Yaliang Li, Ying Shen

Abstract: Emotional Support Conversation (ESC) systems are pivotal in providing empathetic interactions, aiding users through negative emotional states by understanding and addressing their unique experiences. In this paper, we tackle two key challenges in ESC: enhancing contextually relevant and empathetic response generation through dynamic demonstration retrieval, and advancing cognitive understanding to… ▽ More Emotional Support Conversation (ESC) systems are pivotal in providing empathetic interactions, aiding users through negative emotional states by understanding and addressing their unique experiences. In this paper, we tackle two key challenges in ESC: enhancing contextually relevant and empathetic response generation through dynamic demonstration retrieval, and advancing cognitive understanding to grasp implicit mental states comprehensively. We introduce Dynamic Demonstration Retrieval and Cognitive-Aspect Situation Understanding (\ourwork), a novel approach that synergizes these elements to improve the quality of support provided in ESCs. By leveraging in-context learning and persona information, we introduce an innovative retrieval mechanism that selects informative and personalized demonstration pairs. We also propose a cognitive understanding module that utilizes four cognitive relationships from the ATOMIC knowledge source to deepen situational awareness of help-seekers' mental states. Our supportive decoder integrates information from diverse knowledge sources, underpinning response generation that is both empathetic and cognitively aware. The effectiveness of \ourwork is demonstrated through extensive automatic and human evaluations, revealing substantial improvements over numerous state-of-the-art models, with up to 13.79\% enhancement in overall performance of ten metrics. Our codes are available for public access to facilitate further research and development. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Comments: Accpeted by SIGIR 2024

MSC Class: 68T50 ACM Class: I.2.7

Knowledge-aware Alert Aggregation in Large-scale Cloud Systems: a Hybrid Approach

Authors: Jinxi Kuang, Jinyang Liu, Junjie Huang, Renyi Zhong, Jiazhen Gu, Lan Yu, Rui Tan, Zengyin Yang, Michael R. Lyu

Abstract: Due to the scale and complexity of cloud systems, a system failure would trigger an "alert storm", i.e., massive correlated alerts. Although these alerts can be traced back to a few root causes, the overwhelming number makes it infeasible for manual handling. Alert aggregation is thus critical to help engineers concentrate on the root cause and facilitate failure resolution. Existing methods typic… ▽ More Due to the scale and complexity of cloud systems, a system failure would trigger an "alert storm", i.e., massive correlated alerts. Although these alerts can be traced back to a few root causes, the overwhelming number makes it infeasible for manual handling. Alert aggregation is thus critical to help engineers concentrate on the root cause and facilitate failure resolution. Existing methods typically utilize semantic similarity-based methods or statistical methods to aggregate alerts. However, semantic similarity-based methods overlook the causal rationale of alerts, while statistical methods can hardly handle infrequent alerts. To tackle these limitations, we introduce leveraging external knowledge, i.e., Standard Operation Procedure (SOP) of alerts as a supplement. We propose COLA, a novel hybrid approach based on correlation mining and LLM (Large Language Model) reasoning for online alert aggregation. The correlation mining module effectively captures the temporal and spatial relations between alerts, measuring their correlations in an efficient manner. Subsequently, only uncertain pairs with low confidence are forwarded to the LLM reasoning module for detailed analysis. This hybrid design harnesses both statistical evidence for frequent alerts and the reasoning capabilities of computationally intensive LLMs, ensuring the overall efficiency of COLA in handling large volumes of alerts in practical scenarios. We evaluate COLA on three datasets collected from the production environment of a large-scale cloud platform. The experimental results show COLA achieves F1-scores from 0.901 to 0.930, outperforming state-of-the-art methods and achieving comparable efficiency. We also share our experience in deploying COLA in our real-world cloud system, Cloud X. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: Accepted by Proceedings of the 46th International Conference on Software Engineering: Software Engineering in Practice (ICSE SEIP 2024)

Neural Automated Writing Evaluation with Corrective Feedback

Authors: Izia Xiaoxiao Wang, Xihan Wu, Edith Coates, Min Zeng, Jiexin Kuang, Siliang Liu, Mengyang Qiu, Jungyeul Park

Abstract: The utilization of technology in second language learning and teaching has become ubiquitous. For the assessment of writing specifically, automated writing evaluation (AWE) and grammatical error correction (GEC) have become immensely popular and effective methods for enhancing writing proficiency and delivering instant and individualized feedback to learners. By leveraging the power of natural lan… ▽ More The utilization of technology in second language learning and teaching has become ubiquitous. For the assessment of writing specifically, automated writing evaluation (AWE) and grammatical error correction (GEC) have become immensely popular and effective methods for enhancing writing proficiency and delivering instant and individualized feedback to learners. By leveraging the power of natural language processing (NLP) and machine learning algorithms, AWE and GEC systems have been developed separately to provide language learners with automated corrective feedback and more accurate and unbiased scoring that would otherwise be subject to examiners. In this paper, we propose an integrated system for automated writing evaluation with corrective feedback as a means of bridging the gap between AWE and GEC results for second language learners. This system enables language learners to simulate the essay writing tests: a student writes and submits an essay, and the system returns the assessment of the writing along with suggested grammatical error corrections. Given that automated scoring and grammatical correction are more efficient and cost-effective than human grading, this integrated system would also alleviate the burden of manually correcting innumerable essays. △ Less

Submitted 6 May, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

Comments: Supported by the SoTL Seed Program at UBC

Evaluating Prompting Strategies for Grammatical Error Correction Based on Language Proficiency

Authors: Min Zeng, Jiexin Kuang, Mengyang Qiu, Jayoung Song, Jungyeul Park

Abstract: The writing examples of English language learners may be different from those of native speakers. Given that there is a significant differences in second language (L2) learners' error types by their proficiency levels, this paper attempts to reduce overcorrection by examining the interaction between LLM's performance and L2 language proficiency. Our method focuses on zero-shot and few-shot prompti… ▽ More The writing examples of English language learners may be different from those of native speakers. Given that there is a significant differences in second language (L2) learners' error types by their proficiency levels, this paper attempts to reduce overcorrection by examining the interaction between LLM's performance and L2 language proficiency. Our method focuses on zero-shot and few-shot prompting and fine-tuning models for GEC for learners of English as a foreign language based on the different proficiency. We investigate GEC results and find that overcorrection happens primarily in advanced language learners' writing (proficiency C) rather than proficiency A (a beginner level) and proficiency B (an intermediate level). Fine-tuned LLMs, and even few-shot prompting with writing examples of English learners, actually tend to exhibit decreased recall measures. To make our claim concrete, we conduct a comprehensive examination of GEC outcomes and their evaluation results based on language proficiency. △ Less

Submitted 24 February, 2024; originally announced February 2024.

Comments: To appear in LREC-COLING 2024, short paper (preprint)

Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection

Authors: Jiawei Liang, Siyuan Liang, Aishan Liu, Xiaojun Jia, Junhao Kuang, Xiaochun Cao

Abstract: The proliferation of face forgery techniques has raised significant concerns within society, thereby motivating the development of face forgery detection methods. These methods aim to distinguish forged faces from genuine ones and have proven effective in practical applications. However, this paper introduces a novel and previously unrecognized threat in face forgery detection scenarios caused by… ▽ More The proliferation of face forgery techniques has raised significant concerns within society, thereby motivating the development of face forgery detection methods. These methods aim to distinguish forged faces from genuine ones and have proven effective in practical applications. However, this paper introduces a novel and previously unrecognized threat in face forgery detection scenarios caused by backdoor attack. By embedding backdoors into models and incorporating specific trigger patterns into the input, attackers can deceive detectors into producing erroneous predictions for forged faces. To achieve this goal, this paper proposes \emph{Poisoned Forgery Face} framework, which enables clean-label backdoor attacks on face forgery detectors. Our approach involves constructing a scalable trigger generator and utilizing a novel convolving process to generate translation-sensitive trigger patterns. Moreover, we employ a relative embedding method based on landmark-based regions to enhance the stealthiness of the poisoned samples. Consequently, detectors trained on our poisoned samples are embedded with backdoors. Notably, our approach surpasses SoTA backdoor baselines with a significant improvement in attack success rate (+16.39\% BD-AUC) and reduction in visibility (-12.65\% $L_\infty$). Furthermore, our attack exhibits promising performance against backdoor defenses. We anticipate that this paper will draw greater attention to the potential threats posed by backdoor attacks in face forgery detection scenarios. Our codes will be made available at \url{https://github.com/JWLiang007/PFF} △ Less

Submitted 18 February, 2024; originally announced February 2024.

Comments: ICLR 2024 Spotlight

MIFI: MultI-camera Feature Integration for Roust 3D Distracted Driver Activity Recognition

Authors: Jian Kuang, Wenjing Li, Fang Li, Jun Zhang, Zhongcheng Wu

Abstract: Distracted driver activity recognition plays a critical role in risk aversion-particularly beneficial in intelligent transportation systems. However, most existing methods make use of only the video from a single view and the difficulty-inconsistent issue is neglected. Different from them, in this work, we propose a novel MultI-camera Feature Integration (MIFI) approach for 3D distracted driver ac… ▽ More Distracted driver activity recognition plays a critical role in risk aversion-particularly beneficial in intelligent transportation systems. However, most existing methods make use of only the video from a single view and the difficulty-inconsistent issue is neglected. Different from them, in this work, we propose a novel MultI-camera Feature Integration (MIFI) approach for 3D distracted driver activity recognition by jointly modeling the data from different camera views and explicitly re-weighting examples based on their degree of difficulty. Our contributions are two-fold: (1) We propose a simple but effective multi-camera feature integration framework and provide three types of feature fusion techniques. (2) To address the difficulty-inconsistent problem in distracted driver activity recognition, a periodic learning method, named example re-weighting that can jointly learn the easy and hard samples, is presented. The experimental results on the 3MDAD dataset demonstrate that the proposed MIFI can consistently boost performance compared to single-view models. △ Less

Submitted 25 January, 2024; originally announced January 2024.

Comments: Accepted by IEEE Transactions on Intelligent Transportation Systems. Minor typos have been fixed in Table IV

A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily

Authors: Peng Ding, Jun Kuang, Dan Ma, Xuezhi Cao, Yunsen Xian, Jiajun Chen, Shujian Huang

Abstract: Large Language Models (LLMs), such as ChatGPT and GPT-4, are designed to provide useful and safe responses. However, adversarial prompts known as 'jailbreaks' can circumvent safeguards, leading LLMs to generate potentially harmful content. Exploring jailbreak prompts can help to better reveal the weaknesses of LLMs and further steer us to secure them. Unfortunately, existing jailbreak methods eith… ▽ More Large Language Models (LLMs), such as ChatGPT and GPT-4, are designed to provide useful and safe responses. However, adversarial prompts known as 'jailbreaks' can circumvent safeguards, leading LLMs to generate potentially harmful content. Exploring jailbreak prompts can help to better reveal the weaknesses of LLMs and further steer us to secure them. Unfortunately, existing jailbreak methods either suffer from intricate manual design or require optimization on other white-box models, which compromises either generalization or efficiency. In this paper, we generalize jailbreak prompt attacks into two aspects: (1) Prompt Rewriting and (2) Scenario Nesting. Based on this, we propose ReNeLLM, an automatic framework that leverages LLMs themselves to generate effective jailbreak prompts. Extensive experiments demonstrate that ReNeLLM significantly improves the attack success rate while greatly reducing the time cost compared to existing baselines. Our study also reveals the inadequacy of current defense methods in safeguarding LLMs. Finally, we analyze the failure of LLMs defense from the perspective of prompt execution priority, and propose corresponding defense strategies. We hope that our research can catalyze both the academic community and LLMs developers towards the provision of safer and more regulated LLMs. The code is available at https://github.com/NJUNLP/ReNeLLM. △ Less

Submitted 6 April, 2024; v1 submitted 14 November, 2023; originally announced November 2023.

Comments: Acccepted by NAACL 2024, 18 pages, 7 figures, 13 tables

On Calibration of Modern Quantized Efficient Neural Networks

Authors: Joey Kuang, Alexander Wong

Abstract: We explore calibration properties at various precisions for three architectures: ShuffleNetv2, GhostNet-VGG, and MobileOne; and two datasets: CIFAR-100 and PathMNIST. The quality of calibration is observed to track the quantization quality; it is well-documented that performance worsens with lower precision, and we observe a similar correlation with poorer calibration. This becomes especially egre… ▽ More We explore calibration properties at various precisions for three architectures: ShuffleNetv2, GhostNet-VGG, and MobileOne; and two datasets: CIFAR-100 and PathMNIST. The quality of calibration is observed to track the quantization quality; it is well-documented that performance worsens with lower precision, and we observe a similar correlation with poorer calibration. This becomes especially egregious at 4-bit activation regime. GhostNet-VGG is shown to be the most robust to overall performance drop at lower precision. We find that temperature scaling can improve calibration error for quantized networks, with some caveats. We hope that these preliminary insights can lead to more opportunities for explainable and reliable EdgeML. △ Less

Submitted 26 September, 2023; v1 submitted 25 September, 2023; originally announced September 2023.

Comments: Accepted as an extended abstract at the ICCV 2023 Workshop on Low-Bit Quantized Neural Networks. Corrected some typos

ICDAR 2023 Competition on Structured Text Extraction from Visually-Rich Document Images

Authors: Wenwen Yu, Chengquan Zhang, Haoyu Cao, Wei Hua, Bohan Li, Huang Chen, Mingyu Liu, Mingrui Chen, Jianfeng Kuang, Mengjun Cheng, Yuning Du, Shikun Feng, Xiaoguang Hu, Pengyuan Lyu, Kun Yao, Yuechen Yu, Yuliang Liu, Wanxiang Che, Errui Ding, Cheng-Lin Liu, Jiebo Luo, Shuicheng Yan, Min Zhang, Dimosthenis Karatzas, Xing Sun , et al. (2 additional authors not shown)

Abstract: Structured text extraction is one of the most valuable and challenging application directions in the field of Document AI. However, the scenarios of past benchmarks are limited, and the corresponding evaluation protocols usually focus on the submodules of the structured text extraction scheme. In order to eliminate these problems, we organized the ICDAR 2023 competition on Structured text extracti… ▽ More Structured text extraction is one of the most valuable and challenging application directions in the field of Document AI. However, the scenarios of past benchmarks are limited, and the corresponding evaluation protocols usually focus on the submodules of the structured text extraction scheme. In order to eliminate these problems, we organized the ICDAR 2023 competition on Structured text extraction from Visually-Rich Document images (SVRD). We set up two tracks for SVRD including Track 1: HUST-CELL and Track 2: Baidu-FEST, where HUST-CELL aims to evaluate the end-to-end performance of Complex Entity Linking and Labeling, and Baidu-FEST focuses on evaluating the performance and generalization of Zero-shot / Few-shot Structured Text extraction from an end-to-end perspective. Compared to the current document benchmarks, our two tracks of competition benchmark enriches the scenarios greatly and contains more than 50 types of visually-rich document images (mainly from the actual enterprise applications). The competition opened on 30th December, 2022 and closed on 24th March, 2023. There are 35 participants and 91 valid submissions received for Track 1, and 15 participants and 26 valid submissions received for Track 2. In this report we will presents the motivation, competition datasets, task definition, evaluation protocol, and submission summaries. According to the performance of the submissions, we believe there is still a large gap on the expected information extraction performance for complex and zero-shot scenarios. It is hoped that this competition will attract many researchers in the field of CV and NLP, and bring some new thoughts to the field of Document AI. △ Less

Submitted 5 June, 2023; originally announced June 2023.

Comments: ICDAR 2023 Competition on SVRD report (To be appear in ICDAR 2023)

What Symptoms and How Long? An Interpretable AI Approach for Depression Detection in Social Media

Authors: Junwei Kuang, Jiaheng Xie, Zhijun Yan

Abstract: Depression is the most prevalent and serious mental illness, which induces grave financial and societal ramifications. Depression detection is key for early intervention to mitigate those consequences. Such a high-stake decision inherently necessitates interpretability. Although a few depression detection studies attempt to explain the decision based on the importance score or attention weights, t… ▽ More Depression is the most prevalent and serious mental illness, which induces grave financial and societal ramifications. Depression detection is key for early intervention to mitigate those consequences. Such a high-stake decision inherently necessitates interpretability. Although a few depression detection studies attempt to explain the decision based on the importance score or attention weights, these explanations misalign with the clinical depression diagnosis criterion that is based on depressive symptoms. To fill this gap, we follow the computational design science paradigm to develop a novel Multi-Scale Temporal Prototype Network (MSTPNet). MSTPNet innovatively detects and interprets depressive symptoms as well as how long they last. Extensive empirical analyses using a large-scale dataset show that MSTPNet outperforms state-of-the-art depression detection methods with an F1-score of 0.851. This result also reveals new symptoms that are unnoted in the survey approach, such as sharing admiration for a different life. We further conduct a user study to demonstrate its superiority over the benchmarks in interpretability. This study contributes to IS literature with a novel interpretable deep learning model for depression detection in social media. In practice, our proposed method can be implemented in social media platforms to provide personalized online resources for detected depressed patients. △ Less

Submitted 24 July, 2023; v1 submitted 18 May, 2023; originally announced May 2023.

Comments: 56 pages, 10 figures, 21 tables

Visual Information Extraction in the Wild: Practical Dataset and End-to-end Solution

Authors: Jianfeng Kuang, Wei Hua, Dingkang Liang, Mingkun Yang, Deqiang Jiang, Bo Ren, Xiang Bai

Abstract: Visual information extraction (VIE), which aims to simultaneously perform OCR and information extraction in a unified framework, has drawn increasing attention due to its essential role in various applications like understanding receipts, goods, and traffic signs. However, as existing benchmark datasets for VIE mainly consist of document images without the adequate diversity of layout structures,… ▽ More Visual information extraction (VIE), which aims to simultaneously perform OCR and information extraction in a unified framework, has drawn increasing attention due to its essential role in various applications like understanding receipts, goods, and traffic signs. However, as existing benchmark datasets for VIE mainly consist of document images without the adequate diversity of layout structures, background disturbs, and entity categories, they cannot fully reveal the challenges of real-world applications. In this paper, we propose a large-scale dataset consisting of camera images for VIE, which contains not only the larger variance of layout, backgrounds, and fonts but also much more types of entities. Besides, we propose a novel framework for end-to-end VIE that combines the stages of OCR and information extraction in an end-to-end learning fashion. Different from the previous end-to-end approaches that directly adopt OCR features as the input of an information extraction module, we propose to use contrastive learning to narrow the semantic gap caused by the difference between the tasks of OCR and information extraction. We evaluate the existing end-to-end methods for VIE on the proposed dataset and observe that the performance of these methods has a distinguishable drop from SROIE (a widely used English dataset) to our proposed dataset due to the larger variance of layout and entities. These results demonstrate our dataset is more practical for promoting advanced VIE algorithms. In addition, experiments demonstrate that the proposed VIE method consistently achieves the obvious performance gains on the proposed and SROIE datasets. △ Less

Submitted 14 June, 2023; v1 submitted 12 May, 2023; originally announced May 2023.

Comments: 15 pages, 6 figures, ICDAR2023

Meta-Learning Triplet Network with Adaptive Margins for Few-Shot Named Entity Recognition

Authors: Chengcheng Han, Renyu Zhu, Jun Kuang, FengJiao Chen, Xiang Li, Ming Gao, Xuezhi Cao, Wei Wu

Abstract: Meta-learning methods have been widely used in few-shot named entity recognition (NER), especially prototype-based methods. However, the Other(O) class is difficult to be represented by a prototype vector because there are generally a large number of samples in the class that have miscellaneous semantics. To solve the problem, we propose MeTNet, which generates prototype vectors for entity types o… ▽ More Meta-learning methods have been widely used in few-shot named entity recognition (NER), especially prototype-based methods. However, the Other(O) class is difficult to be represented by a prototype vector because there are generally a large number of samples in the class that have miscellaneous semantics. To solve the problem, we propose MeTNet, which generates prototype vectors for entity types only but not O-class. We design an improved triplet network to map samples and prototype vectors into a low-dimensional space that is easier to be classified and propose an adaptive margin for each entity type. The margin plays as a radius and controls a region with adaptive size in the low-dimensional space. Based on the regions, we propose a new inference procedure to predict the label of a query instance. We conduct extensive experiments in both in-domain and cross-domain settings to show the superiority of MeTNet over other state-of-the-art methods. In particular, we release a Chinese few-shot NER dataset FEW-COMM extracted from a well-known e-commerce platform. To the best of our knowledge, this is the first Chinese few-shot NER dataset. All the datasets and codes are provided at https://github.com/hccngu/MeTNet. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Wheel-SLAM: Simultaneous Localization and Terrain Mapping Using One Wheel-mounted IMU

Authors: Yibin Wu, Jian Kuang, Xiaoji Niu, Jens Behley, Lasse Klingbeil, Heiner Kuhlmann

Abstract: A reliable pose estimator robust to environmental disturbances is desirable for mobile robots. To this end, inertial measurement units (IMUs) play an important role because they can perceive the full motion state of the vehicle independently. However, it suffers from accumulative error due to inherent noise and bias instability, especially for low-cost sensors. In our previous studies on Wheel-INS… ▽ More A reliable pose estimator robust to environmental disturbances is desirable for mobile robots. To this end, inertial measurement units (IMUs) play an important role because they can perceive the full motion state of the vehicle independently. However, it suffers from accumulative error due to inherent noise and bias instability, especially for low-cost sensors. In our previous studies on Wheel-INS \cite{niu2021, wu2021}, we proposed to limit the error drift of the pure inertial navigation system (INS) by mounting an IMU to the wheel of the robot to take advantage of rotation modulation. However, Wheel-INS still drifted over a long period of time due to the lack of external correction signals. In this letter, we propose to exploit the environmental perception ability of Wheel-INS to achieve simultaneous localization and mapping (SLAM) with only one IMU. To be specific, we use the road bank angles (mirrored by the robot roll angles estimated by Wheel-INS) as terrain features to enable the loop closure with a Rao-Blackwellized particle filter. The road bank angle is sampled and stored according to the robot position in the grid maps maintained by the particles. The weights of the particles are updated according to the difference between the currently estimated roll sequence and the terrain map. Field experiments suggest the feasibility of the idea to perform SLAM in Wheel-INS using the robot roll angle estimates. In addition, the positioning accuracy is improved significantly (more than 30\%) over Wheel-INS. The source code of our implementation is publicly available (https://github.com/i2Nav-WHU/Wheel-SLAM). △ Less

Submitted 29 November, 2022; v1 submitted 6 November, 2022; originally announced November 2022.

Comments: Accepted to IEEE Robotics and Automation Letters

CodeGen-Test: An Automatic Code Generation Model Integrating Program Test Information

Authors: Maosheng Zhong, Gen Liu, Hongwei Li, Jiangling Kuang, Jinshan Zeng, Mingwen Wang

Abstract: Automatic code generation is to generate the program code according to the given natural language description. The current mainstream approach uses neural networks to encode natural language descriptions, and output abstract syntax trees (AST) at the decoder, then convert the AST into program code. While the generated code largely conforms to specific syntax rules, two problems are still ignored.… ▽ More Automatic code generation is to generate the program code according to the given natural language description. The current mainstream approach uses neural networks to encode natural language descriptions, and output abstract syntax trees (AST) at the decoder, then convert the AST into program code. While the generated code largely conforms to specific syntax rules, two problems are still ignored. One is missing program testing, an essential step in the process of complete code implementation; the other is only focusing on the syntax compliance of the generated code, while ignoring the more important program functional requirements. The paper proposes a CodeGen-Test model, which adds program testing steps and incorporates program testing information to iteratively generate code that meets the functional requirements of the program, thereby improving the quality of code generation. At the same time, the paper proposes a new evaluation metric, test accuracy (Test-Acc), which represents the proportion of passing program test in generated code. Different from the previous evaluation metric, which only evaluates the quality of code generation from the perspective of character similarity, the Test-Acc can evaluate the quality of code generation from the Program functions. Moreover, the paper evaluates the CodeGen-test model on a python data set "hearthstone legend". The experimental results show the proposed method can effectively improve the quality of generated code. Compared with the existing optimal model, CodeGen-Test model improves the Bleu value by 0.2%, Rouge-L value by 0.3% and Test-Acc by 6%. △ Less

Submitted 14 February, 2022; originally announced February 2022.

Comments: 10 paper pages, 7 figures; 2 appendix pages, 5 appendix figures

ACM Class: D.2.2

CoughTrigger: Earbuds IMU Based Cough Detection Activator Using An Energy-efficient Sensitivity-prioritized Time Series Classifier

Authors: Shibo Zhang, Ebrahim Nemati, Minh Dinh, Nathan Folkman, Tousif Ahmed, Mahbubur Rahman, Jilong Kuang, Nabil Alshurafa, Alex Gao

Abstract: Persistent coughs are a major symptom of respiratory-related diseases. Increasing research attention has been paid to detecting coughs using wearables, especially during the COVID-19 pandemic. Among all types of sensors utilized, microphone is most widely used to detect coughs. However, the intense power consumption needed to process audio signals hinders continuous audio-based cough detection on… ▽ More Persistent coughs are a major symptom of respiratory-related diseases. Increasing research attention has been paid to detecting coughs using wearables, especially during the COVID-19 pandemic. Among all types of sensors utilized, microphone is most widely used to detect coughs. However, the intense power consumption needed to process audio signals hinders continuous audio-based cough detection on battery-limited commercial wearable products, such as earbuds. We present CoughTrigger, which utilizes a lower-power sensor, an inertial measurement unit (IMU), in earbuds as a cough detection activator to trigger a higher-power sensor for audio processing and classification. It is able to run all-the-time as a standby service with minimal battery consumption and trigger the audio-based cough detection when a candidate cough is detected from IMU. Besides, the use of IMU brings the benefit of improved specificity of cough detection. Experiments are conducted on 45 subjects and our IMU-based model achieved 0.77 AUC score under leave one subject out evaluation. We also validated its effectiveness on free-living data and through on-device implementation. △ Less

Submitted 7 November, 2021; originally announced November 2021.

Feature Learning and Network Structure from Noisy Node Activity Data

Authors: Junyao Kuang, Caterina Scoglio, Kristin Michel

Abstract: In the studies of network structures, much attention has been devoted to developing approaches to reconstruct networks and predict missing links when edge-related information is given. However, such approaches are not applicable when we are only given noisy node activity data with missing values. This work presents an unsupervised learning framework to learn node vectors and construct networks fro… ▽ More In the studies of network structures, much attention has been devoted to developing approaches to reconstruct networks and predict missing links when edge-related information is given. However, such approaches are not applicable when we are only given noisy node activity data with missing values. This work presents an unsupervised learning framework to learn node vectors and construct networks from such node activity data. First, we design a scheme to generate random node sequences from node context sets, which are generated from node activity data. Then, a three-layer neural network is adopted training the node sequences to obtain node vectors, which allow us to construct networks and capture nodes with synergistic roles. Furthermore, we present an entropy-based approach to select the most meaningful neighbors for each node in the resulting network. Finally, the effectiveness of the method is validated through both synthetic and real data. △ Less

Submitted 2 December, 2022; v1 submitted 4 November, 2021; originally announced November 2021.

Journal ref: Phys. Rev. E 106, 064301, 2022

A Novel Multi-Centroid Template Matching Algorithm and Its Application to Cough Detection

Authors: Shibo Zhang, Ebrahim Nemati, Tousif Ahmed, Md Mahbubur Rahman, Jilong Kuang, Alex Gao

Abstract: Cough is a major symptom of respiratory-related diseases. There exists a tremendous amount of work in detecting coughs from audio but there has been no effort to identify coughs from solely inertial measurement unit (IMU). Coughing causes motion across the whole body and especially on the neck and head. Therefore, head motion data during coughing captured by a head-worn IMU sensor could be leverag… ▽ More Cough is a major symptom of respiratory-related diseases. There exists a tremendous amount of work in detecting coughs from audio but there has been no effort to identify coughs from solely inertial measurement unit (IMU). Coughing causes motion across the whole body and especially on the neck and head. Therefore, head motion data during coughing captured by a head-worn IMU sensor could be leveraged to detect coughs using a template matching algorithm. In time series template matching problems, K-Nearest Neighbors (KNN) combined with elastic distance measurement (esp. Dynamic Time Warping (DTW)) achieves outstanding performance. However, it is often regarded as prohibitively time-consuming. Nearest Centroid Classifier is thereafter proposed. But the accuracy is comprised of only one centroid obtained for each class. Centroid-based Classifier performs clustering and averaging for each cluster, but requires manually setting the number of clusters. We propose a novel self-tuning multi-centroid template-matching algorithm, which can automatically adjust the number of clusters to balance accuracy and inference time. Through experiments conducted on synthetic datasets and a real-world earbud-based cough dataset, we demonstrate the superiority of our proposed algorithm and present the result of cough detection with a single accelerometer sensor on the earbuds platform. △ Less

Submitted 4 September, 2021; v1 submitted 1 September, 2021; originally announced September 2021.

ACM Class: I.5.4; I.5.1

A principled approach for weighted multilayer network aggregation

Authors: Junyao Kuang, Caterina Scoglio

Abstract: A multilayer network depicts different types of interactions among the same set of nodes. For example, protease networks consist of five to seven layers, where different layers represent distinct types of experimentally confirmed molecule interactions among proteins. In a multilayer protease network, the co-expression layer is obtained through the meta-analysis of transcriptomic data from various… ▽ More A multilayer network depicts different types of interactions among the same set of nodes. For example, protease networks consist of five to seven layers, where different layers represent distinct types of experimentally confirmed molecule interactions among proteins. In a multilayer protease network, the co-expression layer is obtained through the meta-analysis of transcriptomic data from various sources and platforms. While in some researches the co-expression layer is in turn represented as a multilayered network, a fundamental problem is how to obtain a single-layer network from the corresponding multilayered network. This process is called multilayer network aggregation. In this work, we propose a maximum a posteriori estimation-based algorithm for multilayer network aggregation. The method allows to aggregate a weighted multilayer network while conserving the core information of the layers. We evaluate the method through an unweighted friendship network and a multilayer gene co-expression network. We compare the aggregated gene co-expression network with a network obtained from conflated datasets and a network obtained from averaged weights. The Von Neumann entropy is adopted to compare the mixedness of the three networks, and, together with other network measurements, shows the effectiveness of the proposes method. △ Less

Submitted 9 March, 2021; originally announced March 2021.

Layer reconstruction and missing link prediction of multilayer network with a Maximum A Posteriori estimation

Authors: Junyao Kuang, Caterina Scoglio

Abstract: A multilayer network is composed of multiple layers, where different layers have the same set of vertices but represent different types of interactions. Nevertheless, some layers are interdependent or structurally similar in the multilayer network. In this paper, we present a maximum a posteriori estimation based model to reconstruct a specific layer in the multilayer network. The SimHash algorith… ▽ More A multilayer network is composed of multiple layers, where different layers have the same set of vertices but represent different types of interactions. Nevertheless, some layers are interdependent or structurally similar in the multilayer network. In this paper, we present a maximum a posteriori estimation based model to reconstruct a specific layer in the multilayer network. The SimHash algorithm is used to compute the similarities between various layers. And the layers with similar structures are used to determine the parameters of the conjugate prior. With this model, we can also predict missing links and direct experiments for finding potential links. We test the method through two real multilayer networks, and the results show that the maximum a posteriori estimation is promising in reconstructing the layer of interest even with a large number of missing links. △ Less

Submitted 15 October, 2021; v1 submitted 7 January, 2021; originally announced January 2021.

Journal ref: Phys. Rev. E 104, (2021) 024301

Wheel-INS2: Multiple MEMS IMU-based Dead Reckoning System for Wheeled Robots with Evaluation of Different IMU Configurations

Authors: Yibin Wu, Jian Kuang, Xiaoji Niu

Abstract: A reliable self-contained navigation system is essential for autonomous vehicles. Based on our previous study on Wheel-INS \cite{niu2019}, a wheel-mounted inertial measurement unit (Wheel-IMU)-based dead reckoning (DR) system, in this paper, we propose a multiple IMUs-based DR solution for the wheeled robots. The IMUs are mounted at different places of the wheeled vehicles to acquire various dynam… ▽ More A reliable self-contained navigation system is essential for autonomous vehicles. Based on our previous study on Wheel-INS \cite{niu2019}, a wheel-mounted inertial measurement unit (Wheel-IMU)-based dead reckoning (DR) system, in this paper, we propose a multiple IMUs-based DR solution for the wheeled robots. The IMUs are mounted at different places of the wheeled vehicles to acquire various dynamic information. In particular, at least one IMU has to be mounted at the wheel to measure the wheel velocity and take advantages of the rotation modulation. The system is implemented through a distributed extended Kalman filter structure where each subsystem (corresponding to each IMU) retains and updates its own states separately. The relative position constraints between the multiple IMUs are exploited to further limit the error drift and improve the system robustness. Particularly, we present the DR systems using dual Wheel-IMUs, one Wheel-IMU plus one vehicle body-mounted IMU (Body-IMU), and dual Wheel-IMUs plus one Body-IMU as examples for analysis and comparison. Field tests illustrate that the proposed multi-IMU DR system outperforms the single Wheel-INS in terms of both positioning and heading accuracy. By comparing with the centralized filter, the proposed distributed filter shows unimportant accuracy degradation while holds significant computation efficiency. Moreover, among the three multi-IMU configurations, the one Body-IMU plus one Wheel-IMU design obtains the minimum drift rate. The position drift rates of the three configurations are 0.82\% (dual Wheel-IMUs), 0.69\% (one Body-IMU plus one Wheel-IMU), and 0.73\% (dual Wheel-IMUs plus one Body-IMU), respectively. △ Less

Submitted 8 November, 2022; v1 submitted 18 December, 2020; originally announced December 2020.

Comments: Accepted to IEEE Transactions on Intelligent Transportation Systems

A Comparison of Three Measurement Models for the Wheel-mounted MEMS IMU-based Dead Reckoning System

Authors: Yibin Wu, Xiaoji Niu, Jian Kuang

Abstract: A self-contained autonomous dead reckoning (DR) system is desired to complement the Global Navigation Satellite System (GNSS) for land vehicles, for which odometer-aided inertial navigation system (ODO/INS) is a classical solution. In this study, we use a wheel-mounted MEMS IMU (Wheel-IMU) to substitute the odometer, and further, investigate three types of measurement models, including the velocit… ▽ More A self-contained autonomous dead reckoning (DR) system is desired to complement the Global Navigation Satellite System (GNSS) for land vehicles, for which odometer-aided inertial navigation system (ODO/INS) is a classical solution. In this study, we use a wheel-mounted MEMS IMU (Wheel-IMU) to substitute the odometer, and further, investigate three types of measurement models, including the velocity measurement, displacement increment measurement, and contact point zero-velocity measurement, in the Wheel-IMU based DR system. The measurement produced by the Wheel-IMU along with the non-holonomic constraint (NHC) are fused with INS through an error-state extended Kalman filter (EKF). Theoretical discussion and field tests illustrate the feasibility and equivalence of the three measurements in terms of the overall DR performance. The maximum horizontal position drifts are all less than 2% of the total travelled distance. Additionally, the displacement increment measurement model is less sensitive to the lever arm error between the Wheel-IMU and the wheel center. △ Less

Submitted 1 June, 2021; v1 submitted 18 December, 2020; originally announced December 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:1912.07805

Learning Relation Prototype from Unlabeled Texts for Long-tail Relation Extraction

Authors: Yixin Cao, Jun Kuang, Ming Gao, Aoying Zhou, Yonggang Wen, Tat-Seng Chua

Abstract: Relation Extraction (RE) is a vital step to complete Knowledge Graph (KG) by extracting entity relations from texts.However, it usually suffers from the long-tail issue. The training data mainly concentrates on a few types of relations, leading to the lackof sufficient annotations for the remaining types of relations. In this paper, we propose a general approach to learn relation prototypesfrom un… ▽ More Relation Extraction (RE) is a vital step to complete Knowledge Graph (KG) by extracting entity relations from texts.However, it usually suffers from the long-tail issue. The training data mainly concentrates on a few types of relations, leading to the lackof sufficient annotations for the remaining types of relations. In this paper, we propose a general approach to learn relation prototypesfrom unlabeled texts, to facilitate the long-tail relation extraction by transferring knowledge from the relation types with sufficient trainingdata. We learn relation prototypes as an implicit factor between entities, which reflects the meanings of relations as well as theirproximities for transfer learning. Specifically, we construct a co-occurrence graph from texts, and capture both first-order andsecond-order entity proximities for embedding learning. Based on this, we further optimize the distance from entity pairs tocorresponding prototypes, which can be easily adapted to almost arbitrary RE frameworks. Thus, the learning of infrequent or evenunseen relation types will benefit from semantically proximate relations through pairs of entities and large-scale textual information.We have conducted extensive experiments on two publicly available datasets: New York Times and Google Distant Supervision.Compared with eight state-of-the-art baselines, our proposed model achieves significant improvements (4.1% F1 on average). Furtherresults on long-tail relations demonstrate the effectiveness of the learned relation prototypes. We further conduct an ablation study toinvestigate the impacts of varying components, and apply it to four basic relation extraction models to verify the generalization ability.Finally, we analyze several example cases to give intuitive impressions as qualitative analysis. Our codes will be released later. △ Less

Submitted 27 November, 2020; originally announced November 2020.

Wheel-INS: A Wheel-mounted MEMS IMU-based Dead Reckoning System

Authors: Xiaoji Niu, Yibin Wu, Jian Kuang

Abstract: To improve the accuracy and robustness of the inertial navigation systems (INS) for wheeled robots without adding additional component cost, we propose Wheel-INS, a complete dead reckoning solution based on a wheel-mounted microelectromechanical system (MEMS) inertial measurement unit (IMU). There are two major advantages by mounting an IMU to the center of a non-steering wheel of the ground vehic… ▽ More To improve the accuracy and robustness of the inertial navigation systems (INS) for wheeled robots without adding additional component cost, we propose Wheel-INS, a complete dead reckoning solution based on a wheel-mounted microelectromechanical system (MEMS) inertial measurement unit (IMU). There are two major advantages by mounting an IMU to the center of a non-steering wheel of the ground vehicle. Firstly, the gyroscope outputs can be used to calculate the wheel speed, so as to replace the traditional odometer to mitigate the error drift of INS. Secondly, with the rotation of the wheel, the constant bias error of the inertial sensor can be canceled to some extent. The installation scheme of the wheel-mounted IMU (Wheel-IMU), the system characteristics, and the dead reckoning error analysis are described. Experimental results show that the maximum position drift of Wheel-INS in the horizontal plane is less than 1.8% of the total traveled distance, reduced by 23% compared to the conventional odometer-aided INS (ODO/INS). In addition, Wheel-INS outperforms ODO/INS because of its inherent immunity to constant bias error of gyroscopes. The source code and experimental datasets used in this paper is made available to the community (https://github.com/i2Nav-WHU/Wheel-INS). △ Less

Submitted 23 April, 2021; v1 submitted 16 December, 2019; originally announced December 2019.

Improving Neural Relation Extraction with Implicit Mutual Relations

Authors: Jun Kuang, Yixin Cao, Jianbing Zheng, Xiangnan He, Ming Gao, Aoying Zhou

Abstract: Relation extraction (RE) aims at extracting the relation between two entities from the text corpora. It is a crucial task for Knowledge Graph (KG) construction. Most existing methods predict the relation between an entity pair by learning the relation from the training sentences, which contain the targeted entity pair. In contrast to existing distant supervision approaches that suffer from insuffi… ▽ More Relation extraction (RE) aims at extracting the relation between two entities from the text corpora. It is a crucial task for Knowledge Graph (KG) construction. Most existing methods predict the relation between an entity pair by learning the relation from the training sentences, which contain the targeted entity pair. In contrast to existing distant supervision approaches that suffer from insufficient training corpora to extract relations, our proposal of mining implicit mutual relation from the massive unlabeled corpora transfers the semantic information of entity pairs into the RE model, which is more expressive and semantically plausible. After constructing an entity proximity graph based on the implicit mutual relations, we preserve the semantic relations of entity pairs via embedding each vertex of the graph into a low-dimensional space. As a result, we can easily and flexibly integrate the implicit mutual relations and other entity information, such as entity types, into the existing RE methods. Our experimental results on a New York Times and another Google Distant Supervision datasets suggest that our proposed neural RE framework provides a promising improvement for the RE task, and significantly outperforms the state-of-the-art methods. Moreover, the component for mining implicit mutual relations is so flexible that can help to improve the performance of both CNN-based and RNN-based RE models significant. △ Less

Submitted 7 July, 2019; originally announced July 2019.

Comments: 12 pages

Recurrent Neural Networks based Obesity Status Prediction Using Activity Data

Authors: Qinghan Xue, Xiaoran Wang, Samuel Meehan, Jilong Kuang, Alex Gao, Mooi Choo Chuah

Abstract: Obesity is a serious public health concern world-wide, which increases the risk of many diseases, including hypertension, stroke, and type 2 diabetes. To tackle this problem, researchers across the health ecosystem are collecting diverse types of data, which includes biomedical, behavioral and activity, and utilizing machine learning techniques to mine hidden patterns for obesity status improvemen… ▽ More Obesity is a serious public health concern world-wide, which increases the risk of many diseases, including hypertension, stroke, and type 2 diabetes. To tackle this problem, researchers across the health ecosystem are collecting diverse types of data, which includes biomedical, behavioral and activity, and utilizing machine learning techniques to mine hidden patterns for obesity status improvement prediction. While existing machine learning methods such as Recurrent Neural Networks (RNNs) can provide exceptional results, it is challenging to discover hidden patterns of the sequential data due to the irregular observation time instances. Meanwhile, the lack of understanding of why those learning models are effective also limits further improvements on their architectures. Thus, in this work, we develop a RNN based time-aware architecture to tackle the challenging problem of handling irregular observation times and relevant feature extractions from longitudinal patient records for obesity status improvement prediction. To improve the prediction performance, we train our model using two data sources: (i) electronic medical records containing information regarding lab tests, diagnoses, and demographics; (ii) continuous activity data collected from popular wearables. Evaluations of real-world data demonstrate that our proposed method can capture the underlying structures in users' time sequences with irregularities, and achieve an accuracy of 77-86% in predicting the obesity status improvement. △ Less

Submitted 20 September, 2018; originally announced September 2018.

Comments: 8 pages, 6 figures, ICMLA 2018 conference

Iterative Receivers for Downlink MIMO-SCMA: Message Passing and Distributed Cooperative Detection

Authors: Weijie Yuan, Nan Wu, Qinghua Guo, Yonghui Li, Chengwen Xing, Jingming Kuang

Abstract: The rapid development of the mobile communications requires ever higher spectral efficiency. The non-orthogonal multiple access (NOMA) has emerged as a promising technology to further increase the access efficiency of wireless networks. Amongst several NOMA schemes, the sparse code multiple access (SCMA) has been shown to be able to achieve better performance. In this paper, we consider a downlink… ▽ More The rapid development of the mobile communications requires ever higher spectral efficiency. The non-orthogonal multiple access (NOMA) has emerged as a promising technology to further increase the access efficiency of wireless networks. Amongst several NOMA schemes, the sparse code multiple access (SCMA) has been shown to be able to achieve better performance. In this paper, we consider a downlink MIMO-SCMA system over frequency selective fading channels. For optimal detection, the complexity increases exponentially with the product of the number of users, the number of antennas and the channel length. To tackle this challenge, we propose near optimal low-complexity iterative receivers based on factor graph. By introducing auxiliary variables, a stretched factor graph is constructed and a hybrid belief propagation (BP) and expectation propagation (EP) receiver, named as `Stretch-BP-EP', is proposed. Considering the convergence problem of BP algorithm on loopy factor graph, we convexify the Bethe free energy and propose a convergence-guaranteed BP-EP receiver, named as `Conv-BP-EP'. We further consider cooperative network and propose two distributed cooperative detection schemes to exploit the diversity gain, namely, belief consensus-based algorithm and Bregman alternative direction method of multipliers (ADMM)-based method. Simulation results verify the superior performance of the proposed Conv-BP-EP receiver compared with other methods. The two proposed distributed cooperative detection schemes can improve the bit error rate performance by exploiting the diversity gain. Moreover, Bregman ADMM method outperforms the belief consensus-based algorithm in noisy inter-user links. △ Less

Submitted 23 October, 2017; originally announced October 2017.

Comments: For possible publication in IEEE Trans. Wirless Commun

Cooperative Joint Localization and Clock Synchronization Based on Gaussian Message Passing in Asynchronous Wireless Networks

Authors: Weijie Yuan, Nan Wu, Bernhard Etzlinger, Hua Wang, Jingming Kuang

Abstract: Localization and synchronization are very important in many wireless applications such as monitoring and vehicle tracking. Utilizing the same time of arrival (TOA) measurements for simultaneous localization and synchronization is challenging. In this paper, we present a factor graph (FG) representation of the joint localization and time synchronization problem based on TOA measurements, in which t… ▽ More Localization and synchronization are very important in many wireless applications such as monitoring and vehicle tracking. Utilizing the same time of arrival (TOA) measurements for simultaneous localization and synchronization is challenging. In this paper, we present a factor graph (FG) representation of the joint localization and time synchronization problem based on TOA measurements, in which the non-line-of-sight measurements are also taken into consideration. On this FG, belief propagation (BP) message passing and variational message passing (VMP) are applied to derive two fully distributed cooperative algorithms with low computational requirements. Due to the nonlinearity in the observation function, it is intractable to compute the messages in closed form and most existing solutions rely on Monte Carlo methods, e.g., particle filtering. We linearize a specific nonlinear term in the expressions of messages, which enables us to use a Gaussian representation for all messages. Accordingly, only the mean and variance have to be updated and transmitted between neighboring nodes, which significantly reduces the communication overhead and computational complexity. A message passing schedule scheme is proposed to trade off between estimation performance and communication overhead. Simulation results show that the proposed algorithms perform very close to particle-based methods with much lower complexity especially in densely connected networks. △ Less

Submitted 12 January, 2016; originally announced January 2016.

Comments: 38 pages one column, To appear in IEEE Transactions on Vehicular Technology

TOA-based passive localization of multiple targets with inaccurate receivers based on belief propagation on factor graph

Authors: Nan Wu, Weijie Yuan, Hua Wang, Jingming Kuang

Abstract: Location awareness is now becoming a vital requirement for many practical applications. In this paper, we consider passive localization of multiple targets with one transmitter and several receivers based on time of arrival (TOA) measurements. Existing studies assume that positions of receivers are perfectly known. However, in practice, receivers' positions might be inaccurate, which leads to loca… ▽ More Location awareness is now becoming a vital requirement for many practical applications. In this paper, we consider passive localization of multiple targets with one transmitter and several receivers based on time of arrival (TOA) measurements. Existing studies assume that positions of receivers are perfectly known. However, in practice, receivers' positions might be inaccurate, which leads to localization error of targets. We propose factor graph (FG)-based belief propagation (BP) algorithms to locate the passive targets and improve the position accuracy of receivers simultaneously. Due to the nonlinearity of the likelihood function, messages on the FG cannot be derived in closed form. We propose both sample-based and parametric methods to solve this problem. In the sample-based BP algorithm, particle swarm optimization is employed to reduce the number of particles required to represent messages. In parametric BP algorithm, the nonlinear terms in messages are linearized, which results in closed-form Gaussian message passing on FG. The Bayesian Cramer-Rao bound (BCRB) for passive targets localization with uncertain receivers is derived to evaluate the performance of the proposed algorithms. Simulation results show that both the sample-based and parametric BP algorithms outperform the conventional method and attain the proposed BCRB. Receivers' positions can also be improved via the proposed BP algorithms. Although the parametric BP algorithm performs slightly worse than the sample-based BP method, it could be more attractive in practical applications due to the significantly lower computational complexity. △ Less

Submitted 19 November, 2015; originally announced November 2015.

Comments: 37 pages, 11 figures, accepted by Digital Signal Processing

Performance Analysis and Location Optimization for Massive MIMO Systems with Circularly Distributed Antennas

Authors: Ang Yang, Yindi Jing, Chengwen Xing, Zesong Fei, Jingming Kuang

Abstract: In this paper, we analyze the achievable rate of the uplink of a single-cell multi-user distributed massive multiple-input-multiple-output (MIMO) system. The multiple users are equipped with single antenna and the base station (BS) is equipped with a large number of distributed antennas. We derive an analytical expression for the asymptotic ergodic achievable rate of the system under zero-forcing… ▽ More In this paper, we analyze the achievable rate of the uplink of a single-cell multi-user distributed massive multiple-input-multiple-output (MIMO) system. The multiple users are equipped with single antenna and the base station (BS) is equipped with a large number of distributed antennas. We derive an analytical expression for the asymptotic ergodic achievable rate of the system under zero-forcing (ZF) detector. In particular, we consider circular antenna array, where the distributed BS antennas are located evenly on a circle, and derive an analytical expression and closed-form tight bounds for the achievable rate of an arbitrarily located user. Subsequently, closed-form bounds on the average achievable rate per user are obtained under the assumption that the users are uniformly located in the cell. Based on the bounds, we can understand the behavior of the system rate with respect to different parameters and find the optimal location of the circular BS antenna array that maximizes the average rate. Numerical results are provided to assess our analytical results and examine the impact of the number and the location of the BS antennas, the transmit power, and the path-loss exponent on system performance. It is shown that circularly distributed massive MIMO system largely outperforms centralized massive MIMO system. △ Less

Submitted 6 August, 2014; originally announced August 2014.

Comments: Single column, 30 pages, 8 figures. Submitted to IEEE Transactions on Wireless Communications

The Role of Large-Scale Fading in Uplink Massive MIMO Systems

Authors: Ang Yang, Zunwen He, Chengwen Xing, Zesong Fei, Jingming Kuang

Abstract: In this correspondence, we analyze the ergodic capacity of a large uplink multi-user multiple-input multiple-output (MU-MIMO) system over generalized-$K$ fading channels. In the considered scenario, multiple users transmit their information to a base station equipped with a very large number of antennas. Since the effect of fast fading asymptotically disappears in massive MIMO systems, large-scale… ▽ More In this correspondence, we analyze the ergodic capacity of a large uplink multi-user multiple-input multiple-output (MU-MIMO) system over generalized-$K$ fading channels. In the considered scenario, multiple users transmit their information to a base station equipped with a very large number of antennas. Since the effect of fast fading asymptotically disappears in massive MIMO systems, large-scale fading becomes the most dominant factor for the ergodic capacity of massive MIMO systems. Regarding this fact, in our work we concentrate our attention on the effects of large-scale fading for massive MIMO systems. Specifically, some interesting and novel lower bounds of the ergodic capacity have been derived with both perfect channel state information (CSI) and imperfect CSI. Simulation results assess the accuracy of these analytical expressions. △ Less

Submitted 12 June, 2014; originally announced June 2014.

Comments: Submitted to IEEE Transactions on Vehicular Technology as a correspondence

A Framework of Performance Analysis for Distributed Antenna Systems Based on Random Matrix Theory

Authors: Ang Yang, Zesong Fei, Chengwen Xing, Shaodan Ma, Jingming Kuang, Dalin Zhu, Ming Lei

Abstract: Future communications systems will definitely be built on green infrastructures. To realize such a goal, recently a new network infrastructure named cloud radio access network (C-RAN) is proposed by China Mobile to enhance network coverage and save energy simultaneously. In C-RANs, to order to save more energy the radio front ends are separated from the colocated baseband units and distributively… ▽ More Future communications systems will definitely be built on green infrastructures. To realize such a goal, recently a new network infrastructure named cloud radio access network (C-RAN) is proposed by China Mobile to enhance network coverage and save energy simultaneously. In C-RANs, to order to save more energy the radio front ends are separated from the colocated baseband units and distributively located in physical positions. C-RAN can be recognized as a variant of distributed antenna systems (DASs). In this paper we analyze the performance of C-RANS using random matrix theory. Due to the fact that the antennas are distributed geographically instead of being installed nearby, the variances of the entries in the considered channel matrix are different from each other. To the best of the authors' knowledge, the work on random matrices with elements having different variances is largely open, which is of great importance for DASs. In our work, some fundamental results on the eigenvalue distributions of the random matrices with different variances are derived first. Then based on these fundamental conclusions the outage probability of the considered DAS is derived. Finally, the accuracy of our analytical results is assessed by some numerical results. △ Less

Submitted 5 October, 2014; v1 submitted 14 January, 2014; originally announced January 2014.

Comments: This paper has been withdrawn by the authors due to an error in Appendix I

Improved LT Codes in Low Overhead Regions for Binary Erasure Channels

Authors: Zesong Fei, Congzhe Cao, Ming Xiao, Iqbal Hussain, Jingming Kuang

Abstract: We study improved degree distribution for Luby Transform (LT) codes which exhibits improved bit error rate performance particularly in low overhead regions. We construct the degree distribution by modifying Robust Soliton distribution. The performance of our proposed LT codes is evaluated and compared to the conventional LT codes via And-Or tree analysis. Then we propose a transmission scheme base… ▽ More We study improved degree distribution for Luby Transform (LT) codes which exhibits improved bit error rate performance particularly in low overhead regions. We construct the degree distribution by modifying Robust Soliton distribution. The performance of our proposed LT codes is evaluated and compared to the conventional LT codes via And-Or tree analysis. Then we propose a transmission scheme based on the proposed degree distribution to improve its frame error rate in full recovery regions. Furthermore, the improved degree distribution is applied to distributed multi-source relay networks and unequal error protection. It is shown that our schemes achieve better performance and reduced complexity especially in low overhead regions, compared with conventional schemes. △ Less

Submitted 12 September, 2013; originally announced September 2013.

Comments: 8 pages, 8 figures

Low Complexity List Successive Cancellation Decoding of Polar Codes

Authors: Congzhe Cao, Zesong Fei, Jinhong Yuan, Jingming Kuang

Abstract: We propose a low complexity list successive cancellation (LCLSC) decoding algorithm to reduce complexity of traditional list successive cancellation (LSC) decoding of polar codes while trying to maintain the LSC decoding performance at the same time. By defining two thresholds, namely "likelihood ratio (LR) threshold" and "Bhattacharyya parameter threshold", we classify the reliability of each rec… ▽ More We propose a low complexity list successive cancellation (LCLSC) decoding algorithm to reduce complexity of traditional list successive cancellation (LSC) decoding of polar codes while trying to maintain the LSC decoding performance at the same time. By defining two thresholds, namely "likelihood ratio (LR) threshold" and "Bhattacharyya parameter threshold", we classify the reliability of each received information bit and the quality of each bit channel. Based on this classification, we implement successive cancellation (SC) decoding instead of LSC decoding when the information bits from "bad" subchannels are received reliably and further attempt to skip LSC decoding for the rest information bits in order to achieve a lower complexity compared to full LSC decoding. Simulation results show that the complexity of LCLSC decoding is much lower than LSC decoding and can be close to that of SC decoding, especially in low code rate regions. △ Less

Submitted 12 September, 2013; originally announced September 2013.

Comments: 5 pages, 6 figures

Adaptive Multi-objective Optimization for Energy Efficient Interference Coordination in Multi-Cell Networks

Authors: Zesong Fei, Chengwen Xing, Na Li, Jingming Kuang

Abstract: In this paper, we investigate the distributed power allocation for multi-cell OFDMA networks taking both energy efficiency and inter-cell interference (ICI) mitigation into account. A performance metric termed as throughput contribution is exploited to measure how ICI is effectively coordinated. To achieve a distributed power allocation scheme for each base station (BS), the throughput contributio… ▽ More In this paper, we investigate the distributed power allocation for multi-cell OFDMA networks taking both energy efficiency and inter-cell interference (ICI) mitigation into account. A performance metric termed as throughput contribution is exploited to measure how ICI is effectively coordinated. To achieve a distributed power allocation scheme for each base station (BS), the throughput contribution of each BS to the network is first given based on a pricing mechanism. Different from existing works, a biobjective problem is formulated based on multi-objective optimization theory, which aims at maximizing the throughput contribution of the BS to the network and minimizing its total power consumption at the same time. Using the method of Pascoletti and Serafini scalarization, the relationship between the varying parameters and minimal solutions is revealed. Furthermore, to exploit the relationship an algorithm is proposed based on which all the solutions on the boundary of the efficient set can be achieved by adaptively adjusting the involved parameters. With the obtained solution set, the decision maker has more choices on power allocation schemes in terms of both energy consumption and throughput. Finally, the performance of the algorithm is assessed by the simulation results. △ Less

Submitted 20 January, 2014; v1 submitted 22 August, 2013; originally announced August 2013.

Comments: 29 pages

Design of Binary Network Codes for Multi-user Multi-way Relay Networks

Authors: Ang Yang, Zesong Fei, Chengwen Xing, Ming Xiao, Jinhong Yuan, Jingming Kuang

Abstract: We study multi-user multi-way relay networks where $N$ user nodes exchange their information through a single relay node. We use network coding in the relay to increase the throughput. Due to the limitation of complexity, we only consider the binary multi-user network coding (BMNC) in the relay. We study BMNC matrix (in GF(2)) and propose several design criteria on the BMNC matrix to improve the s… ▽ More We study multi-user multi-way relay networks where $N$ user nodes exchange their information through a single relay node. We use network coding in the relay to increase the throughput. Due to the limitation of complexity, we only consider the binary multi-user network coding (BMNC) in the relay. We study BMNC matrix (in GF(2)) and propose several design criteria on the BMNC matrix to improve the symbol error probability (SEP) performance. Closed-form expressions of the SEP of the system are provided. Moreover, an upper bound of the SEP is also proposed to provide further insights on system performance. Then BMNC matrices are designed to minimize the error probabilities. △ Less

Submitted 18 March, 2013; originally announced March 2013.

Comments: accepted by the IEEE Transactions on Vehicular Technology

A Matrix-Field Weighted Mean-Square-Error Model for MIMO Transceiver Designs

Authors: Chengwen Xing, Wenzhi Li, Shaodan Ma, Zesong Fei, Jingming Kuang

Abstract: In this letter, we investigate an important and famous issue, namely weighted mean-square-error (MSE) minimization transceiver designs. In our work, for transceiver designs a novel weighted MSE model is proposed, which is defined as a linear matrix function with respect to the traditional data detection MSE matrix. The new model can be interpreted an extension of weighting operation from vector fi… ▽ More In this letter, we investigate an important and famous issue, namely weighted mean-square-error (MSE) minimization transceiver designs. In our work, for transceiver designs a novel weighted MSE model is proposed, which is defined as a linear matrix function with respect to the traditional data detection MSE matrix. The new model can be interpreted an extension of weighting operation from vector field to matrix field. Based on the proposed weighting operation a general transceiver design is proposed, which aims at minimizing an increasing matrix-monotone function of the output of the previous linear matrix function. The structure of the optimal solutions is also derived. Furthermore, two important special cases of the matrix-monotone functions are discussed in detail. It is also revealed that these two problems are exactly equivalent to the transceiver designs of sum MSE minimization and capacity maximization for dual-hop amplify-and-forward (AF) MIMO relaying systems, respectively. Finally, it is concluded that the AF relaying is undoubtedly this kind of weighting operation. △ Less

Submitted 26 February, 2013; originally announced February 2013.

Comments: 11 pages, 1 figure. Signal Processing and Communications

How to Understand LMMSE Transceiver Design for MIMO Systems From Quadratic Matrix Programming

Authors: Chengwen Xing, Shuo Li, Zesong Fei, Jingming Kuang

Abstract: In this paper, a unified linear minimum mean-square-error (LMMSE) transceiver design framework is investigated, which is suitable for a wide range of wireless systems. The unified design is based on an elegant and powerful mathematical programming technology termed as quadratic matrix programming (QMP). Based on QMP it can be observed that for different wireless systems, there are certain common c… ▽ More In this paper, a unified linear minimum mean-square-error (LMMSE) transceiver design framework is investigated, which is suitable for a wide range of wireless systems. The unified design is based on an elegant and powerful mathematical programming technology termed as quadratic matrix programming (QMP). Based on QMP it can be observed that for different wireless systems, there are certain common characteristics which can be exploited to design LMMSE transceivers e.g., the quadratic forms. It is also discovered that evolving from a point-to-point MIMO system to various advanced wireless systems such as multi-cell coordinated systems, multi-user MIMO systems, MIMO cognitive radio systems, amplify-and-forward MIMO relaying systems and so on, the quadratic nature is always kept and the LMMSE transceiver designs can always be carried out via iteratively solving a number of QMP problems. A comprehensive framework on how to solve QMP problems is also given. The work presented in this paper is likely to be the first shoot for the transceiver design for the future ever-changing wireless systems. △ Less

Submitted 1 March, 2013; v1 submitted 1 January, 2013; originally announced January 2013.

Comments: 31 pages, 4 figures, Accepted by IET Communications

Distributed Resource Allocation Algorithm Design for Multi-Cell Networks Based on Advanced Decomposition Theory

Authors: Zesong Fei, Shuo Li, Chengwen Xing, Yiqing Zhou, Jingming Kuang

Abstract: In this letter, we investigate the resource allocation for downlink multi-cell coordinated OFDMA wireless networks, in which power allocation and subcarrier scheduling are jointly optimized. Aiming at maximizing the weighted sum of the minimal user rates (WSMR) of coordinated cells under individual power constraints at each base station, an effective distributed resource allocation algorithm using… ▽ More In this letter, we investigate the resource allocation for downlink multi-cell coordinated OFDMA wireless networks, in which power allocation and subcarrier scheduling are jointly optimized. Aiming at maximizing the weighted sum of the minimal user rates (WSMR) of coordinated cells under individual power constraints at each base station, an effective distributed resource allocation algorithm using a modified decomposition method is proposed, which is suitable by practical implementation due to its low complexity and fast convergence speed. Simulation results demonstrate that the proposed decentralized algorithm provides substantial throughput gains with lower computational cost compared to existing schemes. △ Less

Submitted 15 September, 2012; originally announced September 2012.

Comments: 4 pages, 2 figures, Submitted to Communications Letter

A Unified Linear MSE Minimization MIMO Beamforming Design Based on Quadratic Matrix Programming

Authors: Chengwen Xing, Zesong Fei, Shaodan Ma, Jingming Kuang, Yik-Chung Wu

Abstract: In this paper, we investigate a unified linear transceiver design with mean-square-error (MSE) as the objective function for a wide range of wireless systems. The unified design is based on an elegant mathematical programming technology namely quadratic matrix programming (QMP). It is revealed that for different wireless systems such as multi-cell coordination systems, multi-user MIMO systems, MIM… ▽ More In this paper, we investigate a unified linear transceiver design with mean-square-error (MSE) as the objective function for a wide range of wireless systems. The unified design is based on an elegant mathematical programming technology namely quadratic matrix programming (QMP). It is revealed that for different wireless systems such as multi-cell coordination systems, multi-user MIMO systems, MIMO cognitive radio systems, amplify-and-forward MIMO relaying systems, the MSE minimization beamforming design problems can always be solved by solving a number of QMP problems. A comprehensive framework on how to solve QMP problems is also given. △ Less

Submitted 9 January, 2013; v1 submitted 16 August, 2012; originally announced August 2012.

Comments: 6 Pages WCSP 2012 Final Version

Symbol Error Rate of Space-Time Network Coding in Nakagami-m Fading

Authors: Ang Yang, Zesong Fei, Nan Yang, Chengwen Xing, Jingming Kuang

Abstract: In this paper, we analyze the symbol error rate (SER) of space-time network coding (STNC) in a distributed cooperative network over independent but not necessarily identically distributed (i.n.i.d.) Nakagami-$m$ fading channels. In this network, multiple sources communicate with a single destination with the assistance of multiple decode-and-forward (DF) relays. We first derive new exact closed-fo… ▽ More In this paper, we analyze the symbol error rate (SER) of space-time network coding (STNC) in a distributed cooperative network over independent but not necessarily identically distributed (i.n.i.d.) Nakagami-$m$ fading channels. In this network, multiple sources communicate with a single destination with the assistance of multiple decode-and-forward (DF) relays. We first derive new exact closed-form expressions for the SER with $M$-ary phase shift-keying modulation ($M$-PSK) and $M$-ary quadrature amplitude modulation ($M$-QAM). We then derive new compact expressions for the asymptotic SER to offer valuable insights into the network behavior in the high signal-to-noise ratio (SNR) regime. Importantly, we demonstrate that STNC guarantees full diversity order, which is determined by the Nakagami-$m$ fading parameters of all the channels but independent of the number of sources. Based on the new expressions, we examine the impact of the number of relays, relay location, Nakagami-$m$ fading parameters, power allocation, and nonorthogonal codes on the SER. △ Less

Submitted 4 July, 2012; originally announced July 2012.

Comments: 23 pages, 9 figures

Performance Analysis for Heterogeneous Cellular Systems with Range Expansion

Authors: Haichuan Ding, Shaodan Ma, Chengwen Xing, Zesong Fei, Jingming Kuang

Abstract: Recently heterogeneous base station structure has been adopted in cellular systems to enhance system throughput and coverage. In this paper, the uplink coverage probability for the heterogeneous cellular systems is analyzed and derived in closed-form. The randomness on the locations and number of mobile users is taken into account in the analysis. Based on the analytical results, the impacts of va… ▽ More Recently heterogeneous base station structure has been adopted in cellular systems to enhance system throughput and coverage. In this paper, the uplink coverage probability for the heterogeneous cellular systems is analyzed and derived in closed-form. The randomness on the locations and number of mobile users is taken into account in the analysis. Based on the analytical results, the impacts of various system parameters on the uplink performance are investigated in detail. The correctness of the analytical results is also verified by simulation results. These analytical results can thus serve as a guidance for system design without the need of time consuming simulations. △ Less

Submitted 1 July, 2012; originally announced July 2012.

Comments: six pages, five figures

Robust Transceiver Design for AF MIMO Relay Systems with Column Correlations

Authors: Chengwen Xing, Zesong Fei, Yik-Chung Wu, Shaodan Ma, Jingming Kuang

Abstract: In this paper, we investigate the robust transceiver design for dual-hop amplify-and-forward (AF) MIMO relay systems with Gaussian distributed channel estimation errors. Aiming at maximizing the mutual information under imperfect channel state information (CSI), source precoder at source and forwarding matrix at the relay are jointly optimized. Using some elegant attributes of matrix-monotone func… ▽ More In this paper, we investigate the robust transceiver design for dual-hop amplify-and-forward (AF) MIMO relay systems with Gaussian distributed channel estimation errors. Aiming at maximizing the mutual information under imperfect channel state information (CSI), source precoder at source and forwarding matrix at the relay are jointly optimized. Using some elegant attributes of matrix-monotone functions, the structures of the optimal solutions are derived first. Then based on the derived structure an iterative waterfilling solution is proposed. Several existing algorithms are shown to be special cases of the proposed solution. Finally, the effectiveness of the proposed robust design is demonstrated by simulation results. △ Less

Submitted 13 January, 2012; originally announced January 2012.

Comments: 6 Pages, 1 Figure

Journal ref: IEEE ICSPCC 2011, Aug. 2011, Xi'An China

Joint Robust Weighted LMMSE Transceiver Design for Dual-Hop AF Multiple-Antenna Relay Systems

Authors: Chengwen Xing, Shaodan Ma, Zesong Fei, Yik-Chung Wu, Jingming Kuang

Abstract: In this paper, joint transceiver design for dual-hop amplify-and-forward (AF) MIMO relay systems with Gaussian distributed channel estimation errors in both two hops is investigated. Due to the fact that various linear transceiver designs can be transformed to a weighted linear minimum mean-square-error (LMMSE) transceiver design with specific weighting matrices, weighted mean square error (MSE) i… ▽ More In this paper, joint transceiver design for dual-hop amplify-and-forward (AF) MIMO relay systems with Gaussian distributed channel estimation errors in both two hops is investigated. Due to the fact that various linear transceiver designs can be transformed to a weighted linear minimum mean-square-error (LMMSE) transceiver design with specific weighting matrices, weighted mean square error (MSE) is chosen as the performance metric. Precoder matrix at source, forwarding matrix at relay and equalizer matrix at destination are jointly designed with channel estimation errors taken care of by Bayesian philosophy. Several existing algorithms are found to be special cases of the proposed solution. The performance advantage of the proposed robust design is demonstrated by the simulation results. △ Less

Submitted 13 January, 2012; originally announced January 2012.

Comments: 5 Pages, 1 Figure

Journal ref: IEEE Global Communications Conference (GlobeCom'2011), 2011, U.S.A

Robust Linear Transceiver Design for Multi-Hop Non-Regenerative MIMO Relaying Systems

Authors: Chengwen Xing, Zesong Fei, Shaodan Ma, Jingming Kuang, Yik-Chung Wu

Abstract: In this paper, optimal linear transceiver designs for multi-hop amplify-and-forward (AF) Multiple-input Multiple-out (MIMO) relaying systems with Gaussian distributed channel estimation errors are investigated. Some commonly used transceiver design criteria are unified into a single matrix-variate optimization problem. With novel applications of majorization theory and properties of matrix-variate… ▽ More In this paper, optimal linear transceiver designs for multi-hop amplify-and-forward (AF) Multiple-input Multiple-out (MIMO) relaying systems with Gaussian distributed channel estimation errors are investigated. Some commonly used transceiver design criteria are unified into a single matrix-variate optimization problem. With novel applications of majorization theory and properties of matrix-variate function, the optimal structure of robust transceiver is first derived. Based on the optimal structure, the original transceiver design problems are reduced to much simpler problems with only scalar variables whose solutions are readily obtained by iterative water-filling algorithms. The performance advantages of the proposed robust designs are demonstrated by the simulation results. △ Less

Submitted 23 September, 2011; originally announced September 2011.

Comments: Accepted by WCSP2011