-
Unsupervised 4D Cardiac Motion Tracking with Spatiotemporal Optical Flow Networks
Authors:
Long Teng,
Wei Feng,
Menglong Zhu,
Xinchao Li
Abstract:
Cardiac motion tracking from echocardiography can be used to estimate and quantify myocardial motion within a cardiac cycle. It is a cost-efficient and effective approach for assessing myocardial function. However, ultrasound imaging has the inherent characteristics of spatially low resolution and temporally random noise, which leads to difficulties in obtaining reliable annotation. Thus it is dif…
▽ More
Cardiac motion tracking from echocardiography can be used to estimate and quantify myocardial motion within a cardiac cycle. It is a cost-efficient and effective approach for assessing myocardial function. However, ultrasound imaging has the inherent characteristics of spatially low resolution and temporally random noise, which leads to difficulties in obtaining reliable annotation. Thus it is difficult to perform supervised learning for motion tracking. In addition, there is no end-to-end unsupervised method currently in the literature. This paper presents a motion tracking method where unsupervised optical flow networks are designed with spatial reconstruction loss and temporal-consistency loss. Our proposed loss functions make use of the pair-wise and temporal correlation to estimate cardiac motion from noisy background. Experiments using a synthetic 4D echocardiography dataset has shown the effectiveness of our approach, and its superiority over existing methods on both accuracy and running speed. To the best of our knowledge, this is the first work performed that uses unsupervised end-to-end deep learning optical flow network for 4D cardiac motion tracking.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
A backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations
Authors:
Lorenc Kapllani,
Long Teng
Abstract:
In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only on the inputs and labels but also the differentials of the corresponding labels. This is motivated by the fact that differential deep learning can provide an ef…
▽ More
In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only on the inputs and labels but also the differentials of the corresponding labels. This is motivated by the fact that differential deep learning can provide an efficient approximation of the labels and their derivatives with respect to inputs. The BSDEs are reformulated as differential deep learning problems by using Malliavin calculus. The Malliavin derivatives of solution to a BSDE satisfy themselves another BSDE, resulting thus in a system of BSDEs. Such formulation requires the estimation of the solution, its gradient, and the Hessian matrix, represented by the triple of processes $\left(Y, Z, Γ\right).$ All the integrals within this system are discretized by using the Euler-Maruyama method. Subsequently, DNNs are employed to approximate the triple of these unknown processes. The DNN parameters are backwardly optimized at each time step by minimizing a differential learning type loss function, which is defined as a weighted sum of the dynamics of the discretized BSDE system, with the first term providing the dynamics of the process $Y$ and the other the process $Z$. An error analysis is carried out to show the convergence of the proposed algorithm. Various numerical experiments up to $50$ dimensions are provided to demonstrate the high efficiency. Both theoretically and numerically, it is demonstrated that our proposed scheme is more efficient compared to other contemporary deep learning-based methodologies, especially in the computation of the process $Γ$.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images
Authors:
Liu Yang,
Huiyu Duan,
Long Teng,
Yucheng Zhu,
Xiaohong Liu,
Menghan Hu,
Xiongkuo Min,
Guangtao Zhai,
Patrick Le Callet
Abstract:
In recent years, the rapid advancement of Artificial Intelligence Generated Content (AIGC) has attracted widespread attention. Among the AIGC, AI generated omnidirectional images hold significant potential for Virtual Reality (VR) and Augmented Reality (AR) applications, hence omnidirectional AIGC techniques have also been widely studied. AI-generated omnidirectional images exhibit unique distorti…
▽ More
In recent years, the rapid advancement of Artificial Intelligence Generated Content (AIGC) has attracted widespread attention. Among the AIGC, AI generated omnidirectional images hold significant potential for Virtual Reality (VR) and Augmented Reality (AR) applications, hence omnidirectional AIGC techniques have also been widely studied. AI-generated omnidirectional images exhibit unique distortions compared to natural omnidirectional images, however, there is no dedicated Image Quality Assessment (IQA) criteria for assessing them. This study addresses this gap by establishing a large-scale AI generated omnidirectional image IQA database named AIGCOIQA2024 and constructing a comprehensive benchmark. We first generate 300 omnidirectional images based on 5 AIGC models utilizing 25 text prompts. A subjective IQA experiment is conducted subsequently to assess human visual preferences from three perspectives including quality, comfortability, and correspondence. Finally, we conduct a benchmark experiment to evaluate the performance of state-of-the-art IQA models on our database. The database will be released to facilitate future research.
△ Less
Submitted 1 April, 2024;
originally announced April 2024.
-
Topic-aware Most Influential Community Search in Social Networks
Authors:
Long Teng,
Yanhao Wang
Abstract:
Community search is a problem aimed at searching for densely connected subgraphs within a network based on query conditions, which has recently attracted significant attention. However, most previous community search studies have overlooked the coexistence relationship among attributes. They typically assign a single attribute to each node or edge (e.g.,only considering influence scores or keyword…
▽ More
Community search is a problem aimed at searching for densely connected subgraphs within a network based on query conditions, which has recently attracted significant attention. However, most previous community search studies have overlooked the coexistence relationship among attributes. They typically assign a single attribute to each node or edge (e.g.,only considering influence scores or keywords), which is difficult for users to obtain a comprehensive and beneficial information. Additionally, most of them also ignored the uncertainty in the attribute graph. Therefore, in this paper, we introduce two novel community models, namely topic-based interaction graph and $(k,l,η)$-influential community. The former is a directed ucertain graph generated by the query topic distribution provided by users, while the latter is used for solving the topic-aware most influential community search problem in social networks. Furthermore, we propose an online search algorithm which computes the influence value of each vertex by considering the topic-aware information diffusion process on interaction graphs. And then, we use a peeling-pruning strategy to iteratively find the topic-aware most $(k,l,η)$-influential community. To further speed up the search performance, we devise two lightweight index structures which efficiently support the search for the topic-aware most influential community within an optimal time. We also propose three optimization methods to improve the space and time costs of the index-based approach.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
CLIP in Medical Imaging: A Comprehensive Survey
Authors:
Zihao Zhao,
Yuxiao Liu,
Han Wu,
Yonghao Li,
Sheng Wang,
Lin Teng,
Disheng Liu,
Zhiming Cui,
Qian Wang,
Dinggang Shen
Abstract:
Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks, attributable to its generalizability and interpretability. The use of CLIP has recently gained increasing interest in the medical imaging domain, serving both as a pre-training paradigm for alig…
▽ More
Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks, attributable to its generalizability and interpretability. The use of CLIP has recently gained increasing interest in the medical imaging domain, serving both as a pre-training paradigm for aligning medical vision and language, and as a critical component in diverse clinical tasks. With the aim of facilitating a deeper understanding of this promising direction, this survey offers an in-depth exploration of the CLIP paradigm within the domain of medical imaging, regarding both refined CLIP pre-training and CLIP-driven applications. In this study, We (1) start with a brief introduction to the fundamentals of CLIP methodology. (2) Then, we investigate the adaptation of CLIP pre-training in the medical domain, focusing on how to optimize CLIP given characteristics of medical images and reports. (3) Furthermore, we explore the practical utilization of CLIP pre-trained models in various tasks, including classification, dense prediction, and cross-modal tasks. (4) Finally, we discuss existing limitations of CLIP in the context of medical imaging and propose forward-looking directions to address the demands of medical imaging domain. We expect that this comprehensive survey will provide researchers in the field of medical image analysis with a holistic understanding of the CLIP paradigm and its potential implications. The project page can be found on https://github.com/zhaozh10/Awesome-CLIP-in-Medical-Imaging.
△ Less
Submitted 21 May, 2024; v1 submitted 12 December, 2023;
originally announced December 2023.
-
Performance Analysis of MDMA-Based Cooperative MRC Networks with Relays in Dissimilar Rayleigh Fading Channels
Authors:
Lei Teng,
Wannian An,
Chen Dong,
Xiaoqi Qin,
Xiaodong Xu
Abstract:
Multiple access technology is a key technology in various generations of wireless communication systems. As a potential multiple access technology for the next generation wireless communication systems, model division multiple access (MDMA) technology improves spectrum efficiency and feasibility regions. This implies that the MDMA scheme can achieve greater performance gains compared to traditiona…
▽ More
Multiple access technology is a key technology in various generations of wireless communication systems. As a potential multiple access technology for the next generation wireless communication systems, model division multiple access (MDMA) technology improves spectrum efficiency and feasibility regions. This implies that the MDMA scheme can achieve greater performance gains compared to traditional schemes. Relayassisted cooperative networks, as a infrastructure of wireless communication, can effectively utilize resources and improve performance when MDMA is applied. In this paper, a communication relay cooperative network based on MDMA in dissimilar rayleigh fading channels is proposed, which consists of two source nodes, any number of decode-and-forward (DF) relay nodes, and one destination node, as well as using the maximal ratio combining (MRC) at the destination to combine the signals received from the source and relays. By applying the state transition matrix (STM) and moment generating function (MGF), closed-form analytical solutions for outage probability and resource utilization efficiency are derived. Theoretical and simulation results are conducted to verify the validity of the theoretical analysis.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
The Communication GSC System with Energy Harvesting Nodes aided by Opportunistic Routing
Authors:
Hanyu Liu,
Lei Teng,
Wannian An,
Xiaoqi Qin,
Chen Dong,
Xiaodong Xu
Abstract:
In this paper, a cooperative communication network based on energy-harvesting (EH) decode-and-forward (DF) relays is proposed. For relay nodes, there is harvest-storage-use (HSU) structure in this system. And energy can be obtained from the surrounding environment through energy buffering. In order to improve the performance of the communication system, the opportunistic routing algorithm and the…
▽ More
In this paper, a cooperative communication network based on energy-harvesting (EH) decode-and-forward (DF) relays is proposed. For relay nodes, there is harvest-storage-use (HSU) structure in this system. And energy can be obtained from the surrounding environment through energy buffering. In order to improve the performance of the communication system, the opportunistic routing algorithm and the generalized selection combining (GSC) algorithm are adopted in this communication system. In addition, from discrete-time continuous-state space Markov chain model (DCSMC), a theoretical expression of the energy limiting distribution stored in infinite buffers is derived. Through using the probability distribution and state transition matrix, the theoretical expressions of system outage probability, throughput and time cost of per packet are obtained. Through the simulation verification, the theoretical results are in good agreement with the simulation results.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations
Authors:
Lorenc Kapllani,
Long Teng,
Matthias Rottmann
Abstract:
Deep learning-based numerical schemes for solving high-dimensional backward stochastic differential equations (BSDEs) have recently raised plenty of scientific interest. While they enable numerical methods to approximate very high-dimensional BSDEs, their reliability has not been studied and is thus not understood. In this work, we study uncertainty quantification (UQ) for a class of deep learning…
▽ More
Deep learning-based numerical schemes for solving high-dimensional backward stochastic differential equations (BSDEs) have recently raised plenty of scientific interest. While they enable numerical methods to approximate very high-dimensional BSDEs, their reliability has not been studied and is thus not understood. In this work, we study uncertainty quantification (UQ) for a class of deep learning-based BSDE schemes. More precisely, we review the sources of uncertainty involved in the schemes and numerically study the impact of different sources. Usually, the standard deviation (STD) of the approximate solutions obtained from multiple runs of the algorithm with different datasets is calculated to address the uncertainty. This approach is computationally quite expensive, especially for high-dimensional problems. Hence, we develop a UQ model that efficiently estimates the STD of the approximate solution using only a single run of the algorithm. The model also estimates the mean of the approximate solution, which can be leveraged to initialize the algorithm and improve the optimization process. Our numerical experiments show that the UQ model produces reliable estimates of the mean and STD of the approximate solution for the considered class of deep learning-based BSDE schemes. The estimated STD captures multiple sources of uncertainty, demonstrating its effectiveness in quantifying the uncertainty. Additionally, the model illustrates the improved performance when comparing different schemes based on the estimated STD values. Furthermore, it can identify hyperparameter values for which the scheme achieves good approximations.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Masked Autoencoders as Image Processors
Authors:
Huiyu Duan,
Wei Shen,
Xiongkuo Min,
Danyang Tu,
Long Teng,
Jia Wang,
Guangtao Zhai
Abstract:
Transformers have shown significant effectiveness for various vision tasks including both high-level vision and low-level vision. Recently, masked autoencoders (MAE) for feature pre-training have further unleashed the potential of Transformers, leading to state-of-the-art performances on various high-level vision tasks. However, the significance of MAE pre-training on low-level vision tasks has no…
▽ More
Transformers have shown significant effectiveness for various vision tasks including both high-level vision and low-level vision. Recently, masked autoencoders (MAE) for feature pre-training have further unleashed the potential of Transformers, leading to state-of-the-art performances on various high-level vision tasks. However, the significance of MAE pre-training on low-level vision tasks has not been sufficiently explored. In this paper, we show that masked autoencoders are also scalable self-supervised learners for image processing tasks. We first present an efficient Transformer model considering both channel attention and shifted-window-based self-attention termed CSformer. Then we develop an effective MAE architecture for image processing (MAEIP) tasks. Extensive experimental results show that with the help of MAEIP pre-training, our proposed CSformer achieves state-of-the-art performance on various image processing tasks, including Gaussian denoising, real image denoising, single-image motion deblurring, defocus deblurring, and image deraining.
△ Less
Submitted 30 March, 2023;
originally announced March 2023.
-
Opportunistic Routing aided Cooperative Communication MRC Network with Energy-Harvesting Nodes
Authors:
Lei Teng,
Wannian An,
Chen Dong,
Xiaodong Xu,
Boxiao Han
Abstract:
In this paper, we consider a multi-hop cooperative network founded on two energy-harvesting (EH) decode-and-forward (DF) relays which are provided with harvest-store-use (HSU) architecture to harvest energy from the ambience using the energy buffers. For the sake of boosting the data delivery in this network, maximal ratio combining (MRC) at destination to combine the signals received from source…
▽ More
In this paper, we consider a multi-hop cooperative network founded on two energy-harvesting (EH) decode-and-forward (DF) relays which are provided with harvest-store-use (HSU) architecture to harvest energy from the ambience using the energy buffers. For the sake of boosting the data delivery in this network, maximal ratio combining (MRC) at destination to combine the signals received from source and relays, as well as an opportunistic routing (OR) algorithm which considers channel status information, location and energy buffer status of relays is proposed. With applying discrete-time continuous-state space Markov chain model (DCSMC), the algorithm-based theoretical expression for limiting distribution of stored energy in infinite-size buffer is derived. Further more, with using both the limiting distributions of energy buffers and the probability of transmitter candidates set, the algorithm-based theoretical expressions for outage probability, throughput and timesolt cost for each data of the network are obtained. The simulation results are presented to validate the derived algorithm-based theoretical expressions.
△ Less
Submitted 2 February, 2023; v1 submitted 10 June, 2022;
originally announced June 2022.
-
Opportunistic Routing Aided Cooperative Communication Network with Energy-Harvesting
Authors:
Wannian An,
Chen Dong,
Xiaodong Xu,
Chao Xu,
Shujun Han,
Lei Teng
Abstract:
In this paper, a cooperative communication network based on energy-harvesting (EH) decode-and-forward (DF) relays that harvest energy from the ambience using buffers with harvest-store-use (HSU) architecture is considered. An opportunistic routing (OR) protocol, which selects the transmission path of packet based on the node transmission priority, is proposed to improve data delivery in this netwo…
▽ More
In this paper, a cooperative communication network based on energy-harvesting (EH) decode-and-forward (DF) relays that harvest energy from the ambience using buffers with harvest-store-use (HSU) architecture is considered. An opportunistic routing (OR) protocol, which selects the transmission path of packet based on the node transmission priority, is proposed to improve data delivery in this network. Additionally, an algorithm based on state transition matrix (STM) is proposed to obtain the probability distribution of the candidate broadcast node set. Based on the probability distribution, the existence conditions and the theoretical expressions for the limiting distribution of energy in energy buffers using discrete-time continuous-state space Markov chain (DCSMC) model are derived. Furthermore, the closed-form expressions for network outage probability and throughput are obtained with the help of the limiting distributions of energy stored in buffers. Numerous experiments have been performed to validate the derived theoretical expressions.
△ Less
Submitted 11 June, 2022; v1 submitted 13 May, 2022;
originally announced May 2022.
-
QoE Driven VR 360 Video Massive MIMO Transmission
Authors:
Long Teng,
Guangtao Zhai,
Yongpeng Wu,
Xiongkuo Min,
Wenjun Zhang,
Zhi Ding,
Chengshang Xiao
Abstract:
Massive multiple-input and multiple-output (MIMO) enables ultra-high throughput and low latency for tile-based adaptive virtual reality (VR) 360 video transmission in wireless network. In this paper, we consider a massive MIMO system where multiple users in a single-cell theater watch an identical VR 360 video. Based on tile prediction, base station (BS) deliveries the tiles in predicted field of…
▽ More
Massive multiple-input and multiple-output (MIMO) enables ultra-high throughput and low latency for tile-based adaptive virtual reality (VR) 360 video transmission in wireless network. In this paper, we consider a massive MIMO system where multiple users in a single-cell theater watch an identical VR 360 video. Based on tile prediction, base station (BS) deliveries the tiles in predicted field of view (FoV) to users. By introducing practical supplementary transmission for missing tiles and unacceptable VR sickness, we propose the first stable transmission scheme for VR video. we formulate an integer non-linear programming (INLP) problem to maximize users' average quality of experience (QoE) score. Moreover, we derive the achievable spectral efficiency (SE) expression of predictive tile groups and the approximately achievable SE expression of missing tile groups, respectively. Analytically, the overall throughput is related to the number of tile groups and the length of pilot sequences. By exploiting the relationship between the structure of viewport tiles and SE expression, we propose a multi-lattice multi-stream grouping method aimed at improving the overall throughput for VR video transmission. Moreover, we analyze the relationship between QoE objective and number of predictive tile. We transform the original INLP problem into an integer linear programming problem by setting the predictive tiles groups as some constants. With variable relaxation and recovery, we obtain the optimal average QoE. Extensive simulation results validate that the proposed algorithm effectively improves QoE.
△ Less
Submitted 15 June, 2021;
originally announced June 2021.
-
Deep learning algorithms for solving high dimensional nonlinear backward stochastic differential equations
Authors:
Lorenc Kapllani,
Long Teng
Abstract:
In this work, we propose a new deep learning-based scheme for solving high dimensional nonlinear backward stochastic differential equations (BSDEs). The idea is to reformulate the problem as a global optimization, where the local loss functions are included. Essentially, we approximate the unknown solution of a BSDE using a deep neural network and its gradient with automatic differentiation. The a…
▽ More
In this work, we propose a new deep learning-based scheme for solving high dimensional nonlinear backward stochastic differential equations (BSDEs). The idea is to reformulate the problem as a global optimization, where the local loss functions are included. Essentially, we approximate the unknown solution of a BSDE using a deep neural network and its gradient with automatic differentiation. The approximations are performed by globally minimizing the quadratic local loss function defined at each time step, which always includes the terminal condition. This kind of loss functions are obtained by iterating the Euler discretization of the time integrals with the terminal condition. Our formulation can prompt the stochastic gradient descent algorithm not only to take the accuracy at each time layer into account, but also converge to a good local minima. In order to demonstrate performances of our algorithm, several high-dimensional nonlinear BSDEs including pricing problems in finance are provided.
△ Less
Submitted 23 June, 2022; v1 submitted 3 October, 2020;
originally announced October 2020.
-
Multistep schemes for solving backward stochastic differential equations on GPU
Authors:
Lorenc Kapllani,
Long Teng
Abstract:
The goal of this work is to parallelize the multistep scheme for the numerical approximation of the backward stochastic differential equations (BSDEs) in order to achieve both, a high accuracy and a reduction of the computation time as well. In the multistep scheme the computations at each grid point are independent and this fact motivates us to select massively parallel GPU computing using CUDA.…
▽ More
The goal of this work is to parallelize the multistep scheme for the numerical approximation of the backward stochastic differential equations (BSDEs) in order to achieve both, a high accuracy and a reduction of the computation time as well. In the multistep scheme the computations at each grid point are independent and this fact motivates us to select massively parallel GPU computing using CUDA. In our investigations we identify performance bottlenecks and apply appropriate optimization techniques for reducing the computation time, using a uniform domain. Finally, some examples with financial applications are provided to demonstrate the achieved acceleration on GPUs.
△ Less
Submitted 12 November, 2019; v1 submitted 30 September, 2019;
originally announced September 2019.
-
Soft Robots for Extreme Environments: Removing Electronic Control
Authors:
Stephen T. Mahon,
Anthony Buchoux,
Mohammed E. Sayed,
Lijun Teng,
Adam A. Stokes
Abstract:
The ignition of flammable liquids and gases in offshore oil and gas environments is a major risk and can cause loss of life, serious injury, and significant damage to infrastructure. Power supplies that are used to provide regulated voltages to drive motors, relays, and power electronic controls can produce heat and cause sparks. As a result, the European Union requires ATEX certification on elect…
▽ More
The ignition of flammable liquids and gases in offshore oil and gas environments is a major risk and can cause loss of life, serious injury, and significant damage to infrastructure. Power supplies that are used to provide regulated voltages to drive motors, relays, and power electronic controls can produce heat and cause sparks. As a result, the European Union requires ATEX certification on electrical equipment to ensure safety in such extreme environments. Implementing designs that meet this standard is time-consuming and adds to the cost of operations. Soft robots are often made with soft materials and can be actuated pneumatically, without electronics, making these systems inherently compliant with this directive. In this paper, we aim to increase the capability of new soft robotic systems moving from a one-to-one control-actuator architecture and implementing an electronics-free control system. We have developed a robot that demonstrates locomotion and gripping using three-pneumatic lines: a vacuum power line, a control input, and a clock line. We have followed the design principles of digital electronics and demonstrated an integrated fluidic circuit with eleven, fully integrated fluidic switches and six actuators. We have realized the basic building blocks of logical operation into combinational logic and memory using our fluidic switches to create a two-state automata machine. This system expands on the state of the art increasing the complexity over existing soft systems with integrated control.
△ Less
Submitted 26 March, 2019;
originally announced March 2019.
