Showing 1–30 of 30 results for author: Shankar, B

CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving

Authors: Bhavani Shankar, Preethi Jyothi, Pushpak Bhattacharyya

Abstract: Code-switching is a widely prevalent linguistic phenomenon in multilingual societies like India. Building speech-to-text models for code-switched speech is challenging due to limited availability of datasets. In this work, we focus on the problem of spoken translation (ST) of code-switched speech in Indian languages to English text. We present a new end-to-end model architecture COSTA that scaffol… ▽ More Code-switching is a widely prevalent linguistic phenomenon in multilingual societies like India. Building speech-to-text models for code-switched speech is challenging due to limited availability of datasets. In this work, we focus on the problem of spoken translation (ST) of code-switched speech in Indian languages to English text. We present a new end-to-end model architecture COSTA that scaffolds on pretrained automatic speech recognition (ASR) and machine translation (MT) modules (that are more widely available for many languages). Speech and ASR text representations are fused using an aligned interleaving scheme and are fed further as input to a pretrained MT module; the whole pipeline is then trained end-to-end for spoken translation using synthetically created ST data. We also release a new evaluation benchmark for code-switched Bengali-English, Hindi-English, Marathi-English and Telugu- English speech to English text. COSTA significantly outperforms many competitive cascaded and end-to-end multimodal baselines by up to 3.5 BLEU points. △ Less

Submitted 16 June, 2024; originally announced June 2024.

SOA: Reducing Domain Mismatch in SSL Pipeline by Speech Only Adaptation for Low Resource ASR

Authors: Natarajan Balaji Shankar, Ruchao Fan, Abeer Alwan

Abstract: Recently, speech foundation models have gained popularity due to their superiority in finetuning downstream ASR tasks. However, models finetuned on certain domains, such as LibriSpeech (adult read speech), behave poorly on other domains (child or noisy speech). One solution could be collecting as much labeled and diverse data as possible for joint finetuning on various domains. However, collecting… ▽ More Recently, speech foundation models have gained popularity due to their superiority in finetuning downstream ASR tasks. However, models finetuned on certain domains, such as LibriSpeech (adult read speech), behave poorly on other domains (child or noisy speech). One solution could be collecting as much labeled and diverse data as possible for joint finetuning on various domains. However, collecting target domain speech-text paired data and retraining the model is often costly and computationally expensive. In this paper, we introduce a simple yet effective method, speech only adaptation (SOA), based on speech foundation models (Wav2vec 2.0), which requires only speech input data from the target domain. Specifically, the Wav2vec 2.0 feature encoder is continually pretrained with the Wav2vec 2.0 loss on both the source and target domain data for domain adaptation, while the contextual encoder is frozen. Compared to a source domain finetuned model with the feature encoder being frozen during training, we find that replacing the frozen feature encoder with the adapted one provides significant WER improvements to the target domain while preserving the performance of the source domain. The effectiveness of SOA is examined on various low resource or domain mismatched ASR settings, including adult-child and clean-noisy speech. △ Less

Submitted 15 June, 2024; originally announced June 2024.

Comments: Accepted to ICASSP 2024 SASB Workshop

Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models

Authors: Ruchao Fan, Natarajan Balaji Shankar, Abeer Alwan

Abstract: Speech foundation models (SFMs) have achieved state-of-the-art results for various speech tasks in supervised (e.g. Whisper) or self-supervised systems (e.g. WavLM). However, the performance of SFMs for child ASR has not been systematically studied. In addition, there is no benchmark for child ASR with standard evaluations, making the comparisons of novel ideas difficult. In this paper, we initiat… ▽ More Speech foundation models (SFMs) have achieved state-of-the-art results for various speech tasks in supervised (e.g. Whisper) or self-supervised systems (e.g. WavLM). However, the performance of SFMs for child ASR has not been systematically studied. In addition, there is no benchmark for child ASR with standard evaluations, making the comparisons of novel ideas difficult. In this paper, we initiate and present a comprehensive benchmark on several child speech databases based on various SFMs (Whisper, Wav2vec2.0, HuBERT, and WavLM). Moreover, we investigate finetuning strategies by comparing various data augmentation and parameter-efficient finetuning (PEFT) methods. We observe that the behaviors of these methods are different when the model size increases. For example, PEFT matches the performance of full finetuning for large models but worse for small models. To stabilize finetuning using augmented data, we propose a perturbation invariant finetuning (PIF) loss as a regularization. △ Less

Submitted 15 June, 2024; originally announced June 2024.

Comments: To appear in Interspeech 2024

Exploring and Evaluating Real-world CXL: Use Cases and System Adoption

Authors: Jie Liu, Xi Wang, Jianbo Wu, Shuangyan Yang, Jie Ren, Bhanu Shankar, Dong Li

Abstract: Compute eXpress Link (CXL) is emerging as a promising memory interface technology. Because of the common unavailiability of CXL devices, the performance of the CXL memory is largely unknown. What are the use cases for the CXL memory? What are the impacts of the CXL memory on application performance? How to use the CXL memory in combination with existing memory components? In this work, we study th… ▽ More Compute eXpress Link (CXL) is emerging as a promising memory interface technology. Because of the common unavailiability of CXL devices, the performance of the CXL memory is largely unknown. What are the use cases for the CXL memory? What are the impacts of the CXL memory on application performance? How to use the CXL memory in combination with existing memory components? In this work, we study the performance of three genuine CXL memory-expansion cards from different vendors. We characterize the basic performance of the CXL memory, study how HPC applications and large language models can benefit from the CXL memory, and study the interplay between memory tiering and page interleaving. We also propose a novel data object-level interleaving policy to match the interleaving policy with memory access patterns. We reveal the challenges and opportunities of using the CXL memory. △ Less

Submitted 23 May, 2024; originally announced May 2024.

The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Video

Authors: Michelle R. Greene, Benjamin J. Balas, Mark D. Lescroart, Paul R. MacNeilage, Jennifer A. Hart, Kamran Binaee, Peter A. Hausamann, Ronald Mezile, Bharath Shankar, Christian B. Sinnott, Kaylie Capurro, Savannah Halow, Hunter Howe, Mariam Josyula, Annie Li, Abraham Mieses, Amina Mohamed, Ilya Nudnou, Ezra Parkhill, Peter Riley, Brett Schmidt, Matthew W. Shinkle, Wentao Si, Brian Szekely, Joaquin M. Torres , et al. (1 additional authors not shown)

Abstract: We introduce the Visual Experience Dataset (VEDB), a compilation of over 240 hours of egocentric video combined with gaze- and head-tracking data that offers an unprecedented view of the visual world as experienced by human observers. The dataset consists of 717 sessions, recorded by 58 observers ranging from 6-49 years old. This paper outlines the data collection, processing, and labeling protoco… ▽ More We introduce the Visual Experience Dataset (VEDB), a compilation of over 240 hours of egocentric video combined with gaze- and head-tracking data that offers an unprecedented view of the visual world as experienced by human observers. The dataset consists of 717 sessions, recorded by 58 observers ranging from 6-49 years old. This paper outlines the data collection, processing, and labeling protocols undertaken to ensure a representative sample and discusses the potential sources of error or bias within the dataset. The VEDB's potential applications are vast, including improving gaze tracking methodologies, assessing spatiotemporal image statistics, and refining deep neural networks for scene and activity recognition. The VEDB is accessible through established open science platforms and is intended to be a living dataset with plans for expansion and community contributions. It is released with an emphasis on ethical considerations, such as participant privacy and the mitigation of potential biases. By providing a dataset grounded in real-world experiences and accompanied by extensive metadata and supporting code, the authors invite the research community to utilize and contribute to the VEDB, facilitating a richer understanding of visual perception and behavior in naturalistic settings. △ Less

Submitted 15 February, 2024; originally announced April 2024.

Comments: 36 pages, 1 table, 7 figures

Stability of buoyant-Couette flow in a vertical porous slot

Authors: B. M. Shankar, I. S. Shivakumara

Abstract: The stability of two-dimensional buoyancy-driven convection in a vertical porous slot, wherein a plane Couette flow is additionally present, is studied. This complex fluid flow scenario is examined under the influence of Robin-type boundary conditions, which are applied to perturbations in both velocity and temperature. The inclusion of a time-derivative velocity term within the Darcy momentum equ… ▽ More The stability of two-dimensional buoyancy-driven convection in a vertical porous slot, wherein a plane Couette flow is additionally present, is studied. This complex fluid flow scenario is examined under the influence of Robin-type boundary conditions, which are applied to perturbations in both velocity and temperature. The inclusion of a time-derivative velocity term within the Darcy momentum equation notably introduces intricacies to the study. The stability of the basic natural convection flow is primarily governed by several key parameters namely, the Péclet number, the Prandtl-Darcy number, the Biot number and a non-negative parameter that dictates the nature of the vertical boundaries. Through numerical analysis, the stability eigenvalue problem is solved for a variety of combinations of boundary conditions. The outcomes of this analysis reveal the critical threshold values that signify the onset of instability. Furthermore, a detailed examination of the stability of the system has provided insights into both its commonalities and distinctions under different conditions. It is observed that, except for the scenario featuring impermeable-isothermal boundaries, the underlying base flow exhibits instability when subjected to various other configurations of perturbed velocity and temperature boundary conditions. This underscores the notion that the presence of Couette flow alone does not suffice to induce instability within the system. The plots depicting neutral stability curves show either bi-modal or uni-modal characteristics, contingent upon specific parameter values that influence the onset of instability. △ Less

Submitted 7 December, 2023; originally announced December 2023.

A Blender-based channel simulator for FMCW Radar

Authors: Yuan Liu, Moein Ahmadi, Johann Fuchs, Mohammad Alaee-Kerahroodi, M. R. Bhavani Shankar

Abstract: Radar simulation is a promising way to provide data-cube with effectiveness and accuracy for AI-based approaches to radar applications. This paper develops a channel simulator to generate frequency-modulated continuous-wave (FMCW) waveform multiple inputs multiple outputs (MIMO) radar signals. In the proposed simulation framework, an open-source animation tool called Blender is utilized to model t… ▽ More Radar simulation is a promising way to provide data-cube with effectiveness and accuracy for AI-based approaches to radar applications. This paper develops a channel simulator to generate frequency-modulated continuous-wave (FMCW) waveform multiple inputs multiple outputs (MIMO) radar signals. In the proposed simulation framework, an open-source animation tool called Blender is utilized to model the scenarios and render animations. The ray tracing (RT) engine embedded can trace the radar propagation paths, i.e., the distance and signal strength of each path. The beat signal models of time division multiplexing (TDM)-MIMO are adapted to RT outputs. Finally, the environment-based models are simulated to show the validation. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Comments: Presented in ISCS23

Report number: ISCS23-26

RIS-Aided Wideband Holographic DFRC

Authors: Tong Wei, Linlong Wu, Kumar Vijay Mishra, M. R. Bhavani Shankar

Abstract: To enable non-line-of-sight (NLoS) sensing and communications, dual-function radar-communications (DFRC) systems have recently proposed employing reconfigurable intelligent surface (RIS) as a reflector in wireless media. However, in the dense environment and higher frequencies, severe propagation and attenuation losses are a hindrance for RIS-aided DFRC systems to utilize wideband processing. To t… ▽ More To enable non-line-of-sight (NLoS) sensing and communications, dual-function radar-communications (DFRC) systems have recently proposed employing reconfigurable intelligent surface (RIS) as a reflector in wireless media. However, in the dense environment and higher frequencies, severe propagation and attenuation losses are a hindrance for RIS-aided DFRC systems to utilize wideband processing. To this end, we propose equipping the transceivers with the reconfigurable holographic surface (RHS) that, different from RIS, is a metasurface with an embedded connected feed deployed at the transceiver for greater control of the radiation amplitude. This surface is crucial for designing compact low-cost wideband wireless systems, wherein ultra-massive antenna arrays are required to compensate for the losses incurred by severe attenuation and diffraction. We consider a novel wideband DFRC system equipped with an RHS at the transceiver and a RIS reflector in the channel. We jointly design the digital, holographic, and passive beamformers to maximize the radar signal-to-interference-plus-noise ratio (SINR) while ensuring the communications SINR among all users. The resulting nonconvex optimization problem involves maximin objective, constant modulus, and difference of convex constraints. We develop an alternating maximization method to decouple and iteratively solve these subproblems. Numerical experiments demonstrate that the proposed method achieves better radar performance than non-RIS, random-RHS, and randomly configured RIS-aided DFRC systems. △ Less

Submitted 8 May, 2023; originally announced May 2023.

Sparse Array Design for Dual-Function Radar-Communications System

Authors: Huiping Huang, Linlong Wu, Bhavani Shankar, Abdelhak M. Zoubir

Abstract: The problem of sparse array design for dual-function radar-communications is investigated. Our goal is to design a sparse array which can simultaneously shape desired beam responses and serve multiple downlink users with the required signal-to-interference-plus-noise ratio levels. Besides, we also take into account the limitation of the radiated power by each antenna. The problem is formulated as… ▽ More The problem of sparse array design for dual-function radar-communications is investigated. Our goal is to design a sparse array which can simultaneously shape desired beam responses and serve multiple downlink users with the required signal-to-interference-plus-noise ratio levels. Besides, we also take into account the limitation of the radiated power by each antenna. The problem is formulated as a quadratically constrained quadratic program with a joint-sparsity-promoting regularization, which is NP-hard. The resulting problem is solved by the consensus alternating direction method of multipliers, which enjoys parallel implementation. Numerical simulations exhibit the effectiveness and superiority of the proposed method which leads to a more power-efficient solution. △ Less

Submitted 13 March, 2023; v1 submitted 2 January, 2023; originally announced January 2023.

Comments: Accepted by IEEE Communications Letters

Collective Intelligent Strategy for Improved Segmentation of COVID-19 from CT

Authors: Surochita Pal Das, Sushmita Mitra, B. Uma Shankar

Abstract: The devastation caused by the coronavirus pandemic makes it imperative to design automated techniques for a fast and accurate detection. We propose a novel non-invasive tool, using deep learning and imaging, for delineating COVID-19 infection in lungs. The Ensembling Attention-based Multi-scaled Convolution network (EAMC), employing Leave-One-Patient-Out (LOPO) training, exhibits high sensitivity… ▽ More The devastation caused by the coronavirus pandemic makes it imperative to design automated techniques for a fast and accurate detection. We propose a novel non-invasive tool, using deep learning and imaging, for delineating COVID-19 infection in lungs. The Ensembling Attention-based Multi-scaled Convolution network (EAMC), employing Leave-One-Patient-Out (LOPO) training, exhibits high sensitivity and precision in outlining infected regions along with assessment of severity. The Attention module combines contextual with local information, at multiple scales, for accurate segmentation. Ensemble learning integrates heterogeneity of decision through different base classifiers. The superiority of EAMC, even with severe class imbalance, is established through comparison with existing state-of-the-art learning models over four publicly-available COVID-19 datasets. The results are suggestive of the relevance of deep learning in providing assistive intelligence to medical practitioners, when they are overburdened with patients as in pandemics. Its clinical significance lies in its unprecedented scope in providing low-cost decision-making for patients lacking specialized healthcare at remote locations. △ Less

Submitted 23 December, 2022; originally announced December 2022.

Improving Pulse-Compression Weather Radar via the Joint Design of Subpulses and Extended Mismatch Filter

Authors: Linlong Wu, Mohammad Alaee-Kerahroodi, M. R. Bhavani Shankar

Abstract: Pulse compression can enhance both the performance in range resolution and sensitivity for weather radar. However, it will introduce the issue of high sidelobes if not delicately implemented. Motivated by this fact, we focus on the pulse compression design for weather radar in this paper. Specifically, we jointly design both the subpulse codes and extended mismatch filter based on the alternating… ▽ More Pulse compression can enhance both the performance in range resolution and sensitivity for weather radar. However, it will introduce the issue of high sidelobes if not delicately implemented. Motivated by this fact, we focus on the pulse compression design for weather radar in this paper. Specifically, we jointly design both the subpulse codes and extended mismatch filter based on the alternating direction method of multipliers (ADMM). This joint design will yield a pulse compression with low sidelobes, which equivalently implies a high signal-to-interference-plus-noise ratio (SINR) and a low estimation error on meteorological reflectivity. The experiment results demonstrate the efficacy of the proposed pulse compression strategy since its achieved meteorological reflectivity estimations are highly similar to the ground truth. △ Less

Submitted 27 September, 2022; originally announced September 2022.

Hybrid Beamforming in mmWave Dual-Function Radar-Communication Systems: Models, Technologies, and Challenges

Authors: Ziyang Cheng, Linlong Wu, Bowen Wang, Bhavani Shankar, Bin Liao, Björn Ottersten

Abstract: As a promising technology in beyond-5G (B5G) and 6G, dual-function radar-communication (DFRC) aims to ensure both radar sensing and communication on a single integrated platform with unified signaling schemes. To achieve accurate sensing and reliable communication, large-scale arrays are anticipated to be implemented in such systems, which brings out the prominent issues on hardware cost and power… ▽ More As a promising technology in beyond-5G (B5G) and 6G, dual-function radar-communication (DFRC) aims to ensure both radar sensing and communication on a single integrated platform with unified signaling schemes. To achieve accurate sensing and reliable communication, large-scale arrays are anticipated to be implemented in such systems, which brings out the prominent issues on hardware cost and power consumption. To address these issues, hybrid beamforming (HBF), beyond its successful deployment in communication-only systems, could be a promising approach in the emerging DFRC ones. In this article, we investigate the development of the HBF techniques on the DFRC system in a self-contained manner. Specifically, we first introduce the basics of the HBF based DFRC system, where the system model and different receive modes are discussed with focus. Then we illustrate the corresponding design principles, which span from the performance metrics and optimization formulations to the design approaches and our preliminary results. Finally, potential extension and key research opportunities, such as the combination with the reconfigurable intelligent surface, are discussed concisely. △ Less

Submitted 4 March, 2024; v1 submitted 10 September, 2022; originally announced September 2022.

Comments: This manuscript has not been fully modified

Multi-IRS-Aided Doppler-Tolerant Wideband DFRC System

Authors: Tong Wei, Linlong Wu, Kumar Vijay Mishra, M. R. Bhavani Shankar

Abstract: Intelligent reflecting surface (IRS) is recognized as an enabler of future dual-function radar-communications (DFRC) by improving spectral efficiency, coverage, parameter estimation, and interference suppression. Prior studies on IRS-aided DFRC focus either on narrowband processing, single-IRS deployment, static targets, non-clutter scenario, or on the under-utilized line-of-sight (LoS) and non-li… ▽ More Intelligent reflecting surface (IRS) is recognized as an enabler of future dual-function radar-communications (DFRC) by improving spectral efficiency, coverage, parameter estimation, and interference suppression. Prior studies on IRS-aided DFRC focus either on narrowband processing, single-IRS deployment, static targets, non-clutter scenario, or on the under-utilized line-of-sight (LoS) and non-line-of-sight (NLoS) paths. In this paper, we address the aforementioned shortcomings by optimizing a wideband DFRC system comprising multiple IRSs and a dual-function base station that jointly processes the LoS and NLoS wideband multi-carrier signals to improve both the communications SINR and the radar SINR in the presence of a moving target and clutter. We formulate the transmit, {receive} and IRS beamformer design as the maximization of the worst-case radar signal-to-interference-plus-noise ratio (SINR) subject to transmit power and communications SINR. We tackle this nonconvex problem under the alternating optimization framework, where the subproblems are solved by a combination of Dinkelbach algorithm, consensus alternating direction method of multipliers, and Riemannian steepest decent. Our numerical experiments show that the proposed multi-IRS-aided wideband DFRC provides over $4$ dB radar SINR and $31.7$\% improvement in target detection over a single-IRS system. △ Less

Submitted 10 August, 2023; v1 submitted 5 July, 2022; originally announced July 2022.

Comments: 16 pages, 8 figures, 2 tables

The Rise of Intelligent Reflecting Surfaces in Integrated Sensing and Communications Paradigms

Authors: Ahmet M. Elbir, Kumar Vijay Mishra, M. R. Bhavani Shankar, Symeon Chatzinotas

Abstract: The intelligent reflecting surface (IRS) alters the behavior of wireless media and, consequently, has potential to improve the performance and reliability of wireless systems such as communications and radar remote sensing. Recently, integrated sensing and communications (ISAC) has been widely studied as a means to efficiently utilize spectrum and thereby save cost and power. This article investig… ▽ More The intelligent reflecting surface (IRS) alters the behavior of wireless media and, consequently, has potential to improve the performance and reliability of wireless systems such as communications and radar remote sensing. Recently, integrated sensing and communications (ISAC) has been widely studied as a means to efficiently utilize spectrum and thereby save cost and power. This article investigates the role of IRS in the future ISAC paradigms. While there is a rich heritage of recent research into IRS-assisted communications, the IRS-assisted radars and ISAC remain relatively unexamined. We discuss the putative advantages of IRS deployment, such as coverage extension, interference suppression, and enhanced parameter estimation, for both communications and radar. We introduce possible IRS-assisted ISAC scenarios with common and dedicated surfaces. The article provides an overview of related signal processing techniques and the design challenges, such as wireless channel acquisition, waveform design, and security. △ Less

Submitted 20 December, 2022; v1 submitted 14 April, 2022; originally announced April 2022.

Comments: Accepted paper in IEEE Network Magazine

Journal ref: IEEE Network, 2023

Multi-Label Classification on Remote-Sensing Images

Authors: Aditya Kumar Singh, B. Uma Shankar

Abstract: Acquiring information on large areas on the earth's surface through satellite cameras allows us to see much more than we can see while standing on the ground. This assists us in detecting and monitoring the physical characteristics of an area like land-use patterns, atmospheric conditions, forest cover, and many unlisted aspects. The obtained images not only keep track of continuous natural phenom… ▽ More Acquiring information on large areas on the earth's surface through satellite cameras allows us to see much more than we can see while standing on the ground. This assists us in detecting and monitoring the physical characteristics of an area like land-use patterns, atmospheric conditions, forest cover, and many unlisted aspects. The obtained images not only keep track of continuous natural phenomena but are also crucial in tackling the global challenge of severe deforestation. Among which Amazon basin accounts for the largest share every year. Proper data analysis would help limit detrimental effects on the ecosystem and biodiversity with a sustainable healthy atmosphere. This report aims to label the satellite image chips of the Amazon rainforest with atmospheric and various classes of land cover or land use through different machine learning and superior deep learning models. Evaluation is done based on the F2 metric, while for loss function, we have both sigmoid cross-entropy as well as softmax cross-entropy. Images are fed indirectly to the machine learning classifiers after only features are extracted using pre-trained ImageNet architectures. Whereas for deep learning models, ensembles of fine-tuned ImageNet pre-trained models are used via transfer learning. Our best score was achieved so far with the F2 metric is 0.927. △ Less

Submitted 6 January, 2022; originally announced January 2022.

Comments: The report consists of 95 Pages, 45 Figures, 31 Tables, 85 References

MIMO Radar Transmit Beampattern Shaping for Spectrally Dense Environments

Authors: Ehsan Raei, Saeid Sedighi, Mohammad Alaee-Kerahroodi, M. R. Bhavani Shankar

Abstract: Designing unimodular waveforms with a desired beampattern, spectral occupancy and orthogonality level is of vital importance in the next generation Multiple-Input Multiple-Output (MIMO) radar systems. Motivated by this fact, in this paper, we propose a framework for shaping the beampattern in MIMO radar systems under the constraints simultaneously ensuring unimodularity, desired spectral occupancy… ▽ More Designing unimodular waveforms with a desired beampattern, spectral occupancy and orthogonality level is of vital importance in the next generation Multiple-Input Multiple-Output (MIMO) radar systems. Motivated by this fact, in this paper, we propose a framework for shaping the beampattern in MIMO radar systems under the constraints simultaneously ensuring unimodularity, desired spectral occupancy and orthogonality of the designed waveform. In this manner, the proposed framework is the most comprehensive approach for MIMO radar waveform design focusing on beampattern shaping. The problem formulation leads to a non-convex quadratic fractional programming. We propose an effective iterative to solve the problem, where each iteration is composed of a Semi-Definite Programming (SDP) followed by eigenvalue decomposition. Some numerical simulations are provided to illustrate the superior performance of our proposed over the state-of-the-art. △ Less

Submitted 13 December, 2021; originally announced December 2021.

One-Bit ADCs/DACs based MIMO Radar: Performance Analysis and Joint Design

Authors: Minglong Deng, Ziyang Cheng, Linlong Wu, Bhavani Shankar, Zishu He

Abstract: Extremely low-resolution (e.g. one-bit) analog-to-digital converters (ADCs) and digital-to-analog converters (DACs) can substantially reduce hardware cost and power consumption for MIMO radar especially with large scale antennas. In this paper, we focus on the detection performance analysis and joint design for the MIMO radar with one-bit ADCs and DACs. Specifically, under the assumption of low si… ▽ More Extremely low-resolution (e.g. one-bit) analog-to-digital converters (ADCs) and digital-to-analog converters (DACs) can substantially reduce hardware cost and power consumption for MIMO radar especially with large scale antennas. In this paper, we focus on the detection performance analysis and joint design for the MIMO radar with one-bit ADCs and DACs. Specifically, under the assumption of low signal-to-noise ratio (SNR) and interference-to-noise ratio (INR), we derive the expressions of probability of detection ($\mathcal{P}_d$) and probability of false alarm ($\mathcal{P}_f$) for one-bit MIMO radar and also the theoretical performance gap to infinite-bit MIMO radars for the noise-only case. We further find that for a fixed $\mathcal{P}_f$, $\mathcal{P}_d$ depends on the defined quantized signal-to-interference-plus-noise ratio (QSINR), which is a function of the transmit waveform and receive filter. Thus, an optimization problem arises naturally to maximize the QSINR by joint designing the waveform and filter. For the formulated problem, we propose an alternatin\emph{g} wavefo\emph{r}m and filt\emph{e}r d\emph{e}sign for QSINR maximiza\emph{t}ion (GREET). At each iteration of GREET, the receive filter is upadted via the minimum variance distortionless response (MVDR) method, and the one-bit waveform is optimized based on the alternating direction method of multipliers (ADMM) algorithm where the closed-form solutions are obtained for both the primary and slack variables. Numerical simulations are consistent to the theoretical performance analysis and demonstrate the effectiveness of the proposed design algorithm. △ Less

Submitted 24 December, 2021; v1 submitted 21 October, 2021; originally announced October 2021.

An asymptotic expansion for a twisted Lambert series associated to a cusp form and the Möbius function: level aspect

Authors: Bibekananda Maji, Sumukha Sathyanarayana, B. R. Shankar

Abstract: Recently, Juyal, Maji, and Sathyanarayana have studied a Lambert series associated with a cusp form over the full modular group and the Möbius function. In this paper, we investigate the Lambert series $\sum_{n=1}^{\infty}[a_f(n)ψ(n)*μ(n)ψ'(n)]\exp(-ny),$ where $a_f(n)$ is the $n$th Fourier coefficient of a cusp form $f$ over any congruence subgroup, and $ψ$ and $ ψ'$ are primitive Dirichlet chara… ▽ More Recently, Juyal, Maji, and Sathyanarayana have studied a Lambert series associated with a cusp form over the full modular group and the Möbius function. In this paper, we investigate the Lambert series $\sum_{n=1}^{\infty}[a_f(n)ψ(n)*μ(n)ψ'(n)]\exp(-ny),$ where $a_f(n)$ is the $n$th Fourier coefficient of a cusp form $f$ over any congruence subgroup, and $ψ$ and $ ψ'$ are primitive Dirichlet characters. This extends the earlier work to the case of higher level subgroups and also gives a character analogue. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: 15 pages, comments are welcome!

MSC Class: Primary 11M06; 11M26; Secondary 11N37

Sparse Array Beampattern Synthesis via Majorization-Based ADMM

Authors: Tong Wei, Linlong Wu, M. R. Bhavani Shankar

Abstract: Beampattern synthesis is a key problem in many wireless applications. With the increasing scale of MIMO antenna array, it is highly desired to conduct beampattern synthesis on a sparse array to reduce the power and hardware cost. In this paper, we consider conducting beampattern synthesis and sparse array construction jointly. In the formulated problem, the beampattern synthesis is designed by min… ▽ More Beampattern synthesis is a key problem in many wireless applications. With the increasing scale of MIMO antenna array, it is highly desired to conduct beampattern synthesis on a sparse array to reduce the power and hardware cost. In this paper, we consider conducting beampattern synthesis and sparse array construction jointly. In the formulated problem, the beampattern synthesis is designed by minimizing the matching error to the beampattern template, and the Shannon entropy function is first introduced to impose the sparsity of the array. Then, for this nonconvex problem, an iterative method is proposed by leveraging on the alternating direction multiplier method (ADMM) and the majorization minimization (MM). Simulation results demonstrate that, compared with the benchmark, our approach achieves a good trade-off between array sparsity and beampattern matching error with less runtime. △ Less

Submitted 4 June, 2021; v1 submitted 9 April, 2021; originally announced April 2021.

Design of MIMO Radar Waveforms based on lp-Norm Criteria

Authors: Ehsan Raei, Mohammad Alaee-Kerahroodi, Prabhu Babu, M. R. Bhavani Shankar

Abstract: Multiple-input multiple-output (MIMO) radars transmit a set of sequences that exhibit small cross-correlation sidelobes, to enhance sensing performance by separating them at the matched filter outputs. The waveforms also require small auto-correlation sidelobes to avoid masking of weak targets by the range sidelobes of strong targets and to mitigate deleterious effects of distributed clutter. In l… ▽ More Multiple-input multiple-output (MIMO) radars transmit a set of sequences that exhibit small cross-correlation sidelobes, to enhance sensing performance by separating them at the matched filter outputs. The waveforms also require small auto-correlation sidelobes to avoid masking of weak targets by the range sidelobes of strong targets and to mitigate deleterious effects of distributed clutter. In light of these requirements, in this paper, we design a set of phase-only (constant modulus) sequences that exhibit near-optimal properties in terms of Peak Sidelobe Level (PSL) and Integrated Sidelobe Level (ISL). At the design stage, we adopt weighted lp-norm of auto- and cross-correlation sidelobes as the objective function and minimize it for a general p value, using block successive upper bound minimization (BSUM). Considering the limitation of radar amplifiers, we design unimodular sequences which make the design problem non-convex and NP-hard. To tackle the problem, in every iteration of the BSUM algorithm, we introduce different local approximation functions and optimize them concerning a block, containing a code entry or a code vector. The numerical results show that the performance of the optimized set of sequences outperforms the state-of-the-art counterparts, in both terms of PSL values and computational time. △ Less

Submitted 7 April, 2021; originally announced April 2021.

Spatial- and Range- ISLR Trade-off in MIMO Radar via Waveform Correlation Optimization

Authors: Ehsan Raei, Mohammad Alaee-Kerahrood, M. R. Bhavani Shankar

Abstract: This paper aims to design a set of transmitting waveforms in cognitive colocated Multi-Input Multi-Output (MIMO) radar systems considering the simultaneous minimization of spatial- and the range- Integrated Sidelobe Level Ratio (ISLR). The design problem is formulated as a bi-objective Pareto optimization under practical constraints on the waveforms, namely total transmit power, peak-to-average-po… ▽ More This paper aims to design a set of transmitting waveforms in cognitive colocated Multi-Input Multi-Output (MIMO) radar systems considering the simultaneous minimization of spatial- and the range- Integrated Sidelobe Level Ratio (ISLR). The design problem is formulated as a bi-objective Pareto optimization under practical constraints on the waveforms, namely total transmit power, peak-to-average-power ratio (PAR), constant modulus, and discrete phase alphabet. A Coordinate Descent (CD) based approach is proposed, in which at every single variable update of the algorithm we obtain the solution of the uni-variable optimization problems. The novelty of the paper comes from deriving a flexible waveform design problem applicable for 4D imaging MIMO radars which is optimized directly over the different constraint sets. The simultaneous optimization leads to a trade-off between the two ISLRs and the simulation results illustrate significantly improved trade-off offered by the proposed methodologies. △ Less

Submitted 8 March, 2021; originally announced March 2021.

On the Performance of One-Bit DoA Estimation via Sparse Linear Arrays

Authors: Saeid Sedighi, M. R. Bhavani Shankar, Mojtaba Soltanalian, Björn Ottersten

Abstract: Direction of Arrival (DoA) estimation using Sparse Linear Arrays (SLAs) has recently gained considerable attention in array processing thanks to their capability to provide enhanced degrees of freedom in resolving uncorrelated source signals. Additionally, deployment of one-bit Analog-to-Digital Converters (ADCs) has emerged as an important topic in array processing, as it offers both a low-cost a… ▽ More Direction of Arrival (DoA) estimation using Sparse Linear Arrays (SLAs) has recently gained considerable attention in array processing thanks to their capability to provide enhanced degrees of freedom in resolving uncorrelated source signals. Additionally, deployment of one-bit Analog-to-Digital Converters (ADCs) has emerged as an important topic in array processing, as it offers both a low-cost and a low-complexity implementation. In this paper, we study the problem of DoA estimation from one-bit measurements received by an SLA. Specifically, we first investigate the identifiability conditions for the DoA estimation problem from one-bit SLA data and establish an equivalency with the case when DoAs are estimated from infinite-bit unquantized measurements. Towards determining the performance limits of DoA estimation from one-bit quantized data, we derive a pessimistic approximation of the corresponding Cramér-Rao Bound (CRB). This pessimistic CRB is then used as a benchmark for assessing the performance of one-bit DoA estimators. We also propose a new algorithm for estimating DoAs from one-bit quantized data. We investigate the analytical performance of the proposed method through deriving a closed-form expression for the covariance matrix of the asymptotic distribution of the DoA estimation errors and show that it outperforms the existing algorithms in the literature. Numerical simulations are provided to validate the analytical derivations and corroborate the resulting performance improvement. △ Less

Submitted 20 October, 2021; v1 submitted 27 December, 2020; originally announced December 2020.

Comments: 17 pages, 10 figures

Localization with One-Bit Passive Radars in Narrowband Internet-of-Things using Multivariate Polynomial Optimization

Authors: Saeid Sedighi, Kumar Vijay Mishra, M. R. Bhavani Shankar, Björn Ottersten

Abstract: Several Internet-of-Things (IoT) applications provide location-based services, wherein it is critical to obtain accurate position estimates by aggregating information from individual sensors. In the recently proposed narrowband IoT (NB-IoT) standard, which trades off bandwidth to gain wide coverage, the location estimation is compounded by the low sampling rate receivers and limited-capacity links… ▽ More Several Internet-of-Things (IoT) applications provide location-based services, wherein it is critical to obtain accurate position estimates by aggregating information from individual sensors. In the recently proposed narrowband IoT (NB-IoT) standard, which trades off bandwidth to gain wide coverage, the location estimation is compounded by the low sampling rate receivers and limited-capacity links. We address both of these NB-IoT drawbacks in the framework of passive sensing devices that receive signals from the target-of-interest. We consider the limiting case where each node receiver employs one-bit analog-to-digital-converters and propose a novel low-complexity nodal delay estimation method using constrained-weighted least squares minimization. To support the low-capacity links to the fusion center (FC), the range estimates obtained at individual sensors are then converted to one-bit data. At the FC, we propose target localization with the aggregated one-bit range vector using both optimal and sub-optimal techniques. The computationally expensive former approach is based on Lasserre's method for multivariate polynomial optimization while the latter employs our less complex iterative joint r\textit{an}ge-\textit{tar}get location \textit{es}timation (ANTARES) algorithm. Our overall one-bit framework not only complements the low NB-IoT bandwidth but also supports the design goal of inexpensive NB-IoT location sensing. Numerical experiments demonstrate feasibility of the proposed one-bit approach with a $0.6$\% increase in the normalized localization error for the small set of $20$-$60$ nodes over the full-precision case. When the number of nodes is sufficiently large ($>80$), the one-bit methods yield the same performance as the full precision. △ Less

Submitted 9 April, 2021; v1 submitted 29 July, 2020; originally announced July 2020.

Comments: 16 pages, 11 figures

Satellite Communications in the New Space Era: A Survey and Future Challenges

Authors: O. Kodheli, E. Lagunas, N. Maturo, S. K. Sharma, B. Shankar, J. F. Mendoza Montoya, J. C. Merlano Duncan, D. Spano, S. Chatzinotas, S. Kisseleff, J. Querol, L. Lei, T. X. Vu, G. Goussetis

Abstract: Satellite communications have recently entered a period of renewed interest motivated by technological advances and nurtured through private investment and ventures. The present survey aims at capturing the state of the art in SatComs, while highlighting the most promising open research topics. Firstly, the main innovation drivers are motivated, such as new constellation types, on-board processing… ▽ More Satellite communications have recently entered a period of renewed interest motivated by technological advances and nurtured through private investment and ventures. The present survey aims at capturing the state of the art in SatComs, while highlighting the most promising open research topics. Firstly, the main innovation drivers are motivated, such as new constellation types, on-board processing capabilities, nonterrestrial networks and space-based data collection/processing. Secondly, the most promising applications are described i.e. 5G integration, space communications, Earth observation, aeronautical and maritime tracking and communication. Subsequently, an in-depth literature review is provided across five axes: i) system aspects, ii) air interface, iii) medium access, iv) networking, v) testbeds & prototyping. Finally, a number of future challenges and the respective open research topics are described. △ Less

Submitted 2 March, 2020; v1 submitted 20 February, 2020; originally announced February 2020.

Comments: Submitted for possible publication in IEEE Communications Surveys & Tutorials

A Family of Deep Learning Architectures for Channel Estimation and Hybrid Beamforming in Multi-Carrier mm-Wave Massive MIMO

Authors: Ahmet M. Elbir, Kumar Vijay Mishra, M. R. Bhavani Shankar, Björn Ottersten

Abstract: Hybrid analog and digital beamforming transceivers are instrumental in addressing the challenge of expensive hardware and high training overheads in the next generation millimeter-wave (mm-Wave) massive MIMO (multiple-input multiple-output) systems. However, lack of fully digital beamforming in hybrid architectures and short coherence times at mm-Wave impose additional constraints on the channel e… ▽ More Hybrid analog and digital beamforming transceivers are instrumental in addressing the challenge of expensive hardware and high training overheads in the next generation millimeter-wave (mm-Wave) massive MIMO (multiple-input multiple-output) systems. However, lack of fully digital beamforming in hybrid architectures and short coherence times at mm-Wave impose additional constraints on the channel estimation. Prior works on addressing these challenges have focused largely on narrowband channels wherein optimization-based or greedy algorithms were employed to derive hybrid beamformers. In this paper, we introduce a deep learning (DL) approach for channel estimation and hybrid beamforming for frequency-selective, wideband mm-Wave systems. In particular, we consider a massive MIMO Orthogonal Frequency Division Multiplexing (MIMO-OFDM) system and propose three different DL frameworks comprising convolutional neural networks (CNNs), which accept the raw data of received signal as input and yield channel estimates and the hybrid beamformers at the output. We also introduce both offline and online prediction schemes. Numerical experiments demonstrate that, compared to the current state-of-the-art optimization and DL methods, our approach provides higher spectral efficiency, lesser computational cost and fewer number of pilot signals, and higher tolerance against the deviations in the received pilot data, corrupted channel matrix, and propagation environment. △ Less

Submitted 3 January, 2022; v1 submitted 20 December, 2019; originally announced December 2019.

Comments: Accepted Paper in IEEE Transactions on Cognitive Communications and Networking. arXiv admin note: text overlap with arXiv:1910.14240

Dynamic Approach for Lane Detection using Google Street View and CNN

Authors: Rama Sai Mamidala, Uday Uthkota, Mahamkali Bhavani Shankar, A. Joseph Antony, A. V. Narasimhadhan

Abstract: Lane detection algorithms have been the key enablers for a fully-assistive and autonomous navigation systems. In this paper, a novel and pragmatic approach for lane detection is proposed using a convolutional neural network (CNN) model based on SegNet encoder-decoder architecture. The encoder block renders low-resolution feature maps of the input and the decoder block provides pixel-wise classific… ▽ More Lane detection algorithms have been the key enablers for a fully-assistive and autonomous navigation systems. In this paper, a novel and pragmatic approach for lane detection is proposed using a convolutional neural network (CNN) model based on SegNet encoder-decoder architecture. The encoder block renders low-resolution feature maps of the input and the decoder block provides pixel-wise classification from the feature maps. The proposed model has been trained over 2000 image data-set and tested against their corresponding ground-truth provided in the data-set for evaluation. To enable real-time navigation, we extend our model's predictions interfacing it with the existing Google APIs evaluating the metrics of the model tuning the hyper-parameters. The novelty of this approach lies in the integration of existing segNet architecture with google APIs. This interface makes it handy for assistive robotic systems. The observed results show that the proposed method is robust under challenging occlusion conditions due to pre-processing involved and gives superior performance when compared to the existing methods. △ Less

Submitted 2 September, 2019; originally announced September 2019.

Comments: Preprint: To be published in the proceedings of IEEE TENCON 2019

Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge

Authors: Spyridon Bakas, Mauricio Reyes, Andras Jakab, Stefan Bauer, Markus Rempfler, Alessandro Crimi, Russell Takeshi Shinohara, Christoph Berger, Sung Min Ha, Martin Rozycki, Marcel Prastawa, Esther Alberts, Jana Lipkova, John Freymann, Justin Kirby, Michel Bilello, Hassan Fathallah-Shaykh, Roland Wiest, Jan Kirschke, Benedikt Wiestler, Rivka Colen, Aikaterini Kotrotsou, Pamela Lamontagne, Daniel Marcus, Mikhail Milchenko , et al. (402 additional authors not shown)

Abstract: Gliomas are the most common primary brain malignancies, with different degrees of aggressiveness, variable prognosis and various heterogeneous histologic sub-regions, i.e., peritumoral edematous/invaded tissue, necrotic core, active and non-enhancing core. This intrinsic heterogeneity is also portrayed in their radio-phenotype, as their sub-regions are depicted by varying intensity profiles dissem… ▽ More Gliomas are the most common primary brain malignancies, with different degrees of aggressiveness, variable prognosis and various heterogeneous histologic sub-regions, i.e., peritumoral edematous/invaded tissue, necrotic core, active and non-enhancing core. This intrinsic heterogeneity is also portrayed in their radio-phenotype, as their sub-regions are depicted by varying intensity profiles disseminated across multi-parametric magnetic resonance imaging (mpMRI) scans, reflecting varying biological properties. Their heterogeneous shape, extent, and location are some of the factors that make these tumors difficult to resect, and in some cases inoperable. The amount of resected tumor is a factor also considered in longitudinal scans, when evaluating the apparent tumor for potential diagnosis of progression. Furthermore, there is mounting evidence that accurate segmentation of the various tumor sub-regions can offer the basis for quantitative image analysis towards prediction of patient overall survival. This study assesses the state-of-the-art machine learning (ML) methods used for brain tumor image analysis in mpMRI scans, during the last seven instances of the International Brain Tumor Segmentation (BraTS) challenge, i.e., 2012-2018. Specifically, we focus on i) evaluating segmentations of the various glioma sub-regions in pre-operative mpMRI scans, ii) assessing potential tumor progression by virtue of longitudinal growth of tumor sub-regions, beyond use of the RECIST/RANO criteria, and iii) predicting the overall survival from pre-operative mpMRI scans of patients that underwent gross total resection. Finally, we investigate the challenge of identifying the best ML algorithms for each of these tasks, considering that apart from being diverse on each instance of the challenge, the multi-institutional mpMRI BraTS dataset has also been a continuously evolving/growing dataset. △ Less

Submitted 23 April, 2019; v1 submitted 5 November, 2018; originally announced November 2018.

Comments: The International Multimodal Brain Tumor Segmentation (BraTS) Challenge

A CADe System for Gliomas in Brain MRI using Convolutional Neural Networks

Authors: Subhasis Banerjee, Sushmita Mitra, Anmol Sharma, B. Uma Shankar

Abstract: Inspired by the success of Convolutional Neural Networks (CNN), we develop a novel Computer Aided Detection (CADe) system using CNN for Glioblastoma Multiforme (GBM) detection and segmentation from multi channel MRI data. A two-stage approach first identifies the presence of GBM. This is followed by a GBM localization in each "abnormal" MR slice. As part of the CADe system, two CNN architectures v… ▽ More Inspired by the success of Convolutional Neural Networks (CNN), we develop a novel Computer Aided Detection (CADe) system using CNN for Glioblastoma Multiforme (GBM) detection and segmentation from multi channel MRI data. A two-stage approach first identifies the presence of GBM. This is followed by a GBM localization in each "abnormal" MR slice. As part of the CADe system, two CNN architectures viz. Classification CNN (C-CNN) and Detection CNN (D-CNN) are employed. The CADe system considers MRI data consisting of four sequences ($T_1$, $T_{1c},$ $T_2$, and $T_{2FLAIR}$) as input, and automatically generates the bounding boxes encompassing the tumor regions in each slice which is deemed abnormal. Experimental results demonstrate that the proposed CADe system, when used as a preliminary step before segmentation, can allow improved delineation of tumor region while reducing false positives arising in normal areas of the brain. The GrowCut method, employed for tumor segmentation, typically requires a foreground and background seed region for initialization. Here the algorithm is initialized with seeds automatically generated from the output of the proposed CADe system, thereby resulting in improved performance as compared to that using random seeds. △ Less

Submitted 20 June, 2018; originally announced June 2018.

Comments: The paper consists of 11 Pages, 6 Figures, 7 Tables, 56 References

Pushing for higher rates and efficiency in Satcom: the different perspectives within SatNExIV

Authors: Miguel Ángel Vázquez, Ana Pérez-Neira, Carlos Mosquera, Bhavanni Shankar, Pol Henarejos, Athanasios D. Panagopoulos, Giovanni Giambere, Vasilios Siris, George Polyzos, Nader Alagha

Abstract: SatNEx IV project aims at studying medium and long term directions of satellite telecommunication systems for any of the commercial or institutional applications that can be considered appealing by key players although still not mature enough for attracting industry or initiating dedicated ESA R&D activities. This paper summarizes the first year activities identified as very promising techniques f… ▽ More SatNEx IV project aims at studying medium and long term directions of satellite telecommunication systems for any of the commercial or institutional applications that can be considered appealing by key players although still not mature enough for attracting industry or initiating dedicated ESA R&D activities. This paper summarizes the first year activities identified as very promising techniques for next generation satellite communication systems. Concretely, very high throughput satellite trunking, physical layer advances for full-duplex and multipolarization systems, network coding applications and multiple access schemes for information centric networking are briefly presented. For all the activities, we identify the scenarios under study so as the preliminary technical solutions to be further investigated. △ Less

Submitted 20 March, 2018; originally announced March 2018.

Signal Processing for High Throughput Satellite Systems: Challenges in New Interference-Limited Scenarios

Authors: Ana I. Perez-Neira, Miguel Angel Vazquez, Sina Maleki, M. R. Bhavani Shankar, Symeon Chatzinotas

Abstract: The field of satellite communications is enjoying a renewed interest in the global telecom market, and very high throughput satellites (V/HTS), with their multiple spot-beams, are key for delivering the future rate demands. In this article, the state-of-the-art and open research challenges of signal processing techniques for V/HTS systems are presented for the first time, with focus on novel appro… ▽ More The field of satellite communications is enjoying a renewed interest in the global telecom market, and very high throughput satellites (V/HTS), with their multiple spot-beams, are key for delivering the future rate demands. In this article, the state-of-the-art and open research challenges of signal processing techniques for V/HTS systems are presented for the first time, with focus on novel approaches for efficient interference mitigation. The main signal processing topics for the ground, satellite, and user segment are addressed. Also, the critical components for the integration of satellite and terrestrial networks are studied, such as cognitive satellite systems and satellite-terrestrial backhaul for caching. All the reviewed techniques are essential in empowering satellite systems to support the increasing demands of the upcoming generation of communication networks. △ Less

Submitted 12 February, 2018; originally announced February 2018.