Skip to main content

Showing 1–18 of 18 results for author: Kapoor, P

  1. arXiv:2406.17066  [pdf, other

    eess.SY cs.AI cs.LO cs.RO

    Tolerance of Reinforcement Learning Controllers against Deviations in Cyber Physical Systems

    Authors: Changjian Zhang, Parv Kapoor, Eunsuk Kang, Romulo Meira-Goes, David Garlan, Akila Ganlath, Shatadal Mishra, Nejib Ammar

    Abstract: Cyber-physical systems (CPS) with reinforcement learning (RL)-based controllers are increasingly being deployed in complex physical environments such as autonomous vehicles, the Internet-of-Things(IoT), and smart cities. An important property of a CPS is tolerance; i.e., its ability to function safely under possible disturbances and uncertainties in the actual operation. In this paper, we introduc… ▽ More

    Submitted 24 June, 2024; originally announced June 2024.

    Comments: arXiv admin note: text overlap with arXiv:2311.07462

  2. arXiv:2403.10554  [pdf, other

    eess.SY cs.LO cs.RO

    Safe Planning through Incremental Decomposition of Signal Temporal Logic Specifications

    Authors: Parv Kapoor, Eunsuk Kang, Romulo Meira-Goes

    Abstract: Trajectory planning is a critical process that enables autonomous systems to safely navigate complex environments. Signal temporal logic (STL) specifications are an effective way to encode complex temporally extended objectives for trajectory planning in cyber-physical systems (CPS). However, planning from these specifications using existing techniques scale exponentially with the number of nested… ▽ More

    Submitted 18 March, 2024; v1 submitted 13 March, 2024; originally announced March 2024.

    Comments: Accepted to Nasa Formal Methods (NFM) 2024

  3. arXiv:2311.07462  [pdf, other

    eess.SY cs.LO cs.SE

    Investigating Robustness in Cyber-Physical Systems: Specification-Centric Analysis in the face of System Deviations

    Authors: Changjian Zhang, Parv Kapoor, Romulo Meira-Goes, David Garlan, Eunsuk Kang, Akila Ganlath, Shatadal Mishra, Nejib Ammar

    Abstract: The adoption of cyber-physical systems (CPS) is on the rise in complex physical environments, encompassing domains such as autonomous vehicles, the Internet of Things (IoT), and smart cities. A critical attribute of CPS is robustness, denoting its capacity to operate safely despite potential disruptions and uncertainties in the operating environment. This paper proposes a novel specification-based… ▽ More

    Submitted 25 March, 2024; v1 submitted 13 November, 2023; originally announced November 2023.

    Comments: 12 pages

  4. arXiv:2310.18791  [pdf, other

    cs.RO cs.AI cs.HC eess.SY

    "Do it my way!": Impact of Customizations on Trust perceptions in Human-Robot Collaboration

    Authors: Parv Kapoor, Simon Chu, Angela Chen

    Abstract: Trust has been shown to be a key factor in effective human-robot collaboration. In the context of assistive robotics, the effect of trust factors on human experience is further pronounced. Personalization of assistive robots is an orthogonal factor positively correlated with robot adoption and user perceptions. In this work, we investigate the relationship between these factors through a within-su… ▽ More

    Submitted 28 October, 2023; originally announced October 2023.

    Comments: 8 pages including references

  5. arXiv:2310.16299  [pdf, other

    cs.RO

    FoundLoc: Vision-based Onboard Aerial Localization in the Wild

    Authors: Yao He, Ivan Cisneros, Nikhil Keetha, Jay Patrikar, Zelin Ye, Ian Higgins, Yaoyu Hu, Parv Kapoor, Sebastian Scherer

    Abstract: Robust and accurate localization for Unmanned Aerial Vehicles (UAVs) is an essential capability to achieve autonomous, long-range flights. Current methods either rely heavily on GNSS, face limitations in visual-based localization due to appearance variances and stylistic dissimilarities between camera and reference imagery, or operate under the assumption of a known initial pose. In this paper, we… ▽ More

    Submitted 24 October, 2023; originally announced October 2023.

  6. arXiv:2211.06932  [pdf, other

    cs.RO

    Challenges in Close-Proximity Safe and Seamless Operation of Manned and Unmanned Aircraft in Shared Airspace

    Authors: Jay Patrikar, Joao P. A. Dantas, Sourish Ghosh, Parv Kapoor, Ian Higgins, Jasmine J. Aloor, Ingrid Navarro, Jimin Sun, Ben Stoler, Milad Hamidi, Rohan Baijal, Brady Moon, Jean Oh, Sebastian Scherer

    Abstract: We propose developing an integrated system to keep autonomous unmanned aircraft safely separated and behave as expected in conjunction with manned traffic. The main goal is to achieve safe manned-unmanned vehicle teaming to improve system performance, have each (robot/human) teammate learn from each other in various aircraft operations, and reduce the manning needs of manned aircraft. The proposed… ▽ More

    Submitted 13 November, 2022; originally announced November 2022.

  7. arXiv:2209.13737  [pdf, other

    cs.RO

    Follow The Rules: Online Signal Temporal Logic Tree Search for Guided Imitation Learning in Stochastic Domains

    Authors: Jasmine Jerry Aloor, Jay Patrikar, Parv Kapoor, Jean Oh, Sebastian Scherer

    Abstract: Seamlessly integrating rules in Learning-from-Demonstrations (LfD) policies is a critical requirement to enable the real-world deployment of AI agents. Recently, Signal Temporal Logic (STL) has been shown to be an effective language for encoding rules as spatio-temporal constraints. This work uses Monte Carlo Tree Search (MCTS) as a means of integrating STL specification into a vanilla LfD policy… ▽ More

    Submitted 6 March, 2023; v1 submitted 27 September, 2022; originally announced September 2022.

    Comments: Accepted for publication at IEEE International Conference on Robotics and Automation (ICRA) 2023, 7 pages

  8. arXiv:2106.12790  [pdf, other

    cs.CV

    Towards Automatic Speech to Sign Language Generation

    Authors: Parul Kapoor, Rudrabha Mukhopadhyay, Sindhu B Hegde, Vinay Namboodiri, C V Jawahar

    Abstract: We aim to solve the highly challenging task of generating continuous sign language videos solely from speech segments for the first time. Recent efforts in this space have focused on generating such videos from human-annotated text transcripts without considering other modalities. However, replacing speech with sign language proves to be a practical solution while communicating with people sufferi… ▽ More

    Submitted 24 June, 2021; originally announced June 2021.

    Comments: 5 pages(including references), 5 figures, Accepted in Interspeech 2021

  9. arXiv:2103.03394  [pdf, other

    cs.CV cs.CG cs.RO

    Point Cloud based Hierarchical Deep Odometry Estimation

    Authors: Farzan Erlik Nowruzi, Dhanvin Kolhatkar, Prince Kapoor, Robert Laganiere

    Abstract: Processing point clouds using deep neural networks is still a challenging task. Most existing models focus on object detection and registration with deep neural networks using point clouds. In this paper, we propose a deep model that learns to estimate odometry in driving scenarios using point cloud data. The proposed model consumes raw point clouds in order to extract frame-to-frame odometry esti… ▽ More

    Submitted 4 March, 2021; originally announced March 2021.

  10. arXiv:2103.03387  [pdf, other

    cs.CV

    PolarNet: Accelerated Deep Open Space Segmentation Using Automotive Radar in Polar Domain

    Authors: Farzan Erlik Nowruzi, Dhanvin Kolhatkar, Prince Kapoor, Elnaz Jahani Heravi, Fahed Al Hassanat, Robert Laganiere, Julien Rebut, Waqas Malik

    Abstract: Camera and Lidar processing have been revolutionized with the rapid development of deep learning model architectures. Automotive radar is one of the crucial elements of automated driver assistance and autonomous driving systems. Radar still relies on traditional signal processing techniques, unlike camera and Lidar based methods. We believe this is the missing link to achieve the most robust perce… ▽ More

    Submitted 4 March, 2021; originally announced March 2021.

  11. arXiv:2101.06371  [pdf, other

    cs.LG cs.AI cs.SE

    NNStreamer: Efficient and Agile Development of On-Device AI Systems

    Authors: MyungJoo Ham, Jijoong Moon, Geunsik Lim, Jaeyun Jung, Hyoungjoo Ahn, Wook Song, Sangjung Woo, Parichay Kapoor, Dongju Chae, Gichan Jang, Yongjoo Ahn, Jihoon Lee

    Abstract: We propose NNStreamer, a software system that handles neural networks as filters of stream pipelines, applying the stream processing paradigm to deep neural network applications. A new trend with the wide-spread of deep neural network applications is on-device AI. It is to process neural networks on mobile devices or edge/IoT devices instead of cloud servers. Emerging privacy issues, data transmis… ▽ More

    Submitted 15 January, 2021; originally announced January 2021.

    Comments: IEEE/ACM ICSE 2021 SEIP (preprint)

  12. arXiv:2011.04950  [pdf, other

    cs.RO cs.AI eess.SY

    Model-based Reinforcement Learning from Signal Temporal Logic Specifications

    Authors: Parv Kapoor, Anand Balakrishnan, Jyotirmoy V. Deshmukh

    Abstract: Techniques based on Reinforcement Learning (RL) are increasingly being used to design control policies for robotic systems. RL fundamentally relies on state-based reward functions to encode desired behavior of the robot and bad reward functions are prone to exploitation by the learning agent, leading to behavior that is undesirable in the best case and critically dangerous in the worst. On the oth… ▽ More

    Submitted 10 November, 2020; originally announced November 2020.

    Comments: Submitted to ICRA 2021

  13. arXiv:2004.03449  [pdf, other

    eess.SP cs.CV cs.LG

    Deep Open Space Segmentation using Automotive Radar

    Authors: Farzan Erlik Nowruzi, Dhanvin Kolhatkar, Prince Kapoor, Fahed Al Hassanat, Elnaz Jahani Heravi, Robert Laganiere, Julien Rebut, Waqas Malik

    Abstract: In this work, we propose the use of radar with advanced deep segmentation models to identify open space in parking scenarios. A publically available dataset of radar observations called SCORP was collected. Deep models are evaluated with various radar input representations. Our proposed approach achieves low memory usage and real-time processing speeds, and is thus very well suited for embedded de… ▽ More

    Submitted 18 March, 2020; originally announced April 2020.

    Comments: IEEE MTT-S International Conference on Microwaves for Intelligent Mobility (ICMIM 2020)

  14. arXiv:1907.07061  [pdf, other

    cs.CV

    How much real data do we actually need: Analyzing object detection performance using synthetic and real data

    Authors: Farzan Erlik Nowruzi, Prince Kapoor, Dhanvin Kolhatkar, Fahed Al Hassanat, Robert Laganiere, Julien Rebut

    Abstract: In recent years, deep learning models have resulted in a huge amount of progress in various areas, including computer vision. By nature, the supervised training of deep models requires a large amount of data to be available. This ideal case is usually not tractable as the data annotation is a tremendously exhausting and costly task to perform. An alternative is to use synthetic data. In this paper… ▽ More

    Submitted 16 July, 2019; originally announced July 2019.

    Comments: Accepted in International Conference on Machine Learning (ICML 2019) Workshop on AI for Autonomous Driving

  15. arXiv:1905.10138  [pdf, ps, other

    cs.LG stat.ML

    Structured Compression by Weight Encryption for Unstructured Pruning and Quantization

    Authors: Se Jung Kwon, Dongsoo Lee, Byeongwook Kim, Parichay Kapoor, Baeseong Park, Gu-Yeon Wei

    Abstract: Model compression techniques, such as pruning and quantization, are becoming increasingly important to reduce the memory footprints and the amount of computations. Despite model size reduction, achieving performance enhancement on devices is, however, still challenging mainly due to the irregular representations of sparse matrix formats. This paper proposes a new weight representation scheme for S… ▽ More

    Submitted 5 March, 2020; v1 submitted 24 May, 2019; originally announced May 2019.

  16. arXiv:1905.05686  [pdf, ps, other

    cs.LG stat.ML

    Network Pruning for Low-Rank Binary Indexing

    Authors: Dongsoo Lee, Se Jung Kwon, Byeongwook Kim, Parichay Kapoor, Gu-Yeon Wei

    Abstract: Pruning is an efficient model compression technique to remove redundancy in the connectivity of deep neural networks (DNNs). Computations using sparse matrices obtained by pruning parameters, however, exhibit vastly different parallelism depending on the index representation scheme. As a result, fine-grained pruning has not gained much attention due to its irregular index form leading to large mem… ▽ More

    Submitted 14 May, 2019; originally announced May 2019.

  17. arXiv:1810.12823  [pdf, ps, other

    cs.LG stat.ML

    DeepTwist: Learning Model Compression via Occasional Weight Distortion

    Authors: Dongsoo Lee, Parichay Kapoor, Byeongwook Kim

    Abstract: Model compression has been introduced to reduce the required hardware resources while maintaining the model accuracy. Lots of techniques for model compression, such as pruning, quantization, and low-rank approximation, have been suggested along with different inference implementation characteristics. Adopting model compression is, however, still challenging because the design complexity of model c… ▽ More

    Submitted 30 October, 2018; originally announced October 2018.

  18. arXiv:1702.00932  [pdf, ps, other

    cs.CV

    A method of limiting performance loss of CNNs in noisy environments

    Authors: James R. Geraci, Parichay Kapoor

    Abstract: Convolutional Neural Network (CNN) recognition rates drop in the presence of noise. We demonstrate a novel method of counteracting this drop in recognition rate by adjusting the biases of the neurons in the convolutional layers according to the noise conditions encountered at runtime. We compare our technique to training one network for all possible noise levels, dehazing via preprocessing a signa… ▽ More

    Submitted 3 February, 2017; originally announced February 2017.