-
Strategies for Increasing Corporate Responsible AI Prioritization
Authors:
Angelina Wang,
Teresa Datta,
John P. Dickerson
Abstract:
Responsible artificial intelligence (RAI) is increasingly recognized as a critical concern. However, the level of corporate RAI prioritization has not kept pace. In this work, we conduct 16 semi-structured interviews with practitioners to investigate what has historically motivated companies to increase the prioritization of RAI. What emerges is a complex story of conflicting and varied factors, b…
▽ More
Responsible artificial intelligence (RAI) is increasingly recognized as a critical concern. However, the level of corporate RAI prioritization has not kept pace. In this work, we conduct 16 semi-structured interviews with practitioners to investigate what has historically motivated companies to increase the prioritization of RAI. What emerges is a complex story of conflicting and varied factors, but we bring structure to the narrative by highlighting the different strategies available to employ, and point to the actors with access to each. While there are no guaranteed steps for increasing RAI prioritization, we paint the current landscape of motivators so that practitioners can learn from each other, and put forth our own selection of promising directions forward.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
Who's Thinking? A Push for Human-Centered Evaluation of LLMs using the XAI Playbook
Authors:
Teresa Datta,
John P. Dickerson
Abstract:
Deployed artificial intelligence (AI) often impacts humans, and there is no one-size-fits-all metric to evaluate these tools. Human-centered evaluation of AI-based systems combines quantitative and qualitative analysis and human input. It has been explored to some depth in the explainable AI (XAI) and human-computer interaction (HCI) communities. Gaps remain, but the basic understanding that human…
▽ More
Deployed artificial intelligence (AI) often impacts humans, and there is no one-size-fits-all metric to evaluate these tools. Human-centered evaluation of AI-based systems combines quantitative and qualitative analysis and human input. It has been explored to some depth in the explainable AI (XAI) and human-computer interaction (HCI) communities. Gaps remain, but the basic understanding that humans interact with AI and accompanying explanations, and that humans' needs -- complete with their cognitive biases and quirks -- should be held front and center, is accepted by the community. In this paper, we draw parallels between the relatively mature field of XAI and the rapidly evolving research boom around large language models (LLMs). Accepted evaluative metrics for LLMs are not human-centered. We argue that many of the same paths tread by the XAI community over the past decade will be retread when discussing LLMs. Specifically, we argue that humans' tendencies -- again, complete with their cognitive biases and quirks -- should rest front and center when evaluating deployed LLMs. We outline three developed focus areas of human-centered evaluation of XAI: mental models, use case utility, and cognitive engagement, and we highlight the importance of exploring each of these concepts for LLMs. Our goal is to jumpstart human-centered LLM evaluation.
△ Less
Submitted 10 March, 2023;
originally announced March 2023.
-
Tensions Between the Proxies of Human Values in AI
Authors:
Teresa Datta,
Daniel Nissani,
Max Cembalest,
Akash Khanna,
Haley Massa,
John P. Dickerson
Abstract:
Motivated by mitigating potentially harmful impacts of technologies, the AI community has formulated and accepted mathematical definitions for certain pillars of accountability: e.g. privacy, fairness, and model transparency. Yet, we argue this is fundamentally misguided because these definitions are imperfect, siloed constructions of the human values they hope to proxy, while giving the guise tha…
▽ More
Motivated by mitigating potentially harmful impacts of technologies, the AI community has formulated and accepted mathematical definitions for certain pillars of accountability: e.g. privacy, fairness, and model transparency. Yet, we argue this is fundamentally misguided because these definitions are imperfect, siloed constructions of the human values they hope to proxy, while giving the guise that those values are sufficiently embedded in our technologies. Under popularized methods, tensions arise when practitioners attempt to achieve each pillar of fairness, privacy, and transparency in isolation or simultaneously. In this position paper, we push for redirection. We argue that the AI community needs to consider all the consequences of choosing certain formulations of these pillars -- not just the technical incompatibilities, but also the effects within the context of deployment. We point towards sociotechnical research for frameworks for the latter, but push for broader efforts into implementing these in practice.
△ Less
Submitted 14 December, 2022;
originally announced December 2022.
-
Probabilistically Robust Recourse: Navigating the Trade-offs between Costs and Robustness in Algorithmic Recourse
Authors:
Martin Pawelczyk,
Teresa Datta,
Johannes van-den-Heuvel,
Gjergji Kasneci,
Himabindu Lakkaraju
Abstract:
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means for recourse. While several approaches have been proposed to construct recourses for affected individuals, the recourses output by…
▽ More
As machine learning models are increasingly being employed to make consequential decisions in real-world settings, it becomes critical to ensure that individuals who are adversely impacted (e.g., loan denied) by the predictions of these models are provided with a means for recourse. While several approaches have been proposed to construct recourses for affected individuals, the recourses output by these methods either achieve low costs (i.e., ease-of-implementation) or robustness to small perturbations (i.e., noisy implementations of recourses), but not both due to the inherent trade-offs between the recourse costs and robustness. Furthermore, prior approaches do not provide end users with any agency over navigating the aforementioned trade-offs. In this work, we address the above challenges by proposing the first algorithmic framework which enables users to effectively manage the recourse cost vs. robustness trade-offs. More specifically, our framework Probabilistically ROBust rEcourse (\texttt{PROBE}) lets users choose the probability with which a recourse could get invalidated (recourse invalidation rate) if small changes are made to the recourse i.e., the recourse is implemented somewhat noisily. To this end, we propose a novel objective function which simultaneously minimizes the gap between the achieved (resulting) and desired recourse invalidation rates, minimizes recourse costs, and also ensures that the resulting recourse achieves a positive model prediction. We develop novel theoretical results to characterize the recourse invalidation rates corresponding to any given instance w.r.t. different classes of underlying models (e.g., linear models, tree based models etc.), and leverage these results to efficiently optimize the proposed objective. Experimental evaluation with multiple real world datasets demonstrates the efficacy of the proposed framework.
△ Less
Submitted 11 October, 2023; v1 submitted 13 March, 2022;
originally announced March 2022.
-
An experimental demonstration of the memristor test
Authors:
Y. V. Pershin,
J. Kim,
T. Datta,
M. Di Ventra
Abstract:
A simple and unambiguous test has been recently suggested [J. Phys. D: Applied Physics, 52, 01LT01 (2018)] to check experimentally if a resistor with memory is indeed a memristor, namely a resistor whose resistance depends only on the charge that flows through it, or on the history of the voltage across it. However, although such a test would represent the litmus test for claims about memristors (…
▽ More
A simple and unambiguous test has been recently suggested [J. Phys. D: Applied Physics, 52, 01LT01 (2018)] to check experimentally if a resistor with memory is indeed a memristor, namely a resistor whose resistance depends only on the charge that flows through it, or on the history of the voltage across it. However, although such a test would represent the litmus test for claims about memristors (in the ideal sense), it has yet to be applied widely to actual physical devices. In this paper, we experimentally apply it to a current-carrying wire interacting with a magnetic core, which was recently claimed to be a memristor (so-called `$Φ$ memristor') [J. Appl. Phys. 125, 054504 (2019)]. The results of our experiment demonstrate unambiguously that this `$Φ$ memristor' is not a memristor: it is simply an inductor with memory. This demonstration casts further doubts that ideal memristors do actually exist in nature or may be easily created in the lab.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
An experimental proof that resistance-switching memories are not memristors
Authors:
J. Kim,
Y. V. Pershin,
M. Yin,
T. Datta,
M. Di Ventra
Abstract:
It has been suggested that all resistive-switching memory cells are memristors. The latter are hypothetical, ideal devices whose resistance, as originally formulated, depends only on the net charge that traverses them. Recently, an unambiguous test has been proposed [J. Phys. D: Appl. Phys. {\bf 52}, 01LT01 (2019)] to determine whether a given physical system is indeed a memristor or not. Here, we…
▽ More
It has been suggested that all resistive-switching memory cells are memristors. The latter are hypothetical, ideal devices whose resistance, as originally formulated, depends only on the net charge that traverses them. Recently, an unambiguous test has been proposed [J. Phys. D: Appl. Phys. {\bf 52}, 01LT01 (2019)] to determine whether a given physical system is indeed a memristor or not. Here, we experimentally apply such a test to both in-house fabricated Cu-SiO2 and commercially available electrochemical metallization cells. Our results unambiguously show that electrochemical metallization memory cells are not memristors. Since the particular resistance-switching memories employed in our study share similar features with many other memory cells, our findings refute the claim that all resistance-switching memories are memristors. They also cast doubts on the existence of ideal memristors as actual physical devices that can be fabricated experimentally. Our results then lead us to formulate two memristor impossibility conjectures regarding the impossibility of building a model of physical resistance-switching memories based on the memristor model.
△ Less
Submitted 24 March, 2020; v1 submitted 16 September, 2019;
originally announced September 2019.
-
A Developer-Friendly Library for Smart Home IoT Privacy-Preserving Traffic Obfuscation
Authors:
Trisha Datta,
Noah Apthorpe,
Nick Feamster
Abstract:
The number and variety of Internet-connected devices have grown enormously in the past few years, presenting new challenges to security and privacy. Research has shown that network adversaries can use traffic rate metadata from consumer IoT devices to infer sensitive user activities. Shaping traffic flows to fit distributions independent of user activities can protect privacy, but this approach ha…
▽ More
The number and variety of Internet-connected devices have grown enormously in the past few years, presenting new challenges to security and privacy. Research has shown that network adversaries can use traffic rate metadata from consumer IoT devices to infer sensitive user activities. Shaping traffic flows to fit distributions independent of user activities can protect privacy, but this approach has seen little adoption due to required developer effort and overhead bandwidth costs. Here, we present a Python library for IoT developers to easily integrate privacy-preserving traffic shaping into their products. The library replaces standard networking functions with versions that automatically obfuscate device traffic patterns through a combination of payload padding, fragmentation, and randomized cover traffic. Our library successfully preserves user privacy and requires approximately 4 KB/s overhead bandwidth for IoT devices with low send rates or high latency tolerances. This overhead is reasonable given normal Internet speeds in American homes and is an improvement on the bandwidth requirements of existing solutions.
△ Less
Submitted 22 August, 2018;
originally announced August 2018.
-
Generalized Space and Frequency Index Modulation
Authors:
T. Datta,
H. S. Eshwaraiah,
A. Chockalingam
Abstract:
Unlike in conventional modulation where information bits are conveyed only through symbols from modulation alphabets defined in the complex plane (e.g., quadrature amplitude modulation (QAM), phase shift keying (PSK)), in index modulation (IM), additional information bits are conveyed through indices of certain transmit entities that get involved in the transmission. Transmit antennas in multi-ant…
▽ More
Unlike in conventional modulation where information bits are conveyed only through symbols from modulation alphabets defined in the complex plane (e.g., quadrature amplitude modulation (QAM), phase shift keying (PSK)), in index modulation (IM), additional information bits are conveyed through indices of certain transmit entities that get involved in the transmission. Transmit antennas in multi-antenna systems and subcarriers in multi-carrier systems are examples of such transmit entities that can be used to convey additional information bits through indexing. In this paper, we introduce {\em generalized space and frequency index modulation}, where the indices of active transmit antennas and subcarriers convey information bits. We first introduce index modulation in the spatial domain, referred to as generalized spatial index modulation (GSIM). For GSIM, where bits are indexed only in the spatial domain, we derive the expression for achievable rate as well as easy-to-compute upper and lower bounds on this rate. We show that the achievable rate in GSIM can be more than that in spatial multiplexing, and analytically establish the condition under which this can happen. It is noted that GSIM achieves this higher rate using fewer transmit radio frequency (RF) chains compared to spatial multiplexing. We also propose a Gibbs sampling based detection algorithm for GSIM and show that GSIM can achieve better bit error rate (BER) performance than spatial multiplexing. For generalized space-frequency index modulation (GSFIM), where bits are encoded through indexing in both active antennas as well as subcarriers, we derive the achievable rate expression. Numerical results show that GSFIM can achieve higher rates compared to conventional MIMO-OFDM. Also, BER results show the potential for GSFIM performing better than MIMO-OFDM.
△ Less
Submitted 27 June, 2015;
originally announced June 2015.
-
Pseudo-random Phase Precoded Spatial Modulation
Authors:
T. Lakshmi Narasimhan,
Yalagala Naresh,
Tanumay Datta,
A. Chockalingam
Abstract:
Spatial modulation (SM) is a transmission scheme that uses multiple transmit antennas but only one transmit RF chain. At each time instant, only one among the transmit antennas will be active and the others remain silent. The index of the active transmit antenna will also convey information bits in addition to the information bits conveyed through modulation symbols (e.g.,QAM). Pseudo-random phase…
▽ More
Spatial modulation (SM) is a transmission scheme that uses multiple transmit antennas but only one transmit RF chain. At each time instant, only one among the transmit antennas will be active and the others remain silent. The index of the active transmit antenna will also convey information bits in addition to the information bits conveyed through modulation symbols (e.g.,QAM). Pseudo-random phase precoding (PRPP) is a technique that can achieve high diversity orders even in single antenna systems without the need for channel state information at the transmitter (CSIT) and transmit power control (TPC). In this paper, we exploit the advantages of both SM and PRPP simultaneously. We propose a pseudo-random phase precoded SM (PRPP-SM) scheme, where both the modulation bits and the antenna index bits are precoded by pseudo-random phases. The proposed PRPP-SM system gives significant performance gains over SM system without PRPP and PRPP system without SM. Since maximum likelihood (ML) detection becomes exponentially complex in large dimensions, we propose low complexity local search based detection (LSD) algorithm suited for PRPP-SM systems with large precoder sizes. Our simulation results show that with 4 transmit antennas, 1 receive antenna, $5\times 20$ pseudo-random phase precoder matrix and BPSK modulation, the performance of PRPP-SM using ML detection is better than SM without PRPP with ML detection by about 9 dB at $10^{-2}$ BER. This performance advantage gets even better for large precoding sizes.
△ Less
Submitted 25 January, 2014;
originally announced January 2014.
-
A Novel MCMC Based Receiver for Large-Scale Uplink Multiuser MIMO Systems
Authors:
Tanumay Datta,
N. Ashok Kumar,
A. Chockalingam,
B. Sundar Rajan
Abstract:
In this paper, we propose low complexity algorithms based on Markov chain Monte Carlo (MCMC) technique for signal detection and channel estimation on the uplink in large scale multiuser multiple input multiple output (MIMO) systems with tens to hundreds of antennas at the base station (BS) and similar number of uplink users. A BS receiver that employs a randomized sampling method (which makes a pr…
▽ More
In this paper, we propose low complexity algorithms based on Markov chain Monte Carlo (MCMC) technique for signal detection and channel estimation on the uplink in large scale multiuser multiple input multiple output (MIMO) systems with tens to hundreds of antennas at the base station (BS) and similar number of uplink users. A BS receiver that employs a randomized sampling method (which makes a probabilistic choice between Gibbs sampling and random sampling in each iteration) for detection and a Gibbs sampling based method for channel estimation is proposed. The algorithm proposed for detection alleviates the stalling problem encountered at high SNRs in conventional MCMC algorithm and achieves near-optimal performance in large systems. A novel ingredient in the detection algorithm that is responsible for achieving near-optimal performance at low complexities is the joint use of a {\it randomized MCMC (R-MCMC) strategy} coupled with a {\it multiple restart strategy} with an efficient restart criterion. Near-optimal detection performance is demonstrated for large number of BS antennas and users (e.g., 64, 128, 256 BS antennas/users). The proposed MCMC based channel estimation algorithm refines an initial estimate of the channel obtained during pilot phase through iterations with R-MCMC detection during data phase. In time division duplex (TDD) systems where channel reciprocity holds, these channel estimates can be used for multiuser MIMO precoding on the downlink. Further, we employ this receiver architecture in the frequency domain for receiving cyclic prefixed single carrier (CPSC) signals on frequency selective fading between users and the BS. The proposed receiver achieves performance that is near optimal and close to that achieved with perfect channel knowledge.
△ Less
Submitted 29 January, 2012;
originally announced January 2012.
-
Low-Complexity Detection/Equalization in Large-Dimension MIMO-ISI Channels Using Graphical Models
Authors:
Pritam Som,
Tanumay Datta,
N. Srinidhi,
A. Chockalingam,
B. Sundar Rajan
Abstract:
In this paper, we deal with low-complexity near-optimal detection/equalization in large-dimension multiple-input multiple-output inter-symbol interference (MIMO-ISI) channels using message passing on graphical models. A key contribution in the paper is the demonstration that near-optimal performance in MIMO-ISI channels with large dimensions can be achieved at low complexities through simple yet e…
▽ More
In this paper, we deal with low-complexity near-optimal detection/equalization in large-dimension multiple-input multiple-output inter-symbol interference (MIMO-ISI) channels using message passing on graphical models. A key contribution in the paper is the demonstration that near-optimal performance in MIMO-ISI channels with large dimensions can be achieved at low complexities through simple yet effective simplifications/approximations, although the graphical models that represent MIMO-ISI channels are fully/densely connected (loopy graphs). These include 1) use of Markov Random Field (MRF) based graphical model with pairwise interaction, in conjunction with {\em message/belief damping}, and 2) use of Factor Graph (FG) based graphical model with {\em Gaussian approximation of interference} (GAI). The per-symbol complexities are $O(K^2n_t^2)$ and $O(Kn_t)$ for the MRF and the FG with GAI approaches, respectively, where $K$ and $n_t$ denote the number of channel uses per frame, and number of transmit antennas, respectively. These low-complexities are quite attractive for large dimensions, i.e., for large $Kn_t$. From a performance perspective, these algorithms are even more interesting in large-dimensions since they achieve increasingly closer to optimum detection performance for increasing $Kn_t$. Also, we show that these message passing algorithms can be used in an iterative manner with local neighborhood search algorithms to improve the reliability/performance of $M$-QAM symbol detection.
△ Less
Submitted 22 January, 2011;
originally announced January 2011.
-
A Hybrid RTS-BP Algorithm for Improved Detection of Large-MIMO M-QAM Signals
Authors:
Tanumay Datta,
N. Srinidhi,
A. Chockalingam,
B. Sundar Rajan
Abstract:
Low-complexity near-optimal detection of large-MIMO signals has attracted recent research. Recently, we proposed a local neighborhood search algorithm, namely `reactive tabu search' (RTS) algorithm, as well as a factor-graph based `belief propagation' (BP) algorithm for low-complexity large-MIMO detection. The motivation for the present work arises from the following two observations on the abov…
▽ More
Low-complexity near-optimal detection of large-MIMO signals has attracted recent research. Recently, we proposed a local neighborhood search algorithm, namely `reactive tabu search' (RTS) algorithm, as well as a factor-graph based `belief propagation' (BP) algorithm for low-complexity large-MIMO detection. The motivation for the present work arises from the following two observations on the above two algorithms: $i)$ RTS works for general M-QAM. Although RTS was shown to achieve close to optimal performance for 4-QAM in large dimensions, significant performance improvement was still possible for higher-order QAM (e.g., 16- and 64-QAM). ii) BP also was shown to achieve near-optimal performance for large dimensions, but only for $\{\pm 1\}$ alphabet. In this paper, we improve the large-MIMO detection performance of higher-order QAM signals by using a hybrid algorithm that employs RTS and BP. In particular, motivated by the observation that when a detection error occurs at the RTS output, the least significant bits (LSB) of the symbols are mostly in error, we propose to first reconstruct and cancel the interference due to bits other than LSBs at the RTS output and feed the interference cancelled received signal to the BP algorithm to improve the reliability of the LSBs. The output of the BP is then fed back to RTS for the next iteration. Our simulation results show that in a 32 x 32 V-BLAST system, the proposed RTS-BP algorithm performs better than RTS by about 3.5 dB at $10^{-3}$ uncoded BER and by about 2.5 dB at $3\times 10^{-4}$ rate-3/4 turbo coded BER with 64-QAM at the same order of complexity as RTS. We also illustrate the performance of large-MIMO detection in frequency-selective fading channels.
△ Less
Submitted 14 January, 2010;
originally announced January 2010.
