-
Proceedings of AAAI 2022 Fall Symposium: The Role of AI in Responding to Climate Challenges
Authors:
Feras A. Batarseh,
Priya L. Donti,
Ján Drgoňa,
Kristen Fletcher,
Pierre-Adrien Hanania,
Melissa Hatton,
Srinivasan Keshav,
Bran Knowles,
Raphaela Kotsch,
Sean McGinnis,
Peetak Mitra,
Alex Philp,
Jim Spohrer,
Frank Stein,
Meghna Tare,
Svitlana Volkov,
Gege Wen
Abstract:
Climate change is one of the most pressing challenges of our time, requiring rapid action across society. As artificial intelligence tools (AI) are rapidly deployed, it is therefore crucial to understand how they will impact climate action. On the one hand, AI can support applications in climate change mitigation (reducing or preventing greenhouse gas emissions), adaptation (preparing for the effe…
▽ More
Climate change is one of the most pressing challenges of our time, requiring rapid action across society. As artificial intelligence tools (AI) are rapidly deployed, it is therefore crucial to understand how they will impact climate action. On the one hand, AI can support applications in climate change mitigation (reducing or preventing greenhouse gas emissions), adaptation (preparing for the effects of a changing climate), and climate science. These applications have implications in areas ranging as widely as energy, agriculture, and finance. At the same time, AI is used in many ways that hinder climate action (e.g., by accelerating the use of greenhouse gas-emitting fossil fuels). In addition, AI technologies have a carbon and energy footprint themselves. This symposium brought together participants from across academia, industry, government, and civil society to explore these intersections of AI with climate change, as well as how each of these sectors can contribute to solutions.
△ Less
Submitted 29 January, 2023; v1 submitted 27 December, 2022;
originally announced December 2022.
-
Humble Machines: Attending to the Underappreciated Costs of Misplaced Distrust
Authors:
Bran Knowles,
Jason D'Cruz,
John T. Richards,
Kush R. Varshney
Abstract:
It is curious that AI increasingly outperforms human decision makers, yet much of the public distrusts AI to make decisions affecting their lives. In this paper we explore a novel theory that may explain one reason for this. We propose that public distrust of AI is a moral consequence of designing systems that prioritize reduction of costs of false positives over less tangible costs of false negat…
▽ More
It is curious that AI increasingly outperforms human decision makers, yet much of the public distrusts AI to make decisions affecting their lives. In this paper we explore a novel theory that may explain one reason for this. We propose that public distrust of AI is a moral consequence of designing systems that prioritize reduction of costs of false positives over less tangible costs of false negatives. We show that such systems, which we characterize as 'distrustful', are more likely to miscategorize trustworthy individuals, with cascading consequences to both those individuals and the overall human-AI trust relationship. Ultimately, we argue that public distrust of AI stems from well-founded concern about the potential of being miscategorized. We propose that restoring public trust in AI will require that systems are designed to embody a stance of 'humble trust', whereby the moral costs of the misplaced distrust associated with false negatives is weighted appropriately during development and use.
△ Less
Submitted 2 August, 2022;
originally announced August 2022.
-
The Many Facets of Trust in AI: Formalizing the Relation Between Trust and Fairness, Accountability, and Transparency
Authors:
Bran Knowles,
John T. Richards,
Frens Kroeger
Abstract:
Efforts to promote fairness, accountability, and transparency are assumed to be critical in fostering Trust in AI (TAI), but extant literature is frustratingly vague regarding this 'trust'. The lack of exposition on trust itself suggests that trust is commonly understood, uncomplicated, or even uninteresting. But is it? Our analysis of TAI publications reveals numerous orientations which differ in…
▽ More
Efforts to promote fairness, accountability, and transparency are assumed to be critical in fostering Trust in AI (TAI), but extant literature is frustratingly vague regarding this 'trust'. The lack of exposition on trust itself suggests that trust is commonly understood, uncomplicated, or even uninteresting. But is it? Our analysis of TAI publications reveals numerous orientations which differ in terms of who is doing the trusting (agent), in what (object), on the basis of what (basis), in order to what (objective), and why (impact). We develop an ontology that encapsulates these key axes of difference to a) illuminate seeming inconsistencies across the literature and b) more effectively manage a dizzying number of TAI considerations. We then reflect this ontology through a corpus of publications exploring fairness, accountability, and transparency to examine the variety of ways that TAI is considered within and between these approaches to promoting trust.
△ Less
Submitted 1 August, 2022;
originally announced August 2022.
-
The Sanction of Authority: Promoting Public Trust in AI
Authors:
Bran Knowles,
John T. Richards
Abstract:
Trusted AI literature to date has focused on the trust needs of users who knowingly interact with discrete AIs. Conspicuously absent from the literature is a rigorous treatment of public trust in AI. We argue that public distrust of AI originates from the under-development of a regulatory ecosystem that would guarantee the trustworthiness of the AIs that pervade society. Drawing from structuration…
▽ More
Trusted AI literature to date has focused on the trust needs of users who knowingly interact with discrete AIs. Conspicuously absent from the literature is a rigorous treatment of public trust in AI. We argue that public distrust of AI originates from the under-development of a regulatory ecosystem that would guarantee the trustworthiness of the AIs that pervade society. Drawing from structuration theory and literature on institutional trust, we offer a model of public trust in AI that differs starkly from models driving Trusted AI efforts. This model provides a theoretical scaffolding for Trusted AI research which underscores the need to develop nothing less than a comprehensive and visibly functioning regulatory ecosystem. We elaborate the pivotal role of externally auditable AI documentation within this model and the work to be done to ensure it is effective, and outline a number of actions that would promote public trust in AI. We discuss how existing efforts to develop AI documentation within organizations -- both to inform potential adopters of AI components and support the deliberations of risk and ethics review boards -- is necessary but insufficient assurance of the trustworthiness of AI. We argue that being accountable to the public in ways that earn their trust, through elaborating rules for AI and developing resources for enforcing these rules, is what will ultimately make AI trustworthy enough to be woven into the fabric of our society.
△ Less
Submitted 22 January, 2021;
originally announced February 2021.
-
Proposed Approximate Dynamic Programming for Pathfinding under Visible Uncertainty
Authors:
Bryan A. Knowles,
Mustafa Atici
Abstract:
Continuing our preleminary work \cite{knowles14}, we define the safest-with-sight pathfinding problems and explore its solution using techniques borrowed from measure-theoretic probability theory. We find a simple recursive definition for the probability that an ideal pathfinder will select an edge in a given scenario of an uncertain network where edges have probabilities of failure and vertices p…
▽ More
Continuing our preleminary work \cite{knowles14}, we define the safest-with-sight pathfinding problems and explore its solution using techniques borrowed from measure-theoretic probability theory. We find a simple recursive definition for the probability that an ideal pathfinder will select an edge in a given scenario of an uncertain network where edges have probabilities of failure and vertices provide "vision" of edges via lines-of-sight. We propose an approximate solution based on our theoretical findings that would borrow techniques from approximate dynamic programming.
△ Less
Submitted 30 November, 2015;
originally announced December 2015.
-
Fault-Tolerant, but Paradoxical Path-Finding in Physical and Conceptual Systems
Authors:
Bryan Knowles,
Mustafa Atici
Abstract:
We report our initial investigations into reliability and path-finding based models and propose future areas of interest. Inspired by broken sidewalks during on-campus construction projects, we develop two models for navigating this "unreliable network." These are based on a concept of "accumulating risk" backward from the destination, and both operate on directed acyclic graphs with a probability…
▽ More
We report our initial investigations into reliability and path-finding based models and propose future areas of interest. Inspired by broken sidewalks during on-campus construction projects, we develop two models for navigating this "unreliable network." These are based on a concept of "accumulating risk" backward from the destination, and both operate on directed acyclic graphs with a probability of failure associated with each edge. The first serves to introduce and has faults addressed by the second, more conservative model. Next, we show a paradox when these models are used to construct polynomials on conceptual networks, such as design processes and software development life cycles. When the risk of a network increases uniformly, the most reliable path changes from wider and longer to shorter and narrower. If we let professional inexperience--such as with entry level cooks and software developers--represent probability of edge failure, does this change in path imply that the novice should follow instructions with fewer "back-up" plans, yet those with alternative routes should be followed by the expert?
△ Less
Submitted 9 June, 2014;
originally announced June 2014.
-
Sinkless: A Preliminary Study of Stress Propagation in Group Project Social Networks using a Variant of the Abelian Sandpile Model
Authors:
Bryan Knowles,
Rong Yang
Abstract:
We perform social network analysis on 53 students split over three semesters and 13 groups, using conventional measures like eigenvector centrality, betweeness centrality, and degree centrality, as well as defining a variant of the Abelian Sandpile Model (ASM) with the intention of modeling stress propagation in the college classroom. We correlate the results of these analyses with group project g…
▽ More
We perform social network analysis on 53 students split over three semesters and 13 groups, using conventional measures like eigenvector centrality, betweeness centrality, and degree centrality, as well as defining a variant of the Abelian Sandpile Model (ASM) with the intention of modeling stress propagation in the college classroom. We correlate the results of these analyses with group project grades received; due to a small or poorly collected dataset, we are unable to conclude that any of these network measures relates to those grades. However, we are successful in using this dataset to define a discrete, recursive, and more generalized variant of the ASM. Abelian Sandpile Model, College Grades, Self-organized Criticality, Sinkless Sandpile Model, Social Network Analysis, Stress Propagation
△ Less
Submitted 22 November, 2013;
originally announced November 2013.