Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Support

Alaa A. Abd-alrazaq, Mohannad Alajlani, Ali Abdallah Alalwan, Bridgette M. Bewick, Peter Gardner, and Mowafa Househ. 2019. An overview of the features of chatbots in mental health: A scoping review. International Journal of Medical Informatics 132 (Dec. 2019), 103978. https://doi.org/10.1016/j.ijmedinf.2019.103978

Alaa Ali Abd-Alrazaq, Asma Rababeh, Mohannad Alajlani, Bridgette M. Bewick, and Mowafa Househ. 2020. Effectiveness and Safety of Using Chatbots to Improve Mental Health: Systematic Review and Meta-Analysis. Journal of Medical Internet Research 22, 7 (July 2020), e16021. https://doi.org/10.2196/16021

Ali Alkhatib and Michael Bernstein. 2019. Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300760

Rebekah Amos, Eric Julian Manalastas, Ross White, Henny Bos, and Praveetha Patalay. 2020. Mental health, social adversity, and health-related outcomes in sexual minority adolescents: a contemporary national cohort study. The Lancet Child & Adolescent Health 4, 1 (Jan. 2020), 36–45. https://doi.org/10.1016/S2352-4642(19)30339-6

Gerhard Andersson and Nickolai Titov. 2014. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry 13, 1 (Feb. 2014), 4–11. https://doi.org/10.1002/wps.20083

Nancy R. Asplund and Ann M. Ordway. 2018. School Counseling Toward an LGBTQ-Inclusive School Climate: Implementing the SCEARE Model. Journal of LGBT Issues in Counseling 12, 1 (Jan. 2018), 17–31. https://doi.org/10.1080/15538605.2018.1421115

Vincenzo Auriemma, Gennaro Iorio, Geraldina Roberti, and Rosalba Morese. 2020. Cyberbullying and Empathy in the Age of Hyperconnection: An Interdisciplinary Approach. Frontiers in Sociology 5 (2020). https://doi.org/10.3389/fsoc.2020.551881

Emma Beede, Elizabeth Baylor, Fred Hersch, Anna Iurchenko, Lauren Wilcox, Paisan Ruamviboonsuk, and Laura M. Vardoulakis. 2020. A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1–12. https://doi.org/10.1145/3313831.3376718

Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency(FAccT ’21). Association for Computing Machinery, New York, NY, USA, 610–623. https://doi.org/10.1145/3442188.3445922

Robbert Jan Beun. 2013. Persuasive strategies in mobile insomnia therapy: alignment, adaptation, and motivational support. Personal and Ubiquitous Computing 17, 6 (Aug. 2013), 1187–1195. https://doi.org/10.1007/s00779-012-0586-2

Timothy W. Bickmore, Kathryn Puskar, Elizabeth A. Schlenk, Laura M. Pfeifer, and Susan M. Sereika. 2010. Maintaining reality: Relational agents for antipsychotic medication adherence. Interacting with Computers 22, 4 (2010), 276–288. https://doi.org/10.1016/j.intcom.2010.02.001

Ghazala Bilquise, Samar Ibrahim, and Khaled Shaalan. 2022. Emotionally Intelligent Chatbots: A Systematic Literature Review. Human Behavior and Emerging Technologies 2022 (Sept. 2022), 9601630. https://doi.org/10.1155/2022/9601630 Publisher: Hindawi.

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2022. On the Opportunities and Risks of Foundation Models. http://arxiv.org/abs/2108.07258 arXiv:2108.07258 [cs].

Eliane M. Boucher, Nicole R. Harake, Haley E. Ward, Sarah Elizabeth Stoeckl, Junielly Vargas, Jared Minkel, Acacia C. Parks, and Ran Zilca. 2021. Artificially intelligent chatbots in digital mental health interventions: a review. Expert Review of Medical Devices 18, sup1 (Dec. 2021), 37–49. https://doi.org/10.1080/17434440.2021.2013200

Danah M Boyd and Nicole B Ellison. 2007. Social network sites: Definition, history, and scholarship. Journal of computer-mediated Communication 13, 1 (2007), 210–230.

Alain Braillon and Françoise Taiebi. 2020. Practicing “Reflective listening” is a mandatory prerequisite for empathy. Patient Education and Counseling 103, 9 (Sept. 2020), 1866–1867. https://doi.org/10.1016/j.pec.2020.03.024

Philip Burnard. 1991. A method of analysing interview transcripts in qualitative research. Nurse Education Today 11, 6 (1991), 461–466. https://doi.org/10.1016/0260-6917(91)90009-Y

Pew Research Center. 2016. Reddit News Users More Likely to Be Male, Young, and Digital in Their News Preferences. https://www.pewresearch.org/journalism/2016/02/25/reddit-news-users-more-likely-to-be-male-young-and-digital-in-their-news-preferences/

Kirsty A Clark, John E Pachankis, Lea R Dougherty, Benjamin A Katz, Kaylin E Hill, Daniel N Klein, and Autumn Kujawa. 2023. Adolescents’ Sexual Orientation and Behavioral and Neural Reactivity to Peer Acceptance and Rejection: The Moderating Role of Family Support. Clinical Psychological Science (2023), 21677026231158574.

Robyn M. Cooper and Warren J. Blumenfeld. 2012. Responses to Cyberbullying: A Descriptive Analysis of the Frequency of and Impact on LGBT and Allied Youth. Journal of LGBT Youth 9, 2 (2012), 153–177. https://doi.org/10.1080/19361653.2011.649616 arXiv:https://doi.org/10.1080/19361653.2011.649616

Neil S Coulson, Richard Smedley, Sophie Bostock, Simon D Kyle, Rosie Gollancz, Annemarie I Luik, Peter Hames, and Colin A Espie. 2016. The Pros and Cons of Getting Engaged in an Online Social Community Embedded Within Digital Cognitive Behavioral Therapy for Insomnia: Survey Among Users. Journal of Medical Internet Research 18, 4 (April 2016), e88. https://doi.org/10.2196/jmir.5654

Nele Cox, Alexis Dewaele, Mieke van Houtte, and John Vincke. 2010. Stress-Related Growth, Coming Out, and Internalized Homonegativity in Lesbian, Gay, and Bisexual Youth. An Examination of Stress-Related Growth Within the Minority Stress Model. Journal of Homosexuality 58, 1 (Dec. 2010), 117–137. https://doi.org/10.1080/00918369.2011.533631

Shelley L. Craig and Lauren McInroy. 2014. You Can Form a Part of Yourself Online: The Influence of New Media on Identity Development and Coming Out for LGBTQ Youth. Journal of Gay & Lesbian Mental Health 18, 1 (Jan. 2014), 95–109. https://doi.org/10.1080/19359705.2013.777007

Alison Darcy, Aaron Beaudette, Emil Chiauzzi, Jade Daniels, Kim Goodwin, Timothy Y. Mariano, Paul Wicks, and Athena Robinson. 2022. Anatomy of a Woebot® (WB001): agent guided CBT for women with postpartum depression. Expert Review of Medical Devices 19, 4 (April 2022), 287–301. https://doi.org/10.1080/17434440.2022.2075726

Samantha DeHaan, Laura E Kuper, Joshua C Magee, Lou Bigelow, and Brian S Mustanski. 2013. The interplay between online and offline explorations of identity, relationships, and sex: A mixed-methods study with LGBT youth. Journal of sex research 50, 5 (2013), 421–434.

Aditya Deshpande, Alisha Shahane, Darshana Gadre, Mrunmayi Deshpande, and Prachi Manoj Joshi. 2017. A Survey of Various Chatbot Implementation Techniques. https://api.semanticscholar.org/CorpusID:212484172

Michael Ann DeVito, Ashley Marie Walker, and Julia R. Fernandez. 2021. Values (Mis)Alignment: Exploring Tensions Between Platform and LGBTQ+ Community Design Values. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 88 (apr 2021), 27 pages. https://doi.org/10.1145/3449162

Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, Lei Li, and Zhifang Sui. 2023. A Survey on In-context Learning. arxiv:2301.00234 [cs.CL]

Jack Drescher and Matthew Fadus. 2020. Issues Arising in Psychotherapy With Lesbian, Gay, Bisexual, and Transgender Patients. FOCUS 18, 3 (July 2020), 262–267. https://doi.org/10.1176/appi.focus.20200001

Emily Durden, Maddison C. Pirner, Stephanie J. Rapoport, Andre Williams, Athena Robinson, and Valerie L. Forman-Hoffman. 2023. Changes in stress, burnout, and resilience associated with an 8-week intervention with relational agent “Woebot”. Internet Interventions 33 (2023), 100637. https://doi.org/10.1016/j.invent.2023.100637

Justin Edwards, Leigh Clark, and Allison Perrone. 2021. LGBTQ-AI? Exploring Expressions of Gender and Sexual Orientation in Chatbots. In Proceedings of the 3rd Conference on Conversational User Interfaces (Bilbao (online), Spain) (CUI ’21). Association for Computing Machinery, New York, NY, USA, Article 2, 4 pages. https://doi.org/10.1145/3469595.3469597

César G. Escobar-Viera, Sophia Choukas-Bradley, Jaime Sidani, Anne J. Maheux, Savannah R. Roberts, and Bruce L. Rollman. 2022. Examining Social Media Experiences and Attitudes Toward Technology-Based Interventions for Reducing Social Isolation Among LGBTQ Youth Living in Rural United States: An Online Qualitative Study. Frontiers in Digital Health 4 (June 2022), 900695. https://doi.org/10.3389/fdgth.2022.900695

Colin A. Espie, Peter Hames, and Brian McKinstry. 2013. Use of the Internet and Mobile Media for Delivery of Cognitive Behavioral Insomnia Therapy. Sleep Medicine Clinics 8, 3 (Sept. 2013), 407–419. https://doi.org/10.1016/j.jsmc.2013.06.001

Virginia K. Felkner, Ho-Chun Herbert Chang, Eugene Jang, and Jonathan May. 2023. WinoQueer: A Community-in-the-Loop Benchmark for Anti-LGBTQ+ Bias in Large Language Models. (2023). https://doi.org/10.48550/ARXIV.2306.15087 Publisher: arXiv Version Number: 1.

Amelia Fiske, Peter Henningsen, and Alena Buyx. 2019. Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy. Journal of Medical Internet Research 21, 5 (May 2019), e13216. https://doi.org/10.2196/13216

Pamela Fitzgerald and Ivan Leudar. 2010. On active listening in person-centred, solution-focused psychotherapy. Journal of Pragmatics 42, 12 (Dec. 2010), 3188–3198. https://doi.org/10.1016/j.pragma.2010.07.007

Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial. JMIR mental health 4, 2 (June 2017), e19. https://doi.org/10.2196/mental.7785

Jesse Fox and Rachel Ralston. 2016. Queer identity online: Informal learning and teaching experiences of LGBTQ individuals on social media. Computers in Human Behavior 65 (2016), 635–642. https://doi.org/10.1016/j.chb.2016.06.009

Russell Fulmer, Angela Joerin, Breanna Gentile, Lysanne Lakerink, and Michiel Rauws. 2018. Using Psychological Artificial Intelligence (Tess) to Relieve Symptoms of Depression and Anxiety: Randomized Controlled Trial. JMIR Mental Health 5, 4 (Dec. 2018), e64. https://doi.org/10.2196/mental.9782

Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé Iii, and Kate Crawford. 2021. Datasheets for datasets. Commun. ACM 64, 12 (Dec. 2021), 86–92. https://doi.org/10.1145/3458723

Samuel Gehman, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith. 2020. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models. (2020). https://doi.org/10.48550/ARXIV.2009.11462 Publisher: arXiv Version Number: 2.

Sarah Graham, Colin Depp, Ellen E. Lee, Camille Nebeker, Xin Tu, Ho-Cheol Kim, and Dilip V. Jeste. 2019. Artificial Intelligence for Mental Health and Mental Illnesses: an Overview. Current Psychiatry Reports 21, 11 (Nov. 2019), 116. https://doi.org/10.1007/s11920-019-1094-0

Oliver L. Haimson, Dykee Gorrell, Denny L. Starks, and Zu Weinger. 2020. Designing Trans Technology: Defining Challenges and Envisioning Community-Centered Solutions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376669

Jean Hardy and Silvia Lindtner. 2017. Constructing a Desiring User: Discourse, Rurality, and Design in Location-Based Social Networks. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, Portland Oregon USA, 13–25. https://doi.org/10.1145/2998181.2998347

Yuhao He, Li Yang, Xiaokun Zhu, Bin Wu, Shuo Zhang, Chunlian Qian, and Tian Tian. 2022. Mental health chatbot for young adults with depressive symptoms during the COVID-19 pandemic: single-blind, three-arm randomized controlled trial. Journal of Medical Internet Research 24, 11 (2022), e40719.

Tanja Henkel, Annemiek Linn, and Margot Goot. 2023. Understanding the Intention to Use Mental Health Chatbots Among LGBTQIA+ Individuals: Testing and Extending the UTAUT. 83–100. https://doi.org/10.1007/978-3-031-25581-6_6

Gilbert Herdt. 1989. Introduction: Gay and lesbian youth, emergent identities, and cultural scenes at home and abroad.Journal of Homosexuality 17, 1-2 (1989), 1–42. https://doi.org/10.1300/J082v17n01_01 Place: US Publisher: Haworth Press.

Benjamin Mako Hill and Aaron Shaw. 2013. The Wikipedia Gender Gap Revisited: Characterizing Survey Response Bias with Propensity Score Estimation. PLoS ONE 8, 6 (June 2013), e65782. https://doi.org/10.1371/journal.pone.0065782

Angela N. Hilton and Dawn M. Szymanski. 2011. Family dynamics and changes in sibling of origin relationship after lesbian and gay sexual orientation disclosure.Contemporary Family Therapy: An International Journal 33, 3 (2011), 291–309. https://doi.org/10.1007/s10591-011-9157-3 Place: Germany Publisher: Springer.

Chris Hollis, Caroline J. Falconer, Jennifer L. Martin, Craig Whittington, Sarah Stockton, Cris Glazebrook, and E. Bethan Davies. 2017. Annual Research Review: Digital health interventions for children and young people with mental health problems - a systematic and meta-review. Journal of Child Psychology and Psychiatry 58, 4 (April 2017), 474–503. https://doi.org/10.1111/jcpp.12663

Minlie Huang, Xiaoyan Zhu, and Jianfeng Gao. 2020. Challenges in Building Intelligent Open-Domain Dialog Systems. ACM Trans. Inf. Syst. 38, 3, Article 21 (apr 2020), 32 pages. https://doi.org/10.1145/3383123

Jevan A. Hutson, Jessie G. Taft, Solon Barocas, and Karen Levy. 2018. Debiasing Desire: Addressing Bias & Discrimination on Intimate Platforms. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (Nov. 2018), 1–18. https://doi.org/10.1145/3274342

Madeleine Irish, Francesca Solmi, Becky Mars, Michael King, Glyn Lewis, Rebecca M Pearson, Alexandra Pitman, Sarah Rowe, Ramya Srinivasan, and Gemma Lewis. 2019. Depression and self-harm from adolescence to young adulthood in sexual minorities compared with heterosexuals in the UK: a population-based cohort study. The Lancet Child & Adolescent Health 3, 2 (Feb. 2019), 91–98. https://doi.org/10.1016/S2352-4642(18)30343-2

Maia Jacobs, Jeffrey He, Melanie F. Pradier, Barbara Lam, Andrew C. Ahn, Thomas H. McCoy, Roy H. Perlis, Finale Doshi-Velez, and Krzysztof Z. Gajos. 2021. Designing AI for Trust and Collaboration in Time-Constrained Medical Decisions: A Sociotechnical Lens. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Article 659, 14 pages. https://doi.org/10.1145/3411764.3445385

Rudolf Kadlec, Martin Schmid, and Jan Kleindienst. 2015. Improved Deep Learning Baselines for Ubuntu Corpus Dialogs. (2015). https://doi.org/10.48550/ARXIV.1510.03753 Publisher: arXiv Version Number: 2.

Enkelejda Kasneci, Kathrin Sessler, Stefan Küchemann, Maria Bannert, Daryna Dementieva, Frank Fischer, Urs Gasser, Georg Groh, Stephan Günnemann, Eyke Hüllermeier, Stephan Krusche, Gitta Kutyniok, Tilman Michaeli, Claudia Nerdel, Jürgen Pfeffer, Oleksandra Poquet, Michael Sailer, Albrecht Schmidt, Tina Seidel, Matthias Stadler, Jochen Weller, Jochen Kuhn, and Gjergji Kasneci. 2023. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences 103 (2023), 102274. https://doi.org/10.1016/j.lindif.2023.102274

Kate Kaye. 2022. Trevor Project uses OpenAI’s GPT for LBTGQ counselors. https://www.protocol.com/enterprise/lgbtq-trevor-suicide-gpt-google

Ahmet Baki Kocaballi, Shlomo Berkovsky, Juan C Quiroz, Liliana Laranjo, Huong Ly Tong, Dana Rezazadegan, Agustina Briatore, and Enrico Coiera. 2019. The Personalization of Conversational Agents in Health Care: Systematic Review. J Med Internet Res 21, 11 (7 Nov 2019), e15360. https://doi.org/10.2196/15360

Keita Kurita, Nidhi Vyas, Ayush Pareek, Alan W Black, and Yulia Tsvetkov. 2019. Measuring Bias in Contextualized Word Representations. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing. Association for Computational Linguistics, Florence, Italy, 166–172. https://doi.org/10.18653/v1/W19-3823

Liliana Laranjo, Adam G Dunn, Huong Ly Tong, Ahmet Baki Kocaballi, Jessica Chen, Rabia Bashir, Didi Surian, Blanca Gallego, Farah Magrabi, Annie Y S Lau, and Enrico Coiera. 2018. Conversational agents in healthcare: a systematic review. Journal of the American Medical Informatics Association : JAMIA 25, 9 (September 2018), 1248—1258. https://doi.org/10.1093/jamia/ocy072

Minhyeok Lee. 2023. A Mathematical Investigation of Hallucination and Creativity in GPT Models. Mathematics 11, 10 (May 2023), 2320. https://doi.org/10.3390/math11102320

Jiwei Li, Will Monroe, Alan Ritter, Dan Jurafsky, Michel Galley, and Jianfeng Gao. 2016. Deep Reinforcement Learning for Dialogue Generation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Austin, Texas, 1192–1202. https://doi.org/10.18653/v1/D16-1127

Calvin Liang, Jevan Alexander Hutson, and Os Keyes. 2020. Surveillance, stigma & sociotechnical design for HIV. First Monday (Sept. 2020). https://doi.org/10.5210/fm.v25i10.10274

Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Alexander Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew Arad Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue WANG, Keshav Santhanam, Laurel Orr, Lucia Zheng, Mert Yuksekgonul, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Andrew Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, and Yuta Koreeda. 2023. Holistic Evaluation of Language Models. Transactions on Machine Learning Research (2023). https://openreview.net/forum?id=iO4LZibEqW Featured Certification, Expert Certification.

Yuting Liao. 2021. Design and Evaluation of a Conversational Agent for Mental Health Support: Forming Human-Agent Sociotechnical and Therapeutic Relationships. Ph. D. Dissertation. University of Maryland, College Park.

Ryan Thomas Lowe, Nissan Pow, Iulian Serban, Laurent Charlin, Chia-Wei Liu, and Joelle Pineau. 2017. Training End-to-End Dialogue Systems with the Ubuntu Dialogue Corpus. Dialogue Discourse 8 (2017), 31–65. https://api.semanticscholar.org/CorpusID:13823999

Mathijs Lucassen, Rajvinder Samra, Ioanna Iacovides, Theresa Fleming, Matthew Shepherd, Karolina Stasiak, and Louise Wallace. 2018. How LGBT+ Young People Use the Internet in Relation to Their Mental Health and Envisage the Use of e-Therapy: Exploratory Study. JMIR serious games 6, 4 (Dec. 2018), e11249. https://doi.org/10.2196/11249

Zilin Ma and Krzysztof Z. Gajos. 2022. Not Just a Preference: Reducing Biased Decision-Making on Dating Websites. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (, New Orleans, LA, USA, ) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 203, 14 pages. https://doi.org/10.1145/3491102.3517587

Zilin Ma, Yiyang Mei, and Zhaoyuan Su. 2023. Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support. AMIA... Annual Symposium proceedings. AMIA Symposium 2023 (2023), 1105–1114.

Varoon Mathur, Caitlin Lustig, and Elizabeth Kaziunas. 2022. Disordering Datasets: Sociotechnical Misalignments in AI-Mediated Behavioral Health. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (Nov. 2022), 1–33. https://doi.org/10.1145/3555141

Elizabeth McDermott, Elizabeth Hughes, and Victoria Rawlings. 2018. The social determinants of lesbian, gay, bisexual and transgender youth suicidality in England: a mixed methods study. Journal of Public Health 40, 3 (Sept. 2018), e244–e251. https://doi.org/10.1093/ /fdx135

Elizabeth McDermott and Katrina Roen. 2016. Queer Youth, Suicide and Self-Harm. Palgrave Macmillan UK, London. https://doi.org/10.1057/9781137003454

Lauren B. McInroy, Shelley L. Craig, and Vivian W. Y. Leung. 2019. Platforms and Patterns for Practice: LGBTQ+ Youths’ Use of Information and Communication Technologies. Child and Adolescent Social Work Journal 36, 5 (Oct. 2019), 507–520. https://doi.org/10.1007/s10560-018-0577-x

Katelyn Y. A. McKenna and John A. Bargh. 1998. Coming out in the age of the Internet: Identity "demarginalization" through virtual group participation.Journal of Personality and Social Psychology 75, 3 (Sept. 1998), 681–694. https://doi.org/10.1037/0022-3514.75.3.681

Cade Metz. 2020. Riding out quarantine with a chatbot friend:‘I feel very connected’. The New York Times (2020).

Ilan H. Meyer. 1995. Minority Stress and Mental Health in Gay Men. Journal of Health and Social Behavior 36, 1 (March 1995), 38. https://doi.org/10.2307/2137286

Ilan H. Meyer. 2003. Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: conceptual issues and research evidence. Psychological Bulletin 129, 5 (Sept. 2003), 674–697. https://doi.org/10.1037/0033-2909.129.5.674

Nicolaas B Moolenijzer and Kristin Dew. 2023. “They Know That It Works Because We Are Looking for Ourselves” – LGBTQ+ TikTok Users’ Perceptions and Experiences of Queerbaiting. In Proceedings of the 25th International Conference on Mobile Human-Computer Interaction (Athens, Greece) (MobileHCI ’23 Companion). Association for Computing Machinery, New York, NY, USA, Article 20, 6 pages. https://doi.org/10.1145/3565066.3608705

N. Okujava, N. Malashkhia, S. Shagidze, A. Tsereteli, B. Arevadze, N. Chikhladze, A. de Weerd, and A. Van Straten. 2019. Digital cognitive behavioral therapy for insomnia – The first Georgian version. Can we use it in practice?Internet Interventions 17 (2019), 100244. https://doi.org/10.1016/j.invent.2019.100244

Elias Capello Oliver L. Haimson, Avery Dame-Griff and Zahari Richter. 2021. Tumblr was a trans technology: the meaning, importance, history, and future of trans technologies. Feminist Media Studies 21, 3 (2021), 345–361. https://doi.org/10.1080/14680777.2019.1678505 arXiv:https://doi.org/10.1080/14680777.2019.1678505

Joseph Ollier, Pavani Suryapalli, Elgar Fleisch, Florian von Wangenheim, Jacqueline Louise Mair, Alicia Salamanca-Sanabria, and Tobias Kowatsch. 2023. Can digital health researchers make a difference during the pandemic? Results of the single-arm, chatbot-led Elena+: Care for COVID-19 interventional study. Frontiers in Public Health 11 (2023).

Gabriele Pizzi, Virginia Vannucci, Valentina Mazzoli, and Raffaele Donvito. 2023. I, chatbot! the impact of anthropomorphism and gaze direction on willingness to disclose personal information and behavioral intentions. Psychology & Marketing 40, 7 (2023), 1372–1387. https://doi.org/10.1002/mar.21813 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/mar.21813

Francesca Polletta. 1998. Contending stories: Narrative in social movements.Qualitative Sociology 21, 4 (1998), 419–446. https://doi.org/10.1023/A:1023332410633

Brandon Andrew Robinson. 2018. Conditional Families and Lesbian, Gay, Bisexual, Transgender, and Queer Youth Homelessness: Gender, Sexuality, Family Instability, and Rejection. Journal of Marriage and Family 80, 2 (April 2018), 383–396. https://doi.org/10.1111/jomf.12466

Caitlin Ryan, David Huebner, Rafael M. Diaz, and Jorge Sanchez. 2009. Family Rejection as a Predictor of Negative Health Outcomes in White and Latino Lesbian, Gay, and Bisexual Young Adults. Pediatrics 123, 1 (Jan. 2009), 346–352. https://doi.org/10.1542/peds.2007-3524

Caitlin Ryan, Stephen T. Russell, David Huebner, Rafael Diaz, and Jorge Sanchez. 2010. Family Acceptance in Adolescence and the Health of LGBT Young Adults: Family Acceptance in Adolescence and the Health of LGBT Young Adults. Journal of Child and Adolescent Psychiatric Nursing 23, 4 (Nov. 2010), 205–213. https://doi.org/10.1111/j.1744-6171.2010.00246.x

Elizabeth M Saewyc. 2011. Research on adolescent sexual orientation: Development, health disparities, stigma, and resilience. Journal of research on adolescence 21, 1 (2011), 256–272.

Vincenzo Scotti, Licia Sbattella, and Roberto Tedesco. 2023. A Primer on Seq2Seq Models for Generative Chatbots. ACM Comput. Surv. (jun 2023). https://doi.org/10.1145/3604281 Just Accepted.

Joanna Semlyen, Michael King, Justin Varney, and Gareth Hagger-Johnson. 2016. Sexual orientation and symptoms of common mental disorder or low wellbeing: combined meta-analysis of 12 UK population health surveys. BMC psychiatry 16 (March 2016), 67. https://doi.org/10.1186/s12888-016-0767-z

Iulian Serban, Tim Klinger, Gerald Tesauro, Kartik Talamadupula, Bowen Zhou, Yoshua Bengio, and Aaron Courville. 2017. Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation. Proceedings of the AAAI Conference on Artificial Intelligence 31, 1 (Feb. 2017). https://doi.org/10.1609/aaai.v31i1.10984

Iulian Serban, Alessandro Sordoni, Yoshua Bengio, Aaron Courville, and Joelle Pineau. 2016. Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models. Proceedings of the AAAI Conference on Artificial Intelligence 30, 1 (March 2016). https://doi.org/10.1609/aaai.v30i1.9883

Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, and Nanyun Peng. 2019. The Woman Worked as a Babysitter: On Biases in Language Generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 3407–3412. https://doi.org/10.18653/v1/D19-1339

Divya Siddarth, Daron Acemoglu, Danielle Allen, Kate Crawford, James Evans, Michael Jordan, and E. Glen Weyl. Date of Publication. How AI Fails Us. https://ethics.harvard.edu/how-ai-fails-us Accessed: September 10th, 2023.

Ellen Simpson and Bryan Semaan. 2021. For You, or For"You"? Everyday LGBTQ+ Encounters with TikTok. Proc. ACM Hum.-Comput. Interact. 4, CSCW3, Article 252 (jan 2021), 34 pages. https://doi.org/10.1145/3432951

Zhaoyuan Su, Mayara Costa Figueiredo, Jueun Jo, Kai Zheng, and Yunan Chen. 2020. Analyzing Description, User Understanding and Expectations of AI in Mobile Health Applications. AMIA... Annual Symposium proceedings. AMIA Symposium 2020 (2020), 1170–1179.

Zhaoyuan Su, Lu He, Sunit P Jariwala, Kai Zheng, and Yunan Chen. 2022. "What is Your Envisioned Future?": Toward Human-AI Enrichment in Data Work of Asthma Care. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (Nov. 2022), 1–28. https://doi.org/10.1145/3555157

Zhaoyuan Su, John A. Schneider, and Sean D. Young. 2021. The Role of Conversational Agents for Substance Use Disorder in Social Distancing Contexts. Substance Use & Misuse 56, 11 (2021), 1732–1735. https://doi.org/10.1080/10826084.2021.1949609 arXiv:https://doi.org/10.1080/10826084.2021.1949609PMID: 34286669.

Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. 2014. Sequence to Sequence Learning with Neural Networks. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (Montreal, Canada) (NIPS’14). MIT Press, Cambridge, MA, USA, 3104–3112.

Vivian Ta, Caroline Griffith, Carolynn Boatfield, Xinyu Wang, Maria Civitello, Haley Bader, Esther DeCero, Alexia Loggarakis, 2020. User experiences of social support from companion chatbots in everyday contexts: thematic analysis. Journal of medical Internet research 22, 3 (2020), e16235.

Russell B. Toomey, Caitlin Ryan, Rafael M. Diaz, and Stephen T. Russell. 2018. Coping With Sexual Orientation–Related Minority Stress. Journal of Homosexuality 65, 4 (March 2018), 484–500. https://doi.org/10.1080/00918369.2017.1321888

Trevor Project. 2023. 2023 National Survey on LGBTQ Youth Mental Health. https://www.thetrevorproject.org/survey-2023/

TrevorSpace. 2023. TrevorSpace - Community for LGBTQ young people. https://www.trevorspace.org/. Accessed: 2023-12-12.

Richard R Troiden. 1988. Gay and lesbian identity: A sociological analysis. Rowman & Littlefield.

Marlon Twyman, Brian C. Keegan, and Aaron Shaw. 2017. Black Lives Matter in Wikipedia: Collective Memory and Collaboration around Online Social Movements. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (Portland, Oregon, USA) (CSCW ’17). Association for Computing Machinery, New York, NY, USA, 1400–1412. https://doi.org/10.1145/2998181.2998232

Aditya Nrusimha Vaidyam, Hannah Wisniewski, John David Halamka, Matcheri S. Kashavan, and John Blake Torous. 2019. Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape. The Canadian Journal of Psychiatry 64, 7 (2019), 456–464. https://doi.org/10.1177/0706743719828977 arXiv:https://doi.org/10.1177/0706743719828977PMID: 30897957.

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is All You Need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS’17). Curran Associates Inc., Red Hook, NY, USA, 6000–6010.

Jaimie F. Veale, Tracey Peter, Robb Travers, and Elizabeth M. Saewyc. 2017. Enacted Stigma, Mental Health, and Protective Factors Among Transgender Youth in Canada. Transgender Health 2, 1 (Dec. 2017), 207–216. https://doi.org/10.1089/trgh.2017.0031

Heyuan Wang, Ziyi Wu, and Junyu Chen. 2019. Multi-Turn Response Selection in Retrieval-Based Chatbots with Iterated Attentive Convolution Matching Network. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management (Beijing, China) (CIKM ’19). Association for Computing Machinery, New York, NY, USA, 1081–1090. https://doi.org/10.1145/3357384.3357928

Lu Wang, Munif Ishad Mujib, Jake Williams, George Demiris, and Jina Huh-Yoo. 2021. An Evaluation of Generative Pre-Training Model-based Therapy Chatbot for Caregivers. ArXiv abs/2107.13115 (2021). https://api.semanticscholar.org/CorpusID:236469205

Joseph Weizenbaum. 1966. ELIZA—a Computer Program for the Study of Natural Language Communication between Man and Machine. Commun. ACM 9, 1 (jan 1966), 36–45. https://doi.org/10.1145/365153.365168

Lauren Wilcox, Renee Shelby, Rajesh Veeraraghavan, Oliver L. Haimson, Gabriela Cruz Erickson, Michael Turken, and Rebecca Gulotta. 2023. Infrastructuring Care: How Trans and Non-Binary People Meet Health and Well-Being Needs through Technology. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1–17. https://doi.org/10.1145/3544548.3581040

Yu Wu, Wei Wu, Chen Xing, Ming Zhou, and Zhoujun Li. 2017. Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-Based Chatbots. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Vancouver, Canada, 496–505. https://doi.org/10.18653/v1/P17-1046

Chloe Xiang. 2023. Man Dies by Suicide After Talking with AI Chatbot, Widow Says. https://www.vice.com/en/article/pkadgm/man-dies-by-suicide-after-talking-with-ai-chatbot-widow-says Accessed: 2023-12-11.

Ziang Xiao, Michelle X. Zhou, Wenxi Chen, Huahai Yang, and Changyan Chi. 2020. If I Hear You Correctly: Building and Evaluating Interview Chatbots with Active Listening Skills. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376131

Hubert D. Zając, Dana Li, Xiang Dai, Jonathan F. Carlsen, Finn Kensing, and Tariq O. Andersen. 2023. Clinician-Facing AI in the Wild: Taking Stock of the Sociotechnical Challenges and Opportunities for HCI. ACM Transactions on Computer-Human Interaction 30, 2 (April 2023), 1–39. https://doi.org/10.1145/3582430

Daniel M. Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul Christiano, and Geoffrey Irving. 2020. Fine-Tuning Language Models from Human Preferences. http://arxiv.org/abs/1909.08593 arXiv:1909.08593 [cs, stat].