Emotional AI Survey, UK: Aggregate Data, 2022

McStay, Andrew John and Bakir, Vian and Urquhart, Lachlan and Miranda, Diana (2023). Emotional AI Survey, UK: Aggregate Data, 2022. [Data Collection]. Colchester, Essex: UK Data Service. 10.5255/UKDA-SN-856708

CONTEXT Emotional AI (EAI) technologies sense, learn and interact with citizens' emotions, moods, attention and intentions. Using weak and narrow rather than strong AI, machines read and react to emotion via text, images, voice, computer vision and biometric sensing. Concurrently, life in cities is increasingly technologically mediated. Data-driven sensors, actuators, robots and pervasive networking are changing how citizens experience cities, but not always for the better. Citizen needs and perspectives are often ancillary in emerging smart city deployments, resulting in mistrust in new civic infrastructure and its management (e.g. Alphabet's Sidewalk Labs). We need to avoid these issues repeating as EAI is rolled out in cities. Reading the body is an increasingly prevalent concern, as recent pushback against facial detection and recognition technologies demonstrates. EAI is an extension of this, and as it becomes normalised across the next decade we are concerned about how these systems are governed, social impacts on citizens, and how EAI can be designed in a more ethical manner. In both Japan and UK, we are at a critical juncture where these social, technological and governance structures can be appropriately prepared before mass adoption of EAI, to enable citizens, in all their diversity, to live ethically and well with EAI in cities-as-platforms. Building on our ESRC/AHRC seminars in Tokyo (2019) that considered cross-cultural ethics and EAI, our research will enable a multi-stakeholder (commerce, security, media) and citizen-led interdisciplinary response to EAI for Japan and UK. While these are two of the most advanced nations in regard to AI, the social contexts and histories from which these technologies emerge differ, providing rich scope for reflection and mutual learning. AIMS/OBJECTIVES 1. To assess what it means to live ethically and well with EAI in cities in cross-cultural (UK-Japan) commercial, security and media contexts. 2. To map and engage with the ecology of influential actors developing and working with EAI in UK-Japan. 3. To understand commercial activities, intentions and ethical implications regarding EAI in cities, via interviews with industry, case studies, and analysis of patents. 4. To ascertain how EAI might impact security/policing stakeholders, and organisations in the new media ecology, via interviews with these stakeholders and case studies in UK-Japan. 5. To examine governance approaches for collection and use of intimate data about emotions in public spaces to understand how these guide EAI technological developments, and to build a repository of best practice on EAI in cities. 6. To understand diverse citizens' attitudes to EAI via quantitative national surveys and qualitative workshops to co-design citizen-led, creative visions of what it means to live ethically and well with EAI in cities in UK-Japan. 8. To feed our insights to stakeholders shaping usage of EAI in cities in UK-Japan. 9. To advance surveillance studies, new media studies, information technology law, science & technology studies, security & policing studies, computer ethics and affective computing via: 24 international conference papers; a conference on EAI; 12 international, refereed journal papers; a Special Issue on EAI. APPLICATIONS/BENEFITS We will: - Raise awareness of UK-Japanese stakeholders (technology industry, policymakers, NGOs, security services, urban planners, media outlets, citizens) on how to live ethically and well with EAI in cities, via co-designed, citizen-led, qualitative visions fed into Stakeholder Policy Workshops; a Final Report with clear criteria on ethical usage of EAI in cites; 24 talks with stakeholders; multiple news stories. - Set up a think tank to provide impartial ethical advice on EAI and cross-cultural issues to diverse stakeholders during and after the project. - Advance collaboration between UK-Japan academics, disciplines and stakeholders in EAI.

Data description (abstract)

This project aimed to quantitatively understand citizens' attitudes to Emotional AI via national surveys (as described in point 6 "Project Description", see above). We developed a demographically representative survey to gauge citizen attitudes to emotion capture technologies in cities in the UK. The survey introduces the overall topic of emotion profiling with the phrase: ‘We would now like to ask your opinion on use of technologies that try to measure and understand emotions (e.g., through computer analysis of social media posts, facial expression, voice, heart rate, gesture, and other data about the body). Closed-ended questions allowed then to explore 10 different use cases (38 questions in total): security, policing, communications, political campaigning, health, transport, education, toys and robots. For each case, positive and negative themes were tested, by grounding each question in an applied use case. In total, nine themes were explored, (although not across all the use cases to minimise survey fatigue).

Downloads

Altmetric