Home Program For Authors For Attendees For Sponsors
The Fairmont, San Francisco, California USA | Oct. 29 – Nov. 1, 2023

The ACM Symposium on User Interface Software and Technology (UIST) is the premier forum for innovations in human-computer interfaces. Sponsored by ACM special interest groups on computer-human interaction (SIGCHI) and computer graphics (SIGGRAPH), UIST brings together people from diverse areas including graphical & web user interfaces, tangible & ubiquitous computing, virtual & augmented reality, multimedia, new input & output devices, Human-Centered AI, and CSCW. The intimate size and intensive program make UIST an ideal opportunity to exchange research results and ideas.

11/2/2023 — UIST 2024 will be held in Pittsburgh, PA, USA!


Lasting Impact

Vizwiz: Nearly Real-Time Answers to Visual Questions
Jeffrey P Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White, Tom Yeh. UIST 2010.

Papers - Best Papers

Going Incognito in the Metaverse: Achieving Theoretically Optimal Privacy-Usability Tradeoffs in VR
Vivek Nair, Gonzallo Munilla-Garrido, Dawn Song

GenAssist: Making Image Generation Accessible
Mina Huh, Yi-Hao Peng, Amy Pavel

Generative Agents: Interactive Simulacra of Human Behavior
Joon Sung Park, Joey O’Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, Michael S. Bernstein

Papers - Honorable Mentions

ecoEDA: Recycling E-waste During Electronics Design
Jasmine Lu, Beza Desta, K.D. Wu, Romain Nith, Joyce E. Passananti, Pedro Lopes

Sustainflatable: Harvesting, Storing and Utilizing Ambient energy for Pneumatic morphing Interfaces
Qiuyu Lu, Tianyu Yu, Semina Yi, Yuran Ding, Haipeng Mi, Lining Yao

Living Papers: A Language Toolkit for Augmented Scholarly Communication
Jeffrey Heer, Matthew Conlen, Vishal Devireddy, Tu Nguyen, Joshua Horowitz

Scene Responsiveness for Visuotactile Illusions in Mixed Reality
Mohamed Kari, Reinhard Schütte, Raj Sodhi

Demos - Best Demo

Constraint-Driven Robotic Surfaces, at Human-Scale
Jesse T Gonzalez, Sonia Prashant,Sapna Tayal, Juhi Kedia, Alexandra Ion, and Scott E Hudson

Z-Ring: Context-Aware Subtle Input Using Single-Point Bio-Impedance Sensing
Anandghan Waghmare, Jiexin Ding, Ishan Chatterjee, and Shwetak Patel

Demos - Honorable Mention

Masonview: Content-Driven Viewport Management
Bryan Min, Matthew T Beaudouin-Lafon, Sangho Suh, and Haijun Xia

Biohybrid Devices: Prototyping Interactive Devices with Growable Materials
Madalina Luciana Nicolae, Vivien Roussel, Marion Koelle, Samuel Huron, Jürgen Steimle, and Marc Teyssier

SuperMagneShape: Interactive Usage of a Passive Pin-Based Shape-Changing Display
Kentaro Yasu

Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz

Taste Retargeting via Chemical Taste Modulators
Jas Brooks, Noor Amin, and Pedro Lopes

Demos - People’s Choice

ChromaNails: Re-Programmable Multi-Colored High-Resolution On-Body Interfaces using Photochromic Nail Polish
Magnus Frisk, Mads Vejrup, Frederik Kjaer Soerensen, and Michael Wessely

Mo2Hap: Rendering VR Performance Motion Flow to Upper-body Vibrotactile Haptic Feedback
Kyungeun Jung, and Sang Ho Yoon

Demos - People’s Choice Honorable Mentions

Fluid Reality: High-Resolution, Untethered Haptic Gloves using Electroosmotic Pump Arrays
Vivian Shen, Tucker Rae-Grant, Joe Mullenbach, Chris Harrison, and Craig Shultz

Double-Sided Tactile Interactions for Grasping in VR
Arata Jingu, Anusha Withana, and Jürgen Steimle

SuperMagneShape: Interactive Usage of a Passive Pin-Based Shape-Changing Display
Kentaro Yasu

Poster - People’s Choice Best Poster

Virtual Buddy: Redefining Conversational AI Interactions for Individuals with Hand Motor Disabilities
Atieh Taheri, Purav Bhardwaj, Arthur Caetano, Alice Zhong, Misha Sra

Poster - People’s Choice Honorable Mentions

SketchingRelatedWork: Finding and Organizing Papers through Inking a Node-Link Diagram
Donghyeok Ma, Joon Hyub Lee, Junwoo Yoon, Taegyu Jin, Seok-Hyung Bae

An Interactive System for Drawing Cars in Perspective
Seung-Jun Lee, Taegyu Jin, Joon Hyub Lee, Seok-Hyung Bae

Generative Facial Expressions and Eye Gaze Behavior from Prompts for Multi-Human-Robot Interaction
Gabriel J. Serfaty, Virgil O. Barnard IV, Joseph P. Salisbury

Student Innovation Contest (SIC) - Best SIC Award

LingoLand: An AI-Assisted Immersive Game for Language Learning
Olivia Seow (Harvard Univeristy)

Student Innovation Contest - SIC Honorable Mentions

AudiLens: Configurable LLM-Generated Audiences for Public Speech Practice
Jeongeon Park and DaEun Choi (KAIST)

Docent: Digital Operation-Centric Elicitation of Novice-friendly Tutorials
Yihao Zhu, Qinyi Zhou (Tsinghua University)

Student Innovation Contest - SIC People’s Choice

Smart-Pikachu: Extending Interactivity of Stuffed Animals with Large Language Models
Toma Itagaki (Columbia), Richard Li (U. Washington)

Student Innovation Contest - SIC People’s Choice Honorable Mentions

4-Frame Manga Drawing Support System
Yuto Nagao, Soichiro Fukuda (Kwansei Gakuin University)

ZINify: Transforming Research Papers into Engaging Zines with Large Language Models
Jaidev Shriram, S.P.K Sreekala (University of California - San Diego)


UIST 2023 is possible in part due to gracious support from our sponsors.

Interested in sponsoring?

Platinum Sponsors

Meta logo

Silver Sponsors

Adobe logo

Apple logo

Autodesk logo

Google logo

Bronze Sponsors

Toyota Research Institute logo

Chase logo

CSIRO logo

David Holz (Opening Keynote)


A wide-ranging conversation with David Holz, founder of Midjourney and Leap Motion, moderated by Jeff Han.


David Holz

David Holz is the founder and CEO of Midjourney. Previously, he was co-founder and CTO of Leap Motion. David contracted for NASA’s Langley Research Center and conducted neuroscience research while at the Max Planck Institute. He studied Applied Math at the University of North Carolina at Chapel Hill, ultimately leaving his PhD program to co-found Leap Motion in 2010. David is based here in San Francisco, California.

Judy Fan (Closing Keynote)


Cognitive tools for uncovering useful abstractions

In the 17th century, the Cartesian coordinate system was groundbreaking. It exposed the unity between algebra and geometry, accelerating the development of the math that took humans to the moon. It was not just another concept, but a cognitive tool that people could wield to express abstract ideas in visual form, thereby expanding their capacity to think and generate new insights about a variety of other problems. Research in my lab aims to uncover the psychological mechanisms that explain how people have come to deploy these technologies in such innovative ways to learn, share knowledge, and create new things. In the first part of this talk, I will provide an overview of our recent work investigating drawing — one of our most enduring and versatile tools. Across several empirical and computational studies, I’ll argue that drawing not only provides a window into how we perceive and understand the visual world, but also accelerates humans’ ability to learn and communicate useful abstractions. In the second part, I will describe an emerging line of work investigating how humans discover new abstractions when building physical structures, and externalize these abstractions to support planning and collaboration. I will close by noting the broader implications of embracing such complex, naturalistic behaviors for advancing theories of human cognition and enhancing real-world impact, including in AI and education.


Judy Fan

Judy Fan is an Assistant Professor of Psychology at Stanford University. Research in her lab aims to reverse engineer the human cognitive toolkit, especially how people use physical representations of thought to learn, communicate, and solve problems. Towards this end, her lab employs converging approaches from cognitive science, computational neuroscience, and artificial intelligence. She previously held a faculty appointment at the University of California, San Diego, received her PhD in Psychology from Princeton University, and received her AB in Neurobiology and Statistics from Harvard College.

© Copyright 2023 ACM SIGCHI