[Access Lunch] [Accessibility Lunch] - 2/17 NSH 4201 @ 12 PM

[Peya Mowar]

Hi everyone, This Monday, we have our alum Jason Wu joining us from Apple  
for accessibility lunch! Please find the talk details below: Title: From  
Agents to Optimization: User Interface Understanding and Generation  
Abstract: A grand challenge in human-computer interaction (HCI) is  
constructing user interfaces (UIs) that make computers useful for all users  
across all contexts. UIs today are static, manually-constructed artifacts  
that limit how users and external software can interact with them. In this  
talk, I describe two types of machine learning approaches that transform  
interfaces into dynamic, computational objects that can be optimized for  
users, applications, and contexts. I first discuss my contributions to UI  
Understanding, a class of approaches that allow machines to reliably  
understand the semantics (content and functionality) of UIs using the  
input/output modalities as humans (e.g., visual perception of rendered  
pixels and mouse input). I show how these capabilities enhance user  
interaction and unlock new possibilities for systems such as assistive  
technology, software testing, and UI automation. Next, I discuss my  
contributions to UI Generation, which enables applications to dynamically  
decide how to present content and functionality for new usage contexts. To  
this end, I present novel approaches to user modeling, UI adaptation, and  
code generation. Finally, I discuss future research directions and  
opportunities to drive advances in fields such as HCI, machine learning,  
and software engineering. Bio: Jason Wu is a Research Scientist at Apple in  
the Human-Centered Machine Intelligence group. Previously, he received a  
PhD in HCI from CMU. He applies ML to optimize UIs for HCI in his research,  
resulting in over 30 publications in top venues for HCI, UI technology,  
accessibility, and ML, where he has received several best paper awards (CHI  
2021, W4A 2021, IUI 2024) and honorable mention awards (CHI 2020, CHI  
2023). His work has also been recognized by a Fast Company Innovation by  
Design Student Finalist Award, press coverage in major outlets such as  
TechCrunch and AppleInsider, and by the FCC Chair Awards for Advancements  
in Accessibility. Jason is a recipient of the NSF Graduate Research  
Fellowship and was selected as a Heidelberg Laureate Forum Young  
Researcher. We will meet in NSH 4201 for this fascinating talk! Thanks and  
regards, Peya

Accessibility Lunch Seminar
Monday Feb 17, 2025 ⋅ 12pm – 1pm
Eastern Time - New York

Location
NSH 4201, Newell-Simon Hall, Hamerschlag Dr, Pittsburgh, PA 15213, USA	
https://www.google.com/maps/search/NSH+4201,+Newell-Simon+Hall,+Hamerschlag+Dr,+Pittsburgh,+PA+15213,+USA?hl=en



Attachments
Accessibility Lunch Schedule 2024  
https://drive.google.com/open?id=1k1Pmh9jo-N7S73Fi10y-5tEynvhw3xLbPf-NMAjTSxU

CMU Accessibility Lunch Seminar SeriesAbout: This seminar series explores  
the evolution and future directions of accessibility research and practice.  
Each week, we discuss diverse facets of accessible and assistive  
technologies, featuring speakers from academia, industry, and beyond. The  
seminar is organised by the Accessibility Research Group at Carnegie Mellon  
University.Peya Mowar is inviting you to a scheduled Zoom meeting.Join Zoom  
Meetinghttps://cmu.zoom.us/j/99282851029?pwd=CUYhUGEykBYvMAGO2zwKeoig3abPzN.1Meeting  
ID: 992 8285 1029Passcode: a11y---One tap  
mobile+12678310333,,99282851029#,,,,*818322# US  
(Philadelphia)+14703812552,,99282851029#,,,,*818322# US (Atlanta)---Dial by  
your location• +1 267 831 0333 US (Philadelphia)• +1 470 381 2552 US  
(Atlanta)• +1 646 518 9805 US (New York)• +1 651 372 8299 US (Minnesota)•  
+1 786 635 1003 US (Miami)• +1 929 205 6099 US (New York)• +1 301 715 8592  
US (Washington DC)• +1 312 626 6799 US (Chicago)• +1 470 250 9358 US  
(Atlanta)• +1 971 247 1195 US (Portland)• +1 206 337 9723 US (Seattle)• +1  
213 338 8477 US (Los Angeles)• +1 253 215 8782 US (Tacoma)• +1 346 248 7799  
US (Houston)• +1 602 753 0140 US (Phoenix)• +1 669 219 2599 US (San Jose)•  
+1 669 900 6833 US (San Jose)• +1 720 928 9299 US (Denver)Meeting ID: 992  
8285 1029Passcode: 818322Find your local number:  
https://cmu.zoom.us/u/acS6qWzHCj---Join by SIP•  
99282851029 at zoomcrc.com---Join by H.323• 162.255.37.11 (US West)•  
162.255.36.11 (US East)• 221.122.88.195 (Mainland China)• 115.114.131.7  
(India Mumbai)• 115.114.115.7 (India Hyderabad)• 213.19.144.110 (Amsterdam  
Netherlands)• 213.244.140.110 (Germany)• 103.122.166.55 (Australia Sydney)•  
103.122.167.55 (Australia Melbourne)• 209.9.211.110 (Hong Kong SAR)•  
149.137.40.110 (Singapore)• 64.211.144.160 (Brazil)• 159.124.132.243  
(Mexico)• 159.124.168.213 (Canada Toronto)• 65.39.152.160 (Canada  
Vancouver)• 207.226.132.110 (Japan Tokyo)• 149.137.24.110 (Japan  
Osaka)Meeting ID: 992 8285 1029Passcode: 818322

Guests
Peya Mowar - creator
calua.pataca at gmail.com
Heather Kelley
Frank Elavsky
accessibility-lunch at lists.andrew.cmu.edu


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.andrew.cmu.edu/pipermail/accessibility-lunch/attachments/20250214/356174fe/attachment.html>