[Access Lunch] [Accessibility Lunch] - 2/17 NSH 4201 @ 12 PM

[Peya Mowar]

Hi everyone,
The correct room is *NSH* *4513*, not NSH 4201. I apologise for the
confusion.
Thanks and regards,
Peya Mowar
cs.cmu.edu/~peyajm29


On Fri, Feb 14, 2025 at 2:22 PM Peya Mowar <pmowar at andrew.cmu.edu> wrote:

> Accessibility Lunch Seminar
>
>
>
> Hi everyone,
> This Monday, we have our alum Jason Wu joining us from Apple for
> accessibility lunch! Please find the talk details below:
>
> Title: From Agents to Optimization: User Interface Understanding and
> Generation
>
> Abstract: A grand challenge in human-computer interaction (HCI) is
> constructing user interfaces (UIs) that make computers useful for all users
> across all contexts. UIs today are static, manually-constructed artifacts
> that limit how users and external software can interact with them. In this
> talk, I describe two types of machine learning approaches that transform
> interfaces into dynamic, computational objects that can be optimized for
> users, applications, and contexts. I first discuss my contributions to UI
> Understanding, a class of approaches that allow machines to reliably
> understand the semantics (content and functionality) of UIs using the
> input/output modalities as humans (e.g., visual perception of rendered
> pixels and mouse input). I show how these capabilities enhance user
> interaction and unlock new possibilities for systems such as assistive
> technology, software testing, and UI automation. Next, I discuss my
> contributions to UI Generation, which enables applications to dynamically
> decide how to present content and functionality for new usage contexts. To
> this end, I present novel approaches to user modeling, UI adaptation, and
> code generation. Finally, I discuss future research directions and
> opportunities to drive advances in fields such as HCI, machine learning,
> and software engineering.
>
> Bio: Jason Wu is a Research Scientist at Apple in the Human-Centered
> Machine Intelligence group. Previously, he received a PhD in HCI from CMU.
> He applies ML to optimize UIs for HCI in his research, resulting in over 30
> publications in top venues for HCI, UI technology, accessibility, and ML,
> where he has received several best paper awards (CHI 2021, W4A 2021, IUI
> 2024) and honorable mention awards (CHI 2020, CHI 2023). His work has also
> been recognized by a Fast Company Innovation by Design Student Finalist
> Award, press coverage in major outlets such as TechCrunch and AppleInsider,
> and by the FCC Chair Awards for Advancements in Accessibility. Jason is a
> recipient of the NSF Graduate Research Fellowship and was selected as a
> Heidelberg Laureate Forum Young Researcher.
>
> We will meet in NSH 4201 for this fascinating talk!
> Thanks and regards,
> Peya
>
> Attachments
> Accessibility Lunch Sc...
> <https://drive.google.com/open?id=1k1Pmh9jo-N7S73Fi10y-5tEynvhw3xLbPf-NMAjTSxU>
> Accessibility Lunch Seminar
> Monday Feb 17, 2025 ⋅ 12pm – 1pm (Eastern Time - New York)
> CMU Accessibility Lunch Seminar Series
> <https://www.google.com/url?q=https%3A%2F%2Fcmubiglab.github.io%2Flunch%2F&sa=D&ust=1739992920000000&usg=AOvVaw383XSTEXG3Rn8I64JYmd4M>
> About: This seminar series explores the evolution and future directions of
> accessibility research and practice. Each week, we discuss diverse facets
> of accessible and assistive technologies, featuring speakers from academia,
> industry, and beyond. The seminar is organised by the Accessibility
> Research Group
> <https://www.google.com/url?q=https%3A%2F%2Faccessibility.cs.cmu.edu%2F&sa=D&ust=1739992920000000&usg=AOvVaw35qh5h_aKtK3HAGl8kBQ8I> at
> Carnegie Mellon University.
>
> Peya Mowar is inviting you to a scheduled Zoom meeting.
>
> Join Zoom Meeting
> https://cmu.zoom.us/j/99282851029?pwd=CUYhUGEykBYvMAGO2zwKeoig3abPzN.1
> <https://www.google.com/url?q=https%3A%2F%2Fcmu.zoom.us%2Fj%2F99282851029%3Fpwd%3DCUYhUGEykBYvMAGO2zwKeoig3abPzN.1&sa=D&ust=1739992920000000&usg=AOvVaw3wdF1DGgaMIoBj2gw1fAiH>
>
> Meeting ID: 992 8285 1029
> Passcode: a11y
>
> ---
>
> One tap mobile
> +12678310333,,99282851029#,,,,*818322# US (Philadelphia)
> +14703812552,,99282851029#,,,,*818322# US (Atlanta)
>
> ---
>
> Dial by your location
> • +1 267 831 0333 US (Philadelphia)
> • +1 470 381 2552 US (Atlanta)
> • +1 646 518 9805 US (New York)
> • +1 651 372 8299 US (Minnesota)
> • +1 786 635 1003 US (Miami)
> • +1 929 205 6099 US (New York)
> • +1 301 715 8592 US (Washington DC)
> • +1 312 626 6799 US (Chicago)
> • +1 470 250 9358 US (Atlanta)
> • +1 971 247 1195 US (Portland)
> • +1 206 337 9723 US (Seattle)
> • +1 213 338 8477 US (Los Angeles)
> • +1 253 215 8782 US (Tacoma)
> • +1 346 248 7799 US (Houston)
> • +1 602 753 0140 US (Phoenix)
> • +1 669 219 2599 US (San Jose)
> • +1 669 900 6833 US (San Jose)
> • +1 720 928 9299 US (Denver)
>
> Meeting ID: 992 8285 1029
> Passcode: 818322
>
> Find your local number: https://cmu.zoom.us/u/acS6qWzHCj
> <https://www.google.com/url?q=https%3A%2F%2Fcmu.zoom.us%2Fu%2FacS6qWzHCj&sa=D&ust=1739992920000000&usg=AOvVaw0lfMngzZjm1UoFfzt1fBY9>
>
> ---
>
> Join by SIP
> • 99282851029 at zoomcrc.com
>
> ---
>
> Join by H.323
> • 162.255.37.11 (US West)
> • 162.255.36.11 (US East)
> • 221.122.88.195 (Mainland China)
> • 115.114.131.7 (India Mumbai)
> • 115.114.115.7 (India Hyderabad)
> • 213.19.144.110 (Amsterdam Netherlands)
> • 213.244.140.110 (Germany)
> • 103.122.166.55 (Australia Sydney)
> • 103.122.167.55 (Australia Melbourne)
> • 209.9.211.110 (Hong Kong SAR)
> • 149.137.40.110 (Singapore)
> • 64.211.144.160 (Brazil)
> • 159.124.132.243 (Mexico)
> • 159.124.168.213 (Canada Toronto)
> • 65.39.152.160 (Canada Vancouver)
> • 207.226.132.110 (Japan Tokyo)
> • 149.137.24.110 (Japan Osaka)
>
> Meeting ID: 992 8285 1029
> Passcode: 818322
> LocationNSH 4201, Newell-Simon Hall, Hamerschlag Dr, Pittsburgh, PA
> 15213, USA
> View map
> <https://www.google.com/maps/search/NSH+4201,+Newell-Simon+Hall,+Hamerschlag+Dr,+Pittsburgh,+PA+15213,+USA?hl=en>
> Guests
> Peya Mowar <pmowar at andrew.cmu.edu> - creator
> calua.pataca at gmail.com
> Heather Kelley <hkelley at andrew.cmu.edu>
> Frank Elavsky <fje at andrew.cmu.edu>
> accessibility-lunch at lists.andrew.cmu.edu
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.andrew.cmu.edu/pipermail/accessibility-lunch/attachments/20250217/881ed151/attachment.html>