<div dir="ltr"><div>Hi everyone,</div><div>The correct room is <b>NSH</b> <b>4513</b>, not NSH 4201. I apologise for the confusion.</div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Thanks and regards,<div>Peya Mowar</div><div><a href="http://cs.cmu.edu/~peyajm29" target="_blank">cs.cmu.edu/~peyajm29</a></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Feb 14, 2025 at 2:22 PM Peya Mowar <<a href="mailto:pmowar@andrew.cmu.edu" target="_blank">pmowar@andrew.cmu.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex"><div><u></u>
<div><span><span style="display:none"></span><span><span></span><span style="display:none;font-size:1px;color:rgb(255,255,255);line-height:1px;height:0px;max-height:0px;width:0px;max-width:0px;opacity:0;overflow:hidden">Accessibility Lunch Seminar</span><span aria-hidden="true"></span><table border="0" cellpadding="0" cellspacing="0" role="presentation" align="center" style="width:100%"><tbody><tr><td align="left"><div style="height:16px" aria-hidden="true"> </div><table border="0" cellpadding="0" cellspacing="0" role="presentation" align="center" style="width:100%"><tbody><tr><td align="left"><span><p>Hi everyone,<br>This Monday, we have our alum Jason Wu joining us from Apple for accessibility lunch! Please find the talk details below:</p><p>Title: From Agents to Optimization: User Interface Understanding and Generation</p><p>Abstract: A grand challenge in human-computer interaction (HCI) is constructing user interfaces (UIs) that make computers useful for all users across all contexts. UIs today are static, manually-constructed artifacts that limit how users and external software can interact with them. In this talk, I describe two types of machine learning approaches that transform interfaces into dynamic, computational objects that can be optimized for users, applications, and contexts. I first discuss my contributions to UI Understanding, a class of approaches that allow machines to reliably understand the semantics (content and functionality) of UIs using the input/output modalities as humans (e.g., visual perception of rendered pixels and mouse input). I show how these capabilities enhance user interaction and unlock new possibilities for systems such as assistive technology, software testing, and UI automation. Next, I discuss my contributions to UI Generation, which enables applications to dynamically decide how to present content and functionality for new usage contexts. To this end, I present novel approaches to user modeling, UI adaptation, and code generation. Finally, I discuss future research directions and opportunities to drive advances in fields such as HCI, machine learning, and software engineering.</p><p>Bio: Jason Wu is a Research Scientist at Apple in the Human-Centered Machine Intelligence group. Previously, he received a PhD in HCI from CMU. He applies ML to optimize UIs for HCI in his research, resulting in over 30 publications in top venues for HCI, UI technology, accessibility, and ML, where he has received several best paper awards (CHI 2021, W4A 2021, IUI 2024) and honorable mention awards (CHI 2020, CHI 2023). His work has also been recognized by a Fast Company Innovation by Design Student Finalist Award, press coverage in major outlets such as TechCrunch and AppleInsider, and by the FCC Chair Awards for Advancements in Accessibility. Jason is a recipient of the NSF Graduate Research Fellowship and was selected as a Heidelberg Laureate Forum Young Researcher.</p><p>We will meet in NSH 4201 for this fascinating talk!<br>Thanks and regards,<br>Peya</p><p></p><p></p><p></p><p></p></span></td></tr></tbody></table><table border="0" cellpadding="0" cellspacing="0" role="presentation" align="center" style="width:100%"><tbody><tr><td style="border:1px solid rgb(218,220,224);border-radius:8px;direction:rtl;font-size:0px;padding:24px 32px;text-align:left;vertical-align:top"><div style="font-size:13px;text-align:left;direction:ltr;display:inline-block;vertical-align:top;width:100%;overflow:hidden"><table border="0" cellpadding="0" cellspacing="0" role="presentation" width="100%"><tbody><tr><td style="vertical-align:top;padding:0px"><table border="0" cellpadding="0" cellspacing="0" role="presentation" width="100%"><tbody><tr><td style="font-size:0px;padding:0px;text-align:left;word-break:break-word"><div style="font-family:Roboto,sans-serif;font-size:14px;line-height:20px;text-align:left" role="presentation"><table border="0" cellpadding="0" cellspacing="0" role="presentation" style="padding-bottom:4px"><tbody><tr><td><h2 style="font-size:14px;color:rgb(60,64,67);text-decoration:none;font-weight:700;margin:0px;padding:0px">Attachments</h2></td></tr></tbody></table></div></td></tr><tr><td style="font-size:0px;padding:0px 1px 24px;text-align:left;word-break:break-word"><table border="0" cellpadding="0" cellspacing="0" role="presentation" style="border:1px solid rgb(218,220,224);border-radius:16px;border-collapse:separate;padding:4px 0px"><tbody><tr><td style="padding:3px 10px;height:14px;width:14px"><img src="https://drive-thirdparty.googleusercontent.com/32/type/application/vnd.google-apps.spreadsheet" width="14" height="14" alt="" style="display: inline-block; vertical-align: middle;"></td><td align="left" style="padding:0px 10px 0px 0px;max-width:160px;overflow:hidden;text-overflow:ellipsis;white-space:nowrap"><div style="overflow:hidden;height:20px"><a href="https://drive.google.com/open?id=1k1Pmh9jo-N7S73Fi10y-5tEynvhw3xLbPf-NMAjTSxU" style="font-weight:400;color:rgb(95,99,104);font-size:14px;margin:0px;text-decoration:none;text-transform:none;font-family:Roboto,sans-serif;display:inline-block;height:20px;max-width:160px;line-height:20px;overflow:hidden;text-overflow:ellipsis;vertical-align:middle;white-space:normal" title="Accessibility Lunch Schedule 2024" target="_blank">Accessibility Lunch Sc...</a></div></td></tr></tbody></table></td></tr></tbody></table></td></tr></tbody></table></div><div style="font-size:13px;text-align:left;direction:ltr;display:inline-block;vertical-align:top;width:100%;overflow:hidden"><table border="0" cellpadding="0" cellspacing="0" role="presentation" width="100%" style="padding-right:32px;padding-left:0px;table-layout:fixed"><tbody><tr><td style="padding:0px;vertical-align:top"><table border="0" cellpadding="0" cellspacing="0" role="presentation" width="100%" style="table-layout:fixed"><tbody><tr><td style="font-size:0px;padding:0px 0px 2px;text-align:left;word-break:break-word"><div style="font-family:"Google Sans",Roboto,sans-serif;font-weight:400;font-size:22px;line-height:28px;color:rgb(60,64,67);text-decoration:none" role="presentation"><span>Accessibility Lunch Seminar</span></div></td></tr><tr><td style="font-size:0px;padding:0px 0px 24px;text-align:left;word-break:break-word"><div style="font-family:Roboto,sans-serif;font-style:normal;font-weight:400;font-size:14px;line-height:20px;letter-spacing:0.2px;color:rgb(60,64,67);text-decoration:none" role="presentation"><span aria-hidden="true"></span><span>Monday Feb 17, 2025 ⋅ 12pm – 1pm (Eastern Time - New York)</span></div></td></tr><tr><td style="font-size:0px;padding:0px 0px 24px;text-align:left;word-break:break-word"><div style="font-family:Roboto,sans-serif;font-style:normal;font-weight:400;font-size:14px;line-height:20px;letter-spacing:0.2px;color:rgb(60,64,67);text-decoration:none" role="presentation"><span><a href="https://www.google.com/url?q=https%3A%2F%2Fcmubiglab.github.io%2Flunch%2F&sa=D&ust=1739992920000000&usg=AOvVaw383XSTEXG3Rn8I64JYmd4M" target="_blank">CMU Accessibility Lunch Seminar Series</a><br>About: This seminar series explores the evolution and future directions of accessibility research and practice. Each week, we discuss diverse facets of accessible and assistive technologies, featuring speakers from academia, industry, and beyond. The seminar is organised by the <a href="https://www.google.com/url?q=https%3A%2F%2Faccessibility.cs.cmu.edu%2F&sa=D&ust=1739992920000000&usg=AOvVaw35qh5h_aKtK3HAGl8kBQ8I" target="_blank">Accessibility Research Group</a> at Carnegie Mellon University.<br><br>Peya Mowar is inviting you to a scheduled Zoom meeting.<br><br>Join Zoom Meeting<br><a href="https://www.google.com/url?q=https%3A%2F%2Fcmu.zoom.us%2Fj%2F99282851029%3Fpwd%3DCUYhUGEykBYvMAGO2zwKeoig3abPzN.1&sa=D&ust=1739992920000000&usg=AOvVaw3wdF1DGgaMIoBj2gw1fAiH" target="_blank">https://cmu.zoom.us/j/99282851029?pwd=CUYhUGEykBYvMAGO2zwKeoig3abPzN.1</a><br><br>Meeting ID: 992 8285 1029<br>Passcode: a11y<br><br>---<br><br>One tap mobile<br>+12678310333,,99282851029#,,,,*818322# US (Philadelphia)<br>+14703812552,,99282851029#,,,,*818322# US (Atlanta)<br><br>---<br><br>Dial by your location<br>• +1 267 831 0333 US (Philadelphia)<br>• +1 470 381 2552 US (Atlanta)<br>• +1 646 518 9805 US (New York)<br>• +1 651 372 8299 US (Minnesota)<br>• +1 786 635 1003 US (Miami)<br>• +1 929 205 6099 US (New York)<br>• +1 301 715 8592 US (Washington DC)<br>• +1 312 626 6799 US (Chicago)<br>• +1 470 250 9358 US (Atlanta)<br>• +1 971 247 1195 US (Portland)<br>• +1 206 337 9723 US (Seattle)<br>• +1 213 338 8477 US (Los Angeles)<br>• +1 253 215 8782 US (Tacoma)<br>• +1 346 248 7799 US (Houston)<br>• +1 602 753 0140 US (Phoenix)<br>• +1 669 219 2599 US (San Jose)<br>• +1 669 900 6833 US (San Jose)<br>• +1 720 928 9299 US (Denver)<br><br>Meeting ID: 992 8285 1029<br>Passcode: 818322<br><br>Find your local number: <a href="https://www.google.com/url?q=https%3A%2F%2Fcmu.zoom.us%2Fu%2FacS6qWzHCj&sa=D&ust=1739992920000000&usg=AOvVaw0lfMngzZjm1UoFfzt1fBY9" target="_blank">https://cmu.zoom.us/u/acS6qWzHCj</a><br><br>---<br><br>Join by SIP<br>• <a href="mailto:99282851029@zoomcrc.com" target="_blank">99282851029@zoomcrc.com</a><br><br>---<br><br>Join by H.323<br>• 162.255.37.11 (US West)<br>• 162.255.36.11 (US East)<br>• 221.122.88.195 (Mainland China)<br>• 115.114.131.7 (India Mumbai)<br>• 115.114.115.7 (India Hyderabad)<br>• 213.19.144.110 (Amsterdam Netherlands)<br>• 213.244.140.110 (Germany)<br>• 103.122.166.55 (Australia Sydney)<br>• 103.122.167.55 (Australia Melbourne)<br>• 209.9.211.110 (Hong Kong SAR)<br>• 149.137.40.110 (Singapore)<br>• 64.211.144.160 (Brazil)<br>• 159.124.132.243 (Mexico)<br>• 159.124.168.213 (Canada Toronto)<br>• 65.39.152.160 (Canada Vancouver)<br>• 207.226.132.110 (Japan Tokyo)<br>• 149.137.24.110 (Japan Osaka)<br><br>Meeting ID: 992 8285 1029<br>Passcode: 818322</span></div></td></tr><tr><td style="font-size:0px;padding:0px 0px 24px;text-align:left;word-break:break-word"><div style="font-family:Roboto,sans-serif;font-style:normal;font-weight:400;font-size:14px;line-height:20px;letter-spacing:0.2px;color:rgb(60,64,67);text-decoration:none" role="presentation"><table border="0" cellpadding="0" cellspacing="0" role="presentation" style="padding-bottom:4px"><tbody><tr><td><h2 style="font-size:14px;color:rgb(60,64,67);text-decoration:none;font-weight:700;margin:0px;padding:0px">Location</h2></td></tr></tbody></table><span><span style="font-family:Roboto,sans-serif;font-style:normal;font-weight:400;font-size:14px;line-height:20px;letter-spacing:0.2px;color:rgb(60,64,67);text-decoration:none">NSH 4201, Newell-Simon Hall, Hamerschlag Dr, Pittsburgh, PA 15213, USA</span><br><a href="https://www.google.com/maps/search/NSH+4201,+Newell-Simon+Hall,+Hamerschlag+Dr,+Pittsburgh,+PA+15213,+USA?hl=en" style="display:inline-block;color:rgb(26,115,232);text-decoration:none;font-weight:700" target="_blank">View map</a></span></div></td></tr><tr><td style="font-size:0px;padding:0px 0px 24px;text-align:left;word-break:break-word"><div style="font-family:Roboto,sans-serif;font-style:normal;font-weight:400;font-size:14px;line-height:20px;letter-spacing:0.2px;color:rgb(60,64,67);text-decoration:none" role="presentation"><table border="0" cellpadding="0" cellspacing="0" role="presentation" style="padding-bottom:4px"><tbody><tr><td><h2 style="font-size:14px;color:rgb(60,64,67);text-decoration:none;font-weight:700;margin:0px;padding:0px">Guests</h2></td></tr></tbody></table><div style="padding-bottom:4px;text-align:left;color:rgb(60,64,66)"><div><span><span><a style="display:inline-block;color:rgb(60,64,67);text-decoration:none" href="mailto:pmowar@andrew.cmu.edu" target="_blank">Peya Mowar</a></span></span><span style="color:rgb(112,117,122);text-decoration:none"> - creator</span></div><div><span><span><a style="display:inline-block;color:rgb(60,64,67);text-decoration:none" href="mailto:calua.pataca@gmail.com" target="_blank">calua.pataca@gmail.com</a></span></span><span style="color:rgb(112,117,122);text-decoration:none"></span></div><div><span><span><a style="display:inline-block;color:rgb(60,64,67);text-decoration:none" href="mailto:hkelley@andrew.cmu.edu" target="_blank">Heather Kelley</a></span></span><span style="color:rgb(112,117,122);text-decoration:none"></span></div><div><span><span><a style="display:inline-block;color:rgb(60,64,67);text-decoration:none" href="mailto:fje@andrew.cmu.edu" target="_blank">Frank Elavsky</a></span></span><span style="color:rgb(112,117,122);text-decoration:none"></span></div><div><span><span><a style="display:inline-block;color:rgb(60,64,67);text-decoration:none" href="mailto:accessibility-lunch@lists.andrew.cmu.edu" target="_blank">accessibility-lunch@lists.andrew.cmu.edu</a></span></span><span style="color:rgb(112,117,122);text-decoration:none"></span></div></div></div></td></tr></tbody></table></td></tr></tbody></table></div></td></tr></tbody></table></td></tr></tbody></table></span></span></div></div></blockquote></div>