[Access Lunch] Monday Dec 4: Oscar Romero Lopez talk

[Brigitte Schmidt]

Hi Everyone,

I’ll actually be in Pittsburgh for this talk!
I know our room is Location: NSH 4201 but what is our zoom link?

Thank you so much.
Vera Schulz

> On Dec 1, 2023, at 6:25 PM, Aaron Steinfeld <steinfeld at cmu.edu> wrote:
> 
> 
> Hi everyone,
> 
> Oscar will be presenting some work from our lab on Monday:
> 
> "Independent Navigation and Interaction for Visually Impaired Users via AR, Computer Vision, and LLMs"
> 
> Abstract
> 
> Navigating unfamiliar indoor environments and interacting with objects are challenging for people who are blind or low-vision (pBLV). In this talk, I describe a functional prototype for smartphone-based, indoor navigation via a conversational assistant for pBLV. The prototype utilizes a cognitive architecture to integrate three different technologies: real-time object/people detection for obstacle avoidance
> 
> and discovery; augmented-reality spatial anchors for high-precision localization and virtual content interaction; and large language models (LLMs) for information extraction, conversational interaction, and turn-by-turn navigation. We assessed the individual and collective impact of different technologies through a human performance analysis where task performance time for a user is measured. We conclude that conversation helps holistically integrate disparate technologies to deliver a better, more context-aware user experience while remarkably reducing task completion time.
> 
> _______________________________________________
> Accessibility-lunch mailing list
> Accessibility-lunch at lists.andrew.cmu.edu
> https://lists.andrew.cmu.edu/mailman/listinfo/accessibility-lunch