The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) Inclusive Design for Seeing AI with Saqib Shaikh - #474
Apr 12, 2021
Saqib Shaikh, a Software Engineer at Microsoft and the lead for the Seeing AI Project, shares insights on his groundbreaking app that narrates the world for the visually impaired. He discusses its evolution from a hackathon project to a powerful tool, the technical challenges behind real-time machine learning, and the significance of user intent in enhancing interaction. Saqib also explores future innovations like smart glasses and the role of AI in promoting accessibility, emphasizing the balance between automation and user trust.
AI Snips
Chapters
Transcript
Episode notes
Seeing AI Origin Story
- Saqib Shaikh, blind since childhood, always loved technology and studied AI.
- He led Seeing AI, a Microsoft project originating from a hackathon, aiming to empower visually impaired individuals.
Seeing AI App Overview
- Seeing AI is an iPhone app described as a "talking camera".
- It offers various modes like reading text, recognizing faces, and detecting objects, tailored for the blind.
Prioritize User Control
- Prioritize user control in AI app design, especially when intent is complex.
- Automatic model selection can frustrate users if incorrect, so explicit user choice is often better.