Michael Abrash, Chief Scientist of Reality Labs Research, shares insights from a decade of innovation in virtual and augmented reality. He discusses groundbreaking technologies like hand tracking and pancake lenses that have reshaped Meta's products. The conversation dives into challenges of developing full AR glasses, including power and weight constraints. They reflect on the evolution of consumer expectations, the impact of AI on tech, and the influence of science fiction in driving future innovations.
The podcast emphasizes the importance of proactive engagement in advancing VR and AR technologies to maximize their transformative impact across various aspects of life.
A key theme discussed is the evolution of tech development from software-centric constraints to a crucial interplay between hardware and software for effective innovation.
Deep dives
The Impact of Virtual and Augmented Reality Technologies
Virtual and augmented reality (VR and AR) technologies hold significant transformative potential beyond their traditional associations with gaming. The discussion emphasizes how innovative figures in the industry, such as Michael Abrash, have broadened perspectives on these technologies, encouraging a focus on their wider applications. These insights suggest that the true power of VR and AR lies in their capability to reshape various facets of life, making it essential for industry leaders to actively engage in pioneering these advancements rather than waiting for others. This proactive approach is highlighted as crucial for realizing the full impact of VR and AR on the world.
Evolution of Hardware and Software Interplay
The conversation reveals the historical evolution of technology from purely software challenges to a complex interplay between hardware and software. As advancements in hardware emerge, particularly in the realm of graphics and display technologies, they necessitate corresponding innovations in software to effectively utilize these capabilities. The podcast discusses how the transition from highly constrained environments on mobile devices demands a rediscovery of optimization techniques once common in older systems. This evolution underscores the need for developers to be not only adept at programming but also deeply aware of hardware limitations and opportunities.
Lessons from the First Decade of VR and AR Development
Reflecting on the past ten years, a key takeaway is the gradual nature of progress in VR and AR technologies, likened to the historical development of personal computers. The acquisition of Oculus by Mark Zuckerberg marked a pivotal moment that translated these technologies from niche hobbies to mainstream applications, which has since shaped consumer expectations. Notably, advancements like hand tracking and touch controllers have shifted user interaction paradigms, enabling more intuitive engagement with virtual environments. Acknowledging the challenges in this journey is essential, as each breakthrough often requires overcoming substantial technical hurdles in both hardware and user experience.
Future Prospects and Challenges Ahead
Looking towards the future, the podcast presents an exciting vision where the integration of contextual AI with AR technologies may fundamentally reshape user interactions. Emerging smart glasses equipped with always-on sensing capabilities could provide users with proactive, intuitive assistance by understanding their contextual needs. Despite this optimism, significant challenges remain, primarily related to display technologies, which dictate the feasibility of lightweight, energy-efficient devices. The conversation emphasizes that while the possibilities are expansive, the underlying technological hurdles must be navigated thoughtfully to unlock the next generation of immersive experiences.
In today’s episode, our host, Meta CTO and Head of Reality Labs Andrew “Boz” Bosworth, is joined by our very own Reality Labs Research Chief Scientist Michael Abrash.
They cover a range of topics, from the progress Reality Labs Research has made through a decade of exploring and prototyping novel ideas, to the technologies it’s brought to Meta’s products in-market, like hand tracking, pancake lenses, and spatial audio. They take a look back at some of the biggest developments of the last 10 years—including Touch controllers and inside-out tracking—and look ahead to the next decade on the horizon.
They discuss the difficult but exciting challenges that lie ahead in building the next generation of computing devices, including full AR glasses with an immersive display. There’s a need to work within compute, power, thermal, and weight constraints, all while pioneering and miniaturizing new technologies to fit in a socially acceptable form factor.