Justin Searls discusses Apple's AI advancements at WWDC, Vision Pro Life, and hopes for future Apple devices. They explore Microsoft's CoPilot, password managers, MacOS Sequoia, Apple Cash privacy, and spatial photos with VR experiences. A chat on Apple-Linux compatibility and insights into Apple's keynote, Swift's 10th anniversary, and Vision Pro usage wrap up the episode.
Apple integrates AI seamlessly for user-centric interactions with AirPods Pro.
Enhancing user experience with Apple Vision Pro's spatial photography feature.
Apple Vision Pro enables shared experiences like remote movie-watching sessions.
Spatial computing offers lifelike interactions through augmented reality on Vision Pro.
VisionOS faces ergonomics challenges but aims to enhance user experience with new updates.
Deep dives
User Feedback Widget Feature in Sentry
Sentry's product manager Jasmine Cassis discusses the new user feedback widget feature that allows developers to capture user feedback directly on the front end of a website, enhancing the connection between developers and end users. This feature complements Sentry's automatic bug detection by capturing the additional 20% of bugs that may not be automatically detected, providing valuable insights for developers to improve user experience.
Personal Experiences in Japan
Justin Searls shares his recent experiences in Japan, including language learning, exploring different cities, and attending the Ruby Kage conference. He emphasizes maximizing language practice and savoring the local cuisine, especially along the Japan Sea coast known for its seafood. Justin also mentions his appreciation for the Japanese language and highlights the immersive experiences he enjoys while traveling in Japan.
Apple's Keynote on AI and Product Updates
Apple's recent keynote unveils advancements in AI integration, particularly in the context of device interactions and user experience. The focus on user-friendly features like nodding to confirm actions with AirPods Pro showcases Apple's commitment to enhancing user convenience. Additionally, the podcast discusses the strategic alignment with OpenAI for backend models and the nuances of ensuring plausible deniability in AI applications.
Innovative Use of AirPods Pro for Interaction
The demonstration of using AirPods Pro for simple gestures like nodding or shaking one's head to interact with notifications and calls highlights Apple's emphasis on user-centric design. This innovation enhances user experiences by providing discreet and intuitive ways to manage tasks without verbal communication, offering a seamless and convenient interaction with devices in various settings.
New Features and Gestures
Vision OS 2 introduces new gestures for Apple Vision Pro users, enhancing the user experience. These gestures mirror those on Quest 2 or 3, enabling hands-only control. Flipping a hand down reveals the time and access to control center, streamlining access to key features. Additionally, a recent guest user feature is hinted at, providing a more seamless experience for returning users, possibly akin to spouse mode.
Spatial Photography and Shared Experiences
Apple Vision Pro's Vision OS 2 brings the concept of spatial photography, allowing users to view 2D photos in a 3D spatial format through ML magic. This feature offers a unique perspective, enhancing visual experiences. Moreover, SharePlay functionality extends to photos, enabling users to engage in shared experiences, like viewing photos together and commenting simultaneously, fostering a more interactive and collaborative user experience.
Potential for Remote Shared Activities and Entertainment
The podcast discusses the potential for shared activities and entertainment through Apple Vision Pro devices. Exploring the idea of remote shared movie-watching experiences akin to MST 3000, the hosts consider leveraging the device for joint viewing sessions. Concepts like remote podcasting and synchronized TV show viewing highlight the device's versatility for fostering shared experiences and boosting user engagement.
Spatial Computing and Shared Experiences
Spatial computing offers unique shared experiences despite physical distance, making interactions more lifelike than traditional methods. Through augmented reality, interactions feel more personal, with visuals appearing seamlessly in front of users, enhancing the feeling of being present together, like playing a game where the board and players' positions are clear. This spatial setting eliminates obstructions and additional equipment, offering a natural and immersive shared experience.
Potential Challenges and Future Directions in VisionOS
VisionOS faces ergonomics challenges such as keyboard invisibility in immersive environments and limited Bluetooth device compatibility. While software updates like VisionOS 2 aim to address these issues by rendering keyboard visuals and enabling Bluetooth mouse connections, user preferences and interruptions remain factors affecting usability. The podcast discusses the aspiration for an ultra wide virtual Mac display, equating it to two 4k displays to meet user demands for seamless and expansive visual experiences. Integrating Linux compatibility on Apple Silicon Macs as a wishful option is raised, highlighting the potential for broader platform support and increased user flexibility beyond traditional operating systems.
Justin Searls joins us for hot takes on Apple’s 2024 WWDC keynote. Apple Intelligence stole the show, but did it steal our hearts? Oh, and we learn all about Justin’s Vision Pro Life and how he hopes/expects Apple’s latest device to improve in future iterations.
Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!
Sponsors:
Sentry – Code breaks, fix it faster. Don’t just observe. Take action. Sentry is the only app monitoring platform built for developers that gets to the root cause for every issue. 90,000+ growing teams use sentry to find problems fast. Use the code CHANGELOG when you sign up to get $100 OFF the team plan.
1Password – Build securely with 1Password - 1Password simplifies how you securely use, manage, and integrate developer credentials. Manage SSH keys and sign Git commits. Access secrets stored in 1Password. Automate administrative tasks. Integrate with third-party tools. Also, check out our INFRASTRUCTURE.md file for more details on how we do secrets with 1Password.
Cronitor – Cronitor helps you understand your cron jobs. Capture the status, metrics, and output from every cron job and background process. Name and organize each job, and ensure the right people are alerted when something goes wrong.
