Developers can create immersive and interactive experiences with the Vision Pro SDK, utilizing 2D and 3D interfaces for a seamless user experience.
The Vision Pro SDK introduces three key building blocks - windows, volumes, and spaces - that offer developers the tools to create compelling and interactive applications.
While the Vision Pro SDK brings exciting possibilities, challenges arise in designing apps without firsthand experience with the device, emphasizing the importance of labs and real hardware testing.
Deep dives
Vision Pro SDK: A New Frontier for Developers
The Vision Pro SDK offers a new and exciting opportunity for developers to create immersive and interactive experiences. With the introduction of Windows, volumes, and spaces, developers can create 2D and 3D interfaces that provide a seamless and intuitive user experience. The SDK provides tools and resources to easily build 3D apps, even for developers with limited experience in 3D development. The addition of hand tracking and spatial awareness further enhances the possibilities for creating unique and engaging applications. While there may be challenges in designing for a device that hasn't been experienced firsthand, the technological advancements and opportunities for creativity make the Vision Pro SDK an exciting platform for developers to explore.
Building Blocks: Windows, Volumes, and Spaces
The Vision Pro SDK introduces three key building blocks: windows, volumes, and spaces. Windows provide the familiar 2D interface that can also incorporate 3D elements. Volumes, on the other hand, are 3D windows that cannot be resized by the user. They serve as containers for 3D content, such as a dice tray or a chessboard. Spaces offer fully immersive experiences, allowing developers to create AR and VR experiences. Spaces provide more control over the user's environment, including hand tracking and the ability to detect surfaces in the room. While limitations exist, such as a fixed play area in immersive spaces, the building blocks of Vision Pro offer developers the tools to create compelling and interactive applications.
Early Impressions and Challenges
As a developer, the announcement of the Vision Pro SDK has brought excitement and new possibilities. The hardware seems advanced and the integration with SwiftUI and RealityKit makes it easier to incorporate 3D content. However, challenges are encountered in designing apps without firsthand experience with the device. Testing apps in a simulator provides some insights, but the lack of real hardware adds complexity to building fully immersive 3D apps. The simulator allows for the creation of traditional apps and some 3D elements, but the full potential of Vision Pro can best be realized when working with the actual device. Labs provide an opportunity to explore and learn from experts, and while obtaining access to developer kits may be competitive, the long lead time suggests Apple's commitment to preparing the developer community for this new frontier.
Looking Ahead: The Future of Vision Pro
The Vision Pro SDK opens up a new world of possibilities for developers. While the initial apps may be familiar with added 3D elements, the true potential of Vision Pro lies in creative and immersive experiences. As developers explore the capabilities of spaces, they can transcend traditional interfaces and build full AR and VR experiences. The future may bring advancements in hardware and software, offering more intuitive and seamless interactions. The pursuit of fully customized hand tracking and improved environmental awareness may redefine how users engage with digital content. Exciting opportunities lie ahead as developers embrace the Vision Pro SDK and push the boundaries of what is possible.
Introducing the VisionOS Simulator: A 3D Environment for App Testing
The podcast episode discusses the new VisionOS simulator introduced by Apple. Unlike previous simulators, VisionOS offers a 3D environment for testing apps. The simulator features different rooms, including a small apartment and a museum, which users can navigate through. The controls allow users to click and pan their view around the rooms. The episode speculates on the possibility of using a game controller to enhance navigation. However, the usefulness of this feature is questioned, as most app development tasks do not require moving around the simulated environment.
Transitioning iPad Apps to VisionOS: Compatibility and Challenges
The episode highlights the ease of transitioning existing iPad apps to VisionOS. Developers can run their apps in the VisionOS simulator with minimal effort. However, some restrictions exist, such as running in light mode only and fixed window size. The episode also mentions limitations for specific app functionalities, like AR and SpriteKit, which may need to be redesigned. SwiftUI apps are expected to adapt better to VisionOS due to their flexible UI rendering. Developers are advised to prioritize adapting their apps to VisionOS gradually and consider the potential user experience in a 3D volume or space.
Federico, Stephen and Myke are joined by James Thomson to talk about the visionOS SDK and what apps may be like when the platform launches early next year. Other topics include laundry symbols, the return of Ridiculous Fishing and more.
This episode of Connected is sponsored by:
CleanMyMac X: Your Mac. As good as new. Get 5% off today.
Sofa: Be more intentional with your downtime. Get 45% off an annual subscription to Super Sofa.
Notion: Do your most efficient work with Notion Projects. Try it free today.
