Voices of VR

The Theater application for the Apple Vision Pro by Sandwich Vision launched in June 2024 with the spatial livestreaming of John Gruber's live interview of Apple Executives at WWDC. They have been collaborating with independent producers of spatial video to distribute rentals and purchases of immersive content spanning across stereoscopic 180-videos to educational planetarium content to more experimental dome content as well as stereoscopic captures of live music performances (I can highly recommend checking out Fungi: Web of Life by K2 Studios). Users can also connect their private collections of movies via Plex Media Servers to enjoy their own private movie collection in a virtual home theater experience with a number of different theater options. They're also currently implementing social features, and may start having live screenings of classic movies with potential collaborations with independent movie theaters. I had a chance to catch up with Sandwich Vision co-founder Adam Lisagor to hear a bit more about his journey into the XR space, how he's blended storytelling and technology throughout his career, as well as his hopes for what might be a new renaissance of spatial video content given Apple's emphasis of on 180-degree spatial video rather than the VR filmmaking era of 360-degree videos. This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

Corey Warning, co-founder of Rose City Games and director of Lovesick, shares insights from his decade in indie game development. He discusses the captivating, character-driven narrative of a post-punk band facing supernatural dilemmas in their bank's collapse. Corey elaborates on the innovative escape room mechanics and player immersion, blending nostalgia and challenges from the 90s music scene. He also touches on the balance of adult themes and accessibility in VR, highlighting how collaboration enhances storytelling in this unique game.

In a series of posts from February 8th to 11th, open source developer Matthieu Bucchianeri started making allegations that Meta's OVRPlugin is blocking non-Meta OpenXR runtimes, thereby undermining the open and interoperable spirit of OpenXR. He claims that "the OVRPlugin takes intentional precautions to exclude non-Meta platforms. This means that XR content developed with OVRPlugin will only work with Quest Link, and it will not work with any other runtime." Bucchianeri's allegation is that if a PCVR game includes Meta's OVRPlugin as their OpenXR middleware and doesn't implement the counter-blocking measures that he details, then PCVR users will only be able to use a Quest headset with Quest Link while other non-Meta headsets like "Pimax, Pico, Varjo, Vive" will be blocked, even if they have conformant OpenXR runtimes. Bucchianeri has validated these blocking counter-measures, and he says, "as proven with many applications using OVRPlugin with counter-measures enabled, these applications can run on a conformant OpenXR implementation." Not very many XR developers are willing to speak about these issues on the record, but I did manage to record a Voices of VR podcast interview with Virtual Desktop's Guy Godin who was able to independently corroborate many of the core allegations from Bucchianeri. Godin collaborated with Bucchianeri on the Virtual Desktop OpenXR (VDXR) runtime, but has also been receiving many complaints from PCVR users around Meta's OpenXR non-compliance issues, especially with games that launch both on Quest and PCVR and use Meta's OVRPlugin. Godin told me that games will work fine natively on the Quest, but any non-Quest headsets or if they aren't using Quest Link will be blocked on the PCVR version, unless the developer specifically implements anti-blocking counter-measures detailed by Bucchianeri in his technical write-up. It appears as though OpenXR conformance from the Khronos Group only pertains to the actual OpenXR runtimes on the hardware, but headset manufacturers are able to create their own SDK plug-in middleware that interfaces with OpenXR that doesn't have the same conformance requirements. It appears as though Meta is able to technically maintain their OpenXR runtime conformant status because it does not apply to their OVRPlugin middleware SDK solution, and Bucchianeri is claiming that Meta is undermining the normative standards of interoperability by not following the best practices from the Khronos Group. He says, "For the past several years, Khronos has come up with best practices and solutions to develop OpenXR applications and maximize cross-vendor and cross-platform interoperability. Khronos has asked XR developers all over the world to follow these best practices, however - Meta - the largest vendor in Khronos is refusing to follow these best practices." Bucchianeri is also claiming to have had private communications with Meta confirming that these were deliberate and intentional changes. He says, "This is not an accident: this concern was reported to Meta early in 2024 via official means in the Khronos group. Meta acknowledged purposedly blocking other platforms from running OpenXR content at that time." I was able to confirm in my discussion with Guy Godwin in this Voices of VR podcast episode that he also believes that these were deliberate and intentional changes to undermine the spirit of OpenXR. Part of why Bucchianeri was blowing the whistle is because the Khronos Group had not been taking any action against Meta. He describes Meta's actions as "reverting many of the improvements to the developers and users ecosystem that Khronos has spent time, money, energy into solving for the past 7 years." He says, "Unfortunately, since 2024, Khronos has refused to take actions to stop Meta’s OVRPlugin destructive initiative towards the PCVR ecosystem. By not taking any actions to resolve the issues created by Meta’s OVRPlugin, Khronos is sending the message that OpenXR is no lo...

Niantic launched their Into the Scaniverse application on Quest 3 on February 26th, 2025 that features over 50,000 Gaussian Spats from 120 different countries. They originally launched the WebXR version on December 10th, 2024 at IntoTheScaniverse.com, which was built using Niantic Studio (be sure to check out their comprehensive history of Gaussian Splats by Kirsten M. Johnson released at the same time). Users can use the Scaniverse mobile app on Android or iOS to capture, render, geotag, and upload their own Gaussian Splats onto the Into the Scaniverse mapps that can be viewed on either mobile phone or XR devices. I had a chance to speak more about Into the Scaniverse with Joel Udwin, who is Niantic's Director of Product for Niantic's AR, Research, Developer Platforms, and Scaniverse. Gaussian Splats are only about 1 year and a half old as the original "3D Gaussian Splatting for Real-Time Radiance Field Rendering" paper was presented at SIGGRAPH in August 2023, but it represents a new rendering pipeline for volumetrically captured content. Niantic's Into the Scaniverse apps are able to process and render these splats locally on the phone or Quest devices, and they have a lot of plans for how they will continue to utilize and develop this as a core part of their technology infrastructure and enabling new mixed reality applications. https://www.youtube.com/watch?v=NR51MrAtUM4 This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

HTC has launched Viverse platform that is aiming to become the YouTube of 3D Content. It's a platform that hosts 3D content and worlds built on PlayCanvas as well as many other open source technologies like WebXR, WebGPU, and VRM. It is sort of like a mix between VRChat with social worlds, 3D web crypto-based metaverse worlds, but also with some more enterprise embedding features as well. It's exciting to see this shift towards building out the open and interoperable metaverse, but in the context of this hybrid walled garden context that is built using open web technology stacks. It is also a hybrid in another way in that it is mostly consumer-facing but also has enterprise use cases like privately embedding of 3D content. I interviewed HTC's Andranik Aslanyan about the new VIVERSE platform, how they recruited over a hundred XR and WebXR developers to seed the content, and how VIVERSE fits into their overall strategy. I get some clarifications on the Android XR non-exclusive IP acquisition, and how VIVERSE fits into where HTC will be heading now that we're coming up on 10 years the HTC Vive was announced on March 1, 2014. This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

The latest Polys Ombudsperson of the Year is Ingrid Kopp, and previous winners Brittan Heller, Michaela Montagna, and myself gathered again on December 8 2024 to reflect on the current state of the XR industry as well as the specific ethical concerns about the intersection between XR and AI. We also speak about some of the power of storytelling to unpack some of these moral dilemmas, as well as tech policy in the context of the existing political climate, but also some of the broader and general trends of the XR industry. In my takeaways at the end, I also elaborate on the leaked memo from Meta CTO Andrew "Boz" Bosworth saying "We need to drive sales, retention, and engagement across the board but especially in MR. And Horizon Worlds on mobile absolutely has to break out for our long term plans to have a chance. If you don't feel the weight of history on you then you aren't paying attention. This year likely determines whether this entire effort will go down as the work of visionaries or a legendary misadventure." A lot of their Meta's commitment to XR seems to be directly tethered to the success or failure of their own first-party app. Zuckerberg's AR/VR Strategy memo from 2014 leaked to TechCrunch by Blake Harris now seems particularly prescient: "for now keep in mind that we need to succeed in building both a major platform and key apps to improve our strategic position on the next platform. If we only build key apps but not the platform, we will remain in our current position. If we only build the platform but not the key apps, we may be in a worse position." Zuckerberg later elaborates that apps and experiences are their top priority in XR: "I think you can divide the ecosystem into three major parts: apps / experiences, platform services and hardware / systems. In my vision of ubiquitous VR / AR, these are listed in order of importance." As time has passed, it's become more and more clear that the success of Meta's Horizon worlds may be directly tethered to Meta's overall commitment to the XR industry. Just yesterday, Meta announced a $50 million dollar fund for Meta Horizon World creators, with special awards for mobile: "By investing in mobile content, we can reach a lot of new people who don’t yet own a Quest headset and ultimately grow the pie for everyone. That’s why, as part of our $50 million Creator Fund for creators of mobile and MR worlds, we’re also announcing our first creator competition of the year with a focus on mobile." UploadVR did a really great follow-up report about "From Quest To Horizon: How Meta's Shifting Priorities Are Affecting Developers" that includes many anonymous statements from XR developers talking about the impact of Meta's shifting priorities. This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

Oliver Kadel's 1618 Digital specializes in spatial audio sound design and engineering across linear immersive storytelling and interactive immersive experiences. Kadel also co-hosts The Immersive Audio Podcast with Monica Bolles, and I was recently featured in episode #109. I sat down with Kadel to get a survey of some of the spatial audio formats and production pipelines ranging from 3rd order ambisonics, object-oriented audio in game engines, working with the audio formats for Apple Immersive Video, Dolby Atmos, MPEG-H Audio, and emerging open standards like the Immersive Audio Model & Format (IAMF), which is "an audio container specification designed to revolutionize immersive audio experiences across a wide range of applications, including streaming, gaming, augmented reality (AR), virtual reality (VR), and traditional broadcasting." We talk about some of his favorite immersive audio productions, his process of getting a Ph.D. studying the impact of spatial audio on cognitive load, and some of the future trends of spatial audio.

The Khronos Group is working on a new open standard tentatively called the glTF External Reference Format (or glTFx for short), which will allow users to add multiple glTF assets to a single scene. This used to be called the "glTF Experience Format (glXF)," and the final name is still being finalized. This will enable new capabilities that are not possible by using glTF itself to contain other glTF assets, which includes is level-of-detail (LoD) management, asset-based lighting Management, and billboarding. The Khronos Group continues to translate the core functionality of game engines into various open standards, and are also working towards finalizing glTF extensions for interactivity as well as for physics. I did a deep dive with Khronos 3D Formats Working Group Chairman Alexey Medvedev (AR Tech Lead at Meta/Facebook), and 3D Formats Working Group Vice Chairman Dan Frith (Chief Creative Officer at London Dynamics) to unpack all of the latest news about glTF and glTF External Reference Format. . This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

I dig into my archives to unpack the one-on-one, immersive theatre piece that I saw online back in 2021 called TM that used a Socratic dialectic to interrogate you as you're going through a process of joining an imaginary cult. I spoke with Ontroerend Goed's artistic director Alexander Devriendt to get a lot more context for how he designs immersive theatre productions for folks who typically don't like immersive theatre. This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality

VR filmmakers Joe Hunting and Max Willson are premiering their short documentary film The Reality of Hope at the Sundance film festival this week (online tickets are still available here from Jan 30 to Feb 2 and it'll also be available later this year on Documentary+). Hunting's previous film We Met in Virtual Reality also premiered at Sundance in 2022 and got picked up by HBO, and he's continuing to document very human stories that are rooted within the context of virtual culture. The Reality of Hope is shot both in VRChat and physical reality as it tells the beautiful and inspiring story of Photographotter traveling across the world to donate a kidney to his friend Hiyu, who he met within the furry community in VR. Hiyu is a world builder and avatar creator who has been a part of the team that has created some truly spectacular worlds as a part of the Furality conference (See the full list of worlds listed down below). Facing kidney failure, Hiyu turned to social media asking for help seeking a donor, which caught Photographotter's attention who then privately reached out. Photographotter documented the ups and downs of his inner journey in a VTuber video blog series, and The Reality of Hope fills in a lot of the gaps for the broader Furality community, the worlds that Hiyu has built, and the nuances of their friendship in hospitals of Stockholm, Sweden as the organ donor process requires a three-month commitment. The Reality of Hope is a beautifully-told story that shows the power of VR to forge deep and meaningful connections that proved to be literally life-saving. VRChat Worlds featured in The Reality of Hope Furality Aqua: The Oceans of Luma by Furality Sylva: Treehouse Village at Night by Furality Luma: Crystal Forest by Furality Sylva: Lahaina Springs by Furality Umbra: Village of Umbra by Furality (video) Furality˸ F․Y․N․N․'s Gym by Furality VR Yoga by Castiel先生 Exoplanet Journey by Niko* Tanuki Tunesǃ - タヌキトゥーンズ by Juno Tanuki Photographotters House V2 - by Photographotter https://www.youtube.com/watch?v=pVMSZ30_FMY This is a listener-supported podcast through the Voices of VR Patreon. Music: Fatality