At the NVIDIA GTC event, NVIDIA unveiled its latest innovation: bringing OpenUSD-based Omniverse enterprise digital twins to the Apple Vision Pro. The company announced a new software framework that enables developers to seamlessly transfer their Universal Scene Description (OpenUSD) industrial scenes to the NVIDIA Graphics Delivery Network (GDN).
This global network, equipped to stream advanced 3D experiences, now supports Apple Vision Pro. In a striking demonstration, NVIDIA showcased an interactive, highly detailed digital twin of a car, displayed in full fidelity on the high-resolution screens of the Apple Vision Pro. The showcase featured a designer utilizing a car configurator application from CGI studio Katana, navigating through various design options directly within the Omniverse platform. This marks a significant step in blending photorealistic 3D environments with the physical world through spatial computing.
Enhancing Immersive Experiences with RTX Cloud Rendering in Spatial Computing
Spatial computing has become a critical technology for creating immersive experiences that allow seamless interaction among people, products, and physical spaces. The technology demands high-resolution displays and powerful sensors that operate at substantial frame rates to ensure manufacturing simulations are as close to reality as possible.
The recently introduced workflow leveraging the Omniverse platform utilizes the groundbreaking high-resolution displays of the Apple Vision Pro, integrated with NVIDIA’s advanced RTX cloud rendering. This combination provides spatial computing experiences requiring only the device and an internet connection. Through this innovative cloud-based method, users receive real-time, physically accurate renderings directly to the Apple Vision Pro, ensuring the delivery of high-quality visuals without losing the integrity of large-scale, engineering-grade datasets.
 the significance of combining Apple Vision Pro’s ultra-high-resolution displays with NVIDIA’s photorealistic renderings of OpenUSD content. He highlighted this synergy as unlocking unparalleled opportunities for the enhancement of immersive experiences, suggesting a transformative impact on how designers and developers create engaging digital content. – MIKE ROCKWELL, Vice President of the Vision Products Group at Apple
This innovative workflow introduces the concept of hybrid rendering, a revolutionary technique that merges local and cloud-based rendering. This allows for creating fully interactive experiences within a single application, using Apple’s SwiftUI and Reality Kit, while NVIDIA’s Omniverse RTX Renderer facilitates streaming from the Global Delivery Network (GDN).
GDN, with its presence in over 130 countries, leverages the company’s extensive cloud-to-edge streaming infrastructure to ensure smooth, high-fidelity interactive experiences. This system efficiently manages the computational demands of rendering, accommodating the most challenging scenarios irrespective of dataset size or complexity.
Rev Lebaredian, NVIDIA’s Vice President of Simulation, remarked on the Apple Vision Pro as the pioneering untethered device that empowers enterprise customers to achieve their visions without constraints. He expressed anticipation for users to leverage these exceptional tools.
Broadening the Scope of Spatial Computing Applications
The workflow derived from the Omniverse platform has demonstrated its versatility across various applications. It enables designers to visualize their 3D projects with unparalleled clarity, ensuring no compromise in quality or detail reduction. Such precision allows for creating reliable simulations that mirror the physical product, fostering innovation in e-commerce and other digital experiences.
Within industrial design, the technology affords factory planners the ability to fully engage with comprehensive engineering datasets of their facilities. This access facilitates the refinement of operational processes and the identification of efficiency barriers.
In addition, NVIDIA is actively developing tools to enhance the utility of the Apple Vision Pro for developers and independent software vendors. These advancements aim to integrate smoothly with the device’s native capabilities, enabling users to interact effortlessly with their existing data through their applications. This initiative represents a significant step toward enriching the spatial computing ecosystem, offering developers the resources to push the boundaries of digital interaction.
FAQs
1. What is the NVIDIA Omniverse platform?
The NVIDIA Omniverse platform is a versatile development environment designed for creating and operating real-time, photorealistic simulations and digital twins. It facilitates seamless collaboration among designers and developers by allowing the integration and streaming of complex 3D models and environments across various applications and devices.
2. How does the Apple Vision Pro integrate with NVIDIA Omniverse?
Apple Vision Pro integrates with NVIDIA Omniverse through a new software framework that enables streaming high-fidelity, real-time 3D experiences from the Omniverse platform to the Vision Pro’s high-resolution displays. This integration leverages NVIDIA’s RTX cloud rendering technology and the Omniverse Cloud APIs to deliver immersive spatial computing experiences directly to the user.
3. What are the benefits of combining NVIDIA’s RTX cloud rendering with Apple Vision Pro’s displays?
Combining NVIDIA’s RTX cloud rendering with Apple Vision Pro’s ultra-high-resolution displays offers unparalleled visual fidelity in spatial computing experiences. This synergy delivers photorealistic, physically accurate renderings and simulations directly to the Vision Pro, enabling users to experience detailed, immersive digital environments without the need for powerful local computing resources.
4. How does this technology impact designers and developers?
This technology empowers designers and developers to create and interact with high-fidelity digital twins and simulations in real time, enhancing the design and development process across various industries. It provides a platform for building and experiencing immersive, photorealistic digital environments, opening up new possibilities for e-commerce, industrial design, and digital content creation.
5. What does the introduction of hybrid rendering mean for users?
Introducing hybrid rendering means that users can now experience fully interactive 3D applications that combine local and cloud-based rendering. This approach enhances the performance and visual quality of spatial computing experiences on devices like the Apple Vision Pro, enabling smoother, more detailed, and more immersive digital interactions.
6. Is NVIDIA’s Global Delivery Network (GDN) essential for streaming these experiences?
NVIDIA’s Global Delivery Network (GDN) is crucial for streaming high-fidelity, interactive 3D experiences to devices like the Apple Vision Pro. GDN leverages NVIDIA’s extensive cloud-to-edge streaming infrastructure to deliver smooth, interactive experiences globally, ensuring that users can access complex renderings and simulations without significant latency or loss of quality, regardless of the dataset’s size or complexity.
