At I/O 2022 in May, Sundar Pichai said that any mobile phoneYou can run the new Immersive View in Google Maps using "Google Cloud Immersive Stream" on a>.Google Cloud later detailed Immersive Stream for XR as a way for "users to have an immersive, interactive, and photo-realistic experience without downloading an app."
The company believes that mobile GPUs are still difficult to create sufficiently realistic images at this stage because they cannot provide an immersive experience, which requires desktop GPUs:
The phone here sends input events to our cloud service, such as camera poses, and our cloud service takes those camera poses and renders photorealistic using a powerful desktop-class GPUThe images are then streamed to the device as video frames. The device then takes those video frames and combines them with camera images to create an immersive and realistic experience for this particular car model.
Today, the Immersive Stream for XR platform is available on Android, iOS and the desktop web.The latter platform allows you to view 3D models in Safari and Chrome, while mobile is where you'll find AR modes that allow you to place objects in real space and adapt them to various environmental conditions, such as lighting.
Google said earlier this week that it was "actively developing an OpenXR client" to stream XR experiences to head-mounted displays (HMDs) compatible with the standard.XR immersive streaming on the headset will support VR mode and Stereoscopic Augmented Reality mode.