Android XR Is Google’s Final Shot to Overthrow Meta’s AR, VR

Earlier this year, Meta built the ‘Android’ of AR/VR devices. But its biggest competitor, Google, took one notch up and beat them in the game by releasing Android XR, integrating AI, AR, and VR for innovative headset and glasses experiences. The tech giant partnered with Samsung for this product.

The first extended reality (XR) headset, codenamed Project Moohan, is expected to debut next year. Google expects more hardware devices, including glasses, to adopt Android XR in the future.

Google said it wants to offer a variety of stylish and comfortable glasses that not only people would enjoy wearing daily but also work seamlessly with other Android devices.

Introducing Android XR, our new platform for headsets and glasses built for the Gemini era pic.twitter.com/CBLaFGUwez

— Google (@Google) December 12, 2024

This headset will allow users to effortlessly transition between virtual spaces and the real world. Google Gemini offers natural conversations to assist users in interacting with devices, planning, researching, and completing tasks.

In a recent interview, Google DeepMind chief Demis Hassabis shared that the company is exploring new form factors and devices for more intuitive AI interactions. Using cooking as an example, Hassabis pointed out that hands are often occupied, and while seeking advice from AI agent Astra, one would prefer a wearable device that they wouldn’t have to hold.

Google’s track record with AR/VR has been less than favourable. Last year, the tech giant cancelled its ‘Project Iris’, while Google Glass was effectively discontinued in January 2015. 

However, with Android XR, Google is attempting a comeback in this category. This time, the tech giant is taking a different approach. Instead of focusing on hardware, the company is developing an operating system similar to what Meta is pursuing with its Horizon OS.

“Played around with the Android XR simulator. Seems like a great foundation for a spatial OS, much more so than Horizon OS, in my opinion. Overall, spatial aspects are quite similar to visionOS, which is a good thing,” Dylan McDonald, owner of Sun Apps LLC, said in a post on X.

“Android XR worked well in my tests on the Samsung headset, but the interface is essentially an ‘Android-ified’ version of visionOS. I think most consumers wouldn’t even be able to tell them apart. It can also run phone/tablet apps from Google Play,” Bloomberg journalist Mark Gurman, who tested the product, said.

Android XR is supported by tools like ARCore, Android Studio, Jetpack Compose, Unity, and OpenXR, making it easier for developers to create apps for upcoming devices. “Literally all AndroidXR has to do to win is be more open than visionOS and be less predatory than Meta,” a user said on X. 

Astra’s Advantage

This time, Google has gained an edge with Astra, its smart assistant that processes text, voice, images, and video. The assistant allows it to understand and respond to situations more naturally and in real-time. 

In the latest Project Astra demo video, Google introduced its new glasses, equipped with a camera, and an internal display and always connected to Astra for instant information. Interestingly, these glasses can also recall things one does and says.

Google isn’t alone in this competition. Meta is already all-in with its Ray-Ban Meta glasses. According to Yann LeCun, Meta’s chief AI scientist, smartphones are expected to be replaced by augmented reality glasses in the next 10-15 years. 

Notably, during his recent trip to India, he used these glasses to take selfies and photos and was also spotted wearing them in various public appearances.

Moreover, at Meta Connect 2024, the social media giant unveiled Orion, which Meta chief  Mark Zuckerberg described as “the most advanced AR glasses the world has ever seen”. The company also launched the Quest 3S VR headset, priced at $299.99 – almost half the price of its predecessor Quest 3.

Meanwhile, Apple hasn’t been able to taste much success with its Apple Vision Pro. According to a report, Apple has sold fewer than 5 lakh units of the device, with many buyers using it less than Apple had hoped for.

On a recent Y Combinator (YC) Podcast, Dianu Hu, a group partner at YC, discussed how the hardware in AR/VR glasses must become more lightweight, a factor she feels is hindering their popularity. “There are actually constraints with physics to fit all that hardware into such a small form factor. Fitting enough computing power and optics is just super challenging”

“There’s still more actual engineering and physics that needs to be discovered, and that’s it. I think the algorithms are there, but it’s just lots of really hard hardware and optics problems,” she added. 

Will OpenAI Join the Race?

Many expect OpenAI to announce a hardware device soon, as the company is collaborating with legendary former Apple design chief Jony Ive. 

Ive’s design firm, LoveFrom, which he co-founded after leaving Apple in 2019, is working on the initiative. Currently, it is in its early stages with a small team of about ten people, including former Apple designers Tang Tan and Evans Hankey, who played key roles in developing the iPhone.

OpenAI recently launched its advanced voice mode with vision, which appears to be the next logical step if the company intends to enter the AI hardware market. So far, no company has fully succeeded. While startups like Rabbit and Humane AI have emerged, they have been struggling to win over customers.