Samsung’s big answer to the Apple Vision Pro is here. I have to try it

You can already use Google Maps to virtually “explore” a city on the other side of the world without leaving your seat. But what if you could go further and feel like you were inside the map? What if you could learn about the local restaurant or a landmark in the distance just by looking at it and asking?

This ability to view apps on a much larger virtual screen and talk with a digital assistant that can see what you see is one of the touted features of the Galaxy XR, Samsung’s new mixed reality headset, which launched October 21 for $1,800. Samsung is one of several tech companies that have attempted to make virtual and augmented reality headsets as ubiquitous as smartphones and laptops, although these devices remain a niche market primarily appealing to early adopters, tech enthusiasts and gamers.

This includes Apple’s $3,500 Vision Pro headset, which has struggled to attract developers And resonate with buyersaccording to reports from the Wall Street Journal and Bloomberg. Apple and Samsung devices seek to establish a new type of headset that offers different levels of immersion, from virtual screens to digital environments that completely envelop the user’s field of vision.

Samsung hopes its latest headset, developed in partnership with Google, will appeal to consumers thanks to the implementation of the search giant’s Gemini assistant. The digital assistant is integrated into the headset’s operating system, meaning it can answer questions about the content displayed in the device.

The new headset is not only Android’s first big rival to the Vision Pro, but Samsung and Google are betting on what could be the next evolution of the personal computer, as tech giants race to supplant the smartphone with new AI-powered gadgets.

“It takes you closer to this kind of sci-fi Jarvis scenario of having a digital assistant that can really be a companion alongside you, understand your context and you can invoke actions as simply as having a conversation,” Shahram Izadi, vice president and general manager of the Android XR software powering the headset, told CNN in an interview.

Like Apple’s Vision Pro headset, Samsung’s headset is aimed at productivity and entertainment. Users can view Android apps on a virtual screen much larger than a TV or computer monitor. Some apps also work differently than you would on a smartphone; Images and videos from Google Photos can be viewed in 3D, like spatial photos from Vision Pro.

Navigating the software involves the use of hand gestures and speech, although the headset also has a button to summon Google’s Gemini and a touchpad.

But what really sets Samsung’s headset apart is how it works with Gemini.

When I asked questions about photos like, “What part of the world does this tree grow in?” » or “What is the best time of year to go to this place?” Gemini not only responded but offered to book plane tickets.

I had a similar experience using Google Maps on the headset. As I wandered around New York, I asked Gemini about points of interest without having to specify the location since he knew what I was looking at. Users must choose to share their screen with Gemini before asking questions about the content they are viewing.

The headset was relatively light to wear during my roughly 30-minute demo, and it was easier to adjust the headband size compared to previous VR headsets I’ve tried. But it’s still much heavier than a pair of glasses, so it’s unclear how comfortable it will be to wear for extended periods of time.

The use of Gemini in the Galaxy Google has reoriented its Android smartphone software around this concept, with features like Circle to Search, which performs a Google search based on what’s displayed on your phone’s screen.

Yet Samsung and Google are grappling with a difficult question: Is there room for yet another gadget in people’s lives?

Virtual reality headsets haven’t taken off because the use case doesn’t justify the price for most people. While $1,800 is significantly cheaper than the Apple Vision Pro, it’s still a splurge for most households.

But Drew Blackard, senior vice president of mobile product management at Samsung Electronics America, said he thinks $1,800 could attract consumers who were not previously interested in virtual reality.

However, he acknowledged that this remains a high cost.

“Is it, you know, enough to drive mass market adoption? Probably not,” he said in a CNN interview. “You will probably see it diminish over time.”

Samsung and Google see the Galaxy XR headset as the starting point for a new wave of AI-powered glasses, including upcoming smart glasses.

Google is already thinking about future use cases: Gemini will one day be able to track a user’s expressions, Izadi said, although that feature is currently in the prototype stage. This could make talking with Gemini more natural, he said, which could be key for a product like the Galaxy XR, designed primarily for AI use.

“You can imagine a world where, by understanding the user’s emotions or expressions, you can respond accordingly,” he said. “Just like the conversations we have in the real world.”