Meta Quest Pro

our-unbiased-take-on-mark-zuckerberg’s-biased-apple-vision-pro-review

Our unbiased take on Mark Zuckerberg’s biased Apple Vision Pro review

No way would Zuckerberg be photographed wearing a Vision Pro, but let's just imagine he's looking at a picture of one in his headset here...

Enlarge / No way would Zuckerberg be photographed wearing a Vision Pro, but let’s just imagine he’s looking at a picture of one in his headset here…

@zuck Instagram | Aurich Lawson

Since the launch of the Apple Vision Pro, it’s not been hard to find countless thoughts and impressions on the headset from professional reviewers and random purchasers. But among all those hot takes, the opinions of Meta CEO Mark Zuckerberg stand out for a few reasons—not least of which is that he and his company have spent years of development time and lost tens of billions of dollars creating the competing Quest headset line.

For that reason alone, Zuckerberg’s Instagram-posted thoughts on the Vision Pro can’t be considered an impartial take on the device’s pros and cons. Still, Zuckerberg’s short review included its fair share of fair points, alongside some careful turns of phrase that obscure the Quest’s relative deficiencies.

To figure out which is which, we thought we’d go through Zuckerberg’s review and give a quick review of the points he makes. In doing so, we get a good viewpoint on the very different angles with which Meta and Apple are approaching mixed-reality headset design.

There’s “high-quality” and then there’s “high-quality”

Near the start of his analysis, Zuckerberg says that the “Quest 3 does high-quality passthrough with big screens, just like Vision Pro.” This is only true in the most technical sense. Saying both headsets have “high-quality passthrough” is like saying an old 720p LCD TV and a new 4K OLED both have “high-quality screens.”

Compared side by side, Apple’s array of cameras and higher-resolution displays combine for a much sharper and more dynamic view of the “real world” than the Quest 3, which barely limps over the “good enough” passthrough threshold, in my experience. That display quality extends to the “big screens” Zuckerberg mentions, too, which are noticeably clearer and easier to read on the Vision Pro.

A view of my mixed reality

Enlarge / A view of my mixed reality “office” in the Quest 3 app Immersed.

Speaking of those “big screens,” the experience with 2D virtual displays is quite different in both headsets. The Vision Pro seems built from the ground up with the ability to place and resize thousands of flat iOS apps anywhere around your virtual space. Those virtual windows react to the light in the room, cast gentle shadows in your virtual view, and get occluded by objects in the real world, adding to the sense that they are really “there” with you.

The Quest, on the other hand, was built more with immersive VR experiences in mind. Yes, recent Quest OS upgrades added the ability to snap selected flat apps and system tools (e.g., the store) into place in your Quest “home environment.” But the system-level “huge floating screens” experience is still much more limited than that on the Vision Pro, which offers easy free positioning and resizing of all sorts of apps. Quest users looking for something similar need to rely on a third-party tool like Virtual Desktop, which also has its own quirks and limitations.

Our unbiased take on Mark Zuckerberg’s biased Apple Vision Pro review Read More »

new-quest-dev-tools-to-add-leg-estimation-for-more-convincing-avatars

New Quest Dev Tools to Add Leg Estimation for More Convincing Avatars

Meta announced that it’s offering new developer tools for Quest headsets to make avatars more realistic. The company also unveiled a Quest 3-exclusive upper body tracking feature that supports a much wider range of body motion.

Announced at Connect 2023 late last week, Meta showed off some new features coming both to Quest 3 and the rest of the Quest platform.

On Quest 3, Meta says it will be able to use inside-out sensor data to optically track wrists, elbows, shoulders, and torso—or something the company is calling ‘Inside Out Body Tracking’ (IOBT). The Quest 3-exclusive feature also tracks where your legs are relative to your torso, making avatars capable of bending forward and peering over a cliff.

Image courtesy Meta

By using this upper body data to extrapolate lower body actions, the company says it can make avatars replicate more natural movements than traditional inverse kinematics (IK)-based methods.

The company also announced a feature called ‘Generative Legs’, which is headed to Quest 2/3/Pro in December. The developer tool is said to create more realistic leg movement using either three-point body tracking or the Quest 3-exclusive IOBT. It’s capable of recreating more natural standing and sitting poses, a more lifelike gait when walking, and also supports jumping, ducking and squatting.

Since it’s essentially guessing where your legs might naturally be in any given situation, Generative Legs won’t account for individual leg movement like a dedicated tracker might, such as a SteamVR tracking puck or Sony’s Mocapi motion capture device—that means your avatar can’t do karate or breakdance.

Still, it’s pretty impressive how much better the whole system is in comparison to standard IK. Granted, Quest users won’t be able to pull of the fancy footwork CEO Mark Zuckerberg did on the virtual stage at Connect 2022 last year, but it’s starting to look pretty close.

Check out Meta’s Generative Legs and the new Quest 3 upper body tracking feature in action in a Meta-built showcase app called Dodge Arcade:

New Quest Dev Tools to Add Leg Estimation for More Convincing Avatars Read More »

xbox-cloud-gaming-coming-to-quest-3-in-december

Xbox Cloud Gaming Coming to Quest 3 in December

Meta announced at Connect 2023 that Xbox Cloud Gaming is heading to Quest in December, meaning you’ll be able to play all of your favorite flatscreen games on offer through Xbox Game Pass Ultimate.

Meta’s full unveiling of Quest 3 yesterday came with a fair bit of news, including specs, price, pre-orders and shipping dates; long story short, you can get Meta’s $500 consumer mixed reality headset starting October 10th, with pre-orders now live.

Sometime in December, Meta says we’ll also get support for Xbox Cloud Gaming on Quest too, which users will be able to use on a virtual screen that can be adjusted and resized.

There’s no specific date yet for when to expect Xbox Cloud Gaming to the Quest platform. On stage, Meta CEO Mark Zuckerberg only mentioned that it’s “coming to Quest in December,” so it’s possible we’ll see even Quest 2 included in the list of supported hardware in addition to Quest 3 and (presumably) Quest Pro.

As it stands, there are a few standard caveats. Xbox Game Pass Ultimate subscription and a supported controller (sold separately) is required. Meta says in a blogpost that some streaming limitations may apply as well, including variable server availability and wait times, and geographical restrictions.


Want to know if Quest 3 is worth it? We haven’t gone in for our deep dive review yet, although we got a full hands-on with the headset right before Connect 2023 this week that goes into everything from confort to clarity.

Xbox Cloud Gaming Coming to Quest 3 in December Read More »

meta-avatars-finally-get-legs-on-quest

Meta Avatars Finally Get Legs on Quest

Meta released a Quest software update via its public test channel (PTC), which lets users opt-in to try new features before they’re pushed out to everyone. Among the v57 PTC update is a feature that’s been notably missing from Meta avatars: legs.

Meta CEO Mark Zuckerberg promised at Connect 2022 that its avatars would eventually be getting legs, putting an end to the platform’s characteristic floating torsos at some point in the not-too-distant future. At the time, Zuckerberg showed off his on-stage avatar jumping and kicking, although it was revealed later this was actually created using some fairly common external motion capture tech.

In short, Quest can’t track legs yet, which means the v57 PTC update is packing a pretty standard implementation of inverse kinematics (IK), resulting in the sort of body positioning guesswork you see in apps like VR Chat. Still, nice to see a full body in Quest Home for once, right?

X (formerly Twitter) user Lunayian shows off the new avatar legs after installing the v57 PTC update.

Meta Quest v57 PTC finally adds legs to your Meta avatar 😀 pic.twitter.com/3dzuuppp6e

— Luna (@Lunayian) August 29, 2023

YouTuber and tech analyst Brad Lynch also tried out the new legs, showing off some of the limitations currently. Notably, you won’t see your avatar’s legs when looking down directly at them—they’re only viewable via the mirror, and ostensibly by other users—and the IK system still doesn’t account for crouching.

According to data mined by X user NyaVR, the v57 PTC update also includes the ability to enable and disable the avatar mirror, a new Horizon Worlds Portal in home, an Airplane Mode, and an Extended Battery Mode.

The comes alongside a wider push to attract more users to Horizon Worlds, as Meta recently took its first steps of ending Quest-exclusivity for the social VR app with the launch of a closed beta on Android mobile devices. It’s also set to arrive on standard PC browsers too at some point.

Additionally, Meta seems to also be investing more in first-party content for Horizon Worlds, having released Super Rumble late last month, a hero shooter which feels more in line with the sort of sticky content that ought to attract and bring users back more regularly.

We’re sure to learn more about Quest software features and Horizon Worlds stuff at the company’s annual Connect developer conference, which takes place September 27th.

Meta Avatars Finally Get Legs on Quest Read More »

meta-shows-off-quest-hand-tracking-improvements,-claims-“almost-as-responsive-as-controllers”

Meta Shows Off Quest Hand-tracking Improvements, Claims “almost as responsive as controllers”

Apple is going all-in with hand-tracking for its upcoming Vision Pro, but can hand-tracking really replace proper VR controllers? Meta, Apple’s main competitor in the space, isn’t going so far as to make that particular claim, however the company says Quest’s recent hand-tracking improvements are now “almost as responsive as controllers” thanks to its recent v56 software update.

First announced in late July, the company’s Hands 2.2 tracking improvements are introducing what Meta says is better hand responsiveness and a few new experimental features that we’ll probably see in Quest 3.

Now rolling out to Quest headsets, Meta says users should notice hand-tracking latency reduced “up to 40%” in regular use, and “up to 75%” during fast movement. Meta says those dramatic gains in fast movement latency are thanks to the introduction of a new Fast Motion Mode (FMM) for more frenetic games, like fitness and rhythm games that require you to punch incoming objects.

Here’s a look at controllers relative to the new Hands 2.2 release:

v56 is also rolling out to Quest Pro, which includes two new experimental features: simultaneous hands and controllers (Multimodal) tracking, and controller-driven hand pose (Capsense Hands).

Multimodal tracking is said to unlock a number of mixed input style, including Hand+controller gameplay, instant transitions between hands and controllers, and improved social presence when using one controller. It’s only available on Quest Pro for experimentation, although Meta plans to add support for additional devices later.

On the other hand, Capsense Hands lets developers show a natural hand model visualization on top of, or instead of, a user’s controller. Check out both in action in the video below:

“Hand Tracking gives your app’s users the ability to engage with their VR or mixed reality environment in a way that is natural and intuitive,” Meta says in a developer blogpost. “These interactions deepen the immersive experience and help people feel more connected to what’s going on around them in-headset. Hands can also provide a faster on ramp for users new to VR. By integrating Hand Tracking in your existing apps, you can give your users more flexibility to tailor their experience and find what works best for them—and thanks to Hands 2.2, you can feel confident knowing your app’s users will enjoy a great experience regardless of whether they play with hands or controllers.”

Meta says we should hear more about its hand-tracking upgrades in the near future, as the company is hosting its annual Meta Connect developer conference on September 27th, which ought to include an info dump (and likely release date) for its upcoming Quest 3 headset, which is bringing much of the functionality of Quest Pro to the consumer price point of $500.

Meta Shows Off Quest Hand-tracking Improvements, Claims “almost as responsive as controllers” Read More »

meta’s-xr-revenue-down-39%-“due-to-lower-quest-2-sales,”-as-quest-3-&-vision-pro-loom

Meta’s XR Revenue Down 39% “due to lower Quest 2 sales,” as Quest 3 & Vision Pro Loom

Meta’s latest quarterly results show its Reality Labs XR division is again reporting an operating loss just south of $4 billion. Now, for its Q2 2023 results, the company says Reality Labs’ revenue was down by 39% due to lower Quest 2 sales, making for the worst quarterly performance in the past two years.

Meta has been clear about its plan to spend aggressively on XR over the next several years, so it’s again no surprise we’re seeing operating budgets in the billions with only a fraction of that coming back in via Quest 2 hardware and software sales.

In fact, Quest 2 sales play such an important role in Reality Labs’ quarterly performance that Meta has reported $276 million in revenue in Q2 2023, or 39% lower than last quarter.

Image created using data courtesy Meta

Meta reported that Reality Labs expenses were $4 billion, which was up 23% since the same period last year. The company says this was due to lapping a reduction in Reality Labs loss reserves and growth in employee-related costs, bringing the XR division’s operating loss to $3.7 billion for Q2 2023.

Meta says it expects continued operating losses in the future, saying losses will likely “increase meaningfully year-over-year due to our ongoing product development efforts in AR/VR and our investments to further scale our ecosystem.”

Meanwhile, the company is preparing to launch Quest 3 in late 2023, the $500 follow-up headset that integrates many of Quest Pro’s mixed reality capabilities. Meta’s $1,000 Quest Pro has also reportedly been discontinued, however (without substantiating that particular claim) Meta CTO Andrew Bosworth implied earlier this month that a Quest Pro 2 isn’t off the table.

Apple’s Vision Pro is also looming, set to launch sometime next year. As rising tides lift all boats, hype around Vision Pro could actually benefit Meta in the short term. Apple’s $3,500 XR headset has attracted new attention to the space, however Meta’s consumer-friendly pricing and extensive game catalogue for Quest 3 may be well positioned this holiday to capitalize on that Apple-adjacent cachet.

Meta’s XR Revenue Down 39% “due to lower Quest 2 sales,” as Quest 3 & Vision Pro Loom Read More »

meta-cto-rebukes-report-claiming-cancellation-of-quest-pro-line

Meta CTO Rebukes Report Claiming Cancellation of Quest Pro Line

According to a recent report from The Information, Meta is allegedly spinning down Quest Pro alongside a broader move to cancel the future ‘Pro’ line of XR hardware altogether. Meta CTO Andrew Bosworth says however, “don’t believe everything you read.”

Meta has reportedly stopped ordering new components for the Quest Pro from its suppliers, The Information maintains. While it’s thought Meta will continue selling its $1,000 Pro-branded mixed reality headset as long as there is enough stock, the report alleges the entire Pro line has been suspended, putting a second-generation Quest Pro distinctly out of the question.

Speaking in an Instagram Stories post yesterday, Bosworth rebukes the claim that a potential Quest Pro 2 has officially been cancelled for good, saying that his team is developing multiple prototypes in parallel for all of its projects. Notably, he doesn’t address whether it’s spinning down the current version of Quest Pro, however he implies that the report of Quest Pro 2’s demise was the result of a disgruntled employee whose project was cut.

Here’s Bosworth’s statement in full:

“I have to explain this every year. There is no Quest Pro 2 headset until we decide there is. What I mean by that is there are lots of prototype headsets—lots of them—all in development in parallel. Some of them, we say, “that’s not the right one,” and we shut it down. Some of them, we say, “that’s the right one,” and we spin it up. What you need to understand is, until it goes out the door, it doesn’t get the name. So, there might be a Quest Pro 2, there might not be. I’m not really telling you, but I will say don’t believe everything you read about what’s been stopped or started. A lot of times it comes from someone who’s unhappy their particular project got cut when there are other projects that did not get cut.”

Still, it’s clear there’s been some turbulence in how Quest Pro was handled from the get-go. Originally launched for $1,500 in October 2022, Meta decided only a few months later it would slash Quest Pro by $500, putting at its $1,000 price tag today. Meanwhile, Quest 2 has seen multiple price changes, ranging from $300 to $400 for the same 128GB variant.

Fluctuating prices aside, Quest Pro’s raison d’être has never really been clearly defined, as the company has nebulously pitched it to professionals as a would-be workstation. In practice, Quest Pro has been more of a developer kit for studios hoping to build consumer apps for the cheaper Quest 3, coming in Fall 2023 at $500. Meanwhile, Quest Pro users have reported a host of usability issues since launch, decidedly making it feel a little less ready for prime time than the company probably hoped.

Whatever the case, Quest Pro 2 would need a much clearer value proposition—provided whatever prototypes Meta has waiting in the wings also don’t also get cut.

Meta CTO Rebukes Report Claiming Cancellation of Quest Pro Line Read More »

meta-launches-monthly-vr-game-subscription-service-for-quest

Meta Launches Monthly VR Game Subscription Service for Quest

Meta today announced a new VR game subscription service that will give you access to two hand-picked Quest games per month, priced at $8 per month, or $60 annually.

Called Meta Quest+, the subscription service will be available to Quest 2, Quest Pro and eventually Quest 3 users.

Similar to PlayStation’s PS Plus service, Meta is offering up two specific redeemable titles on the first of each month which you can download and keep for as long as you’re a paid member.

Meta says members can cancel at any time, which would mean you’d lose access to each game you redeemed, although the company says rejoining allows you to gain access to those previously redeemed titles.

The service is kicking off in July with Cloudhead Games’ physical action-rhythm FPS Pistol Whip and the nostalgia-fueled arcade adventure Pixel Ripped 1995 from ARVORE Immersive Experiences.

August is set to have Mighty Coconut’s highly-rated Walkabout Mini Golf and FPS roguelite MOTHERGUNSHIP: FORGE from Terrible Posture Games.

Meta Quest+ is set to cost $8 per month, or billed for $60 annually, a 37% savings over the monthly charge. You can learn more and also sign up here.

Meta says Quest+ titles are eligible for App Sharing across accounts, although if you happen to already own any of the games on offer monthly, you’ll just have to stick around to see whether something comes up that you don’t already own.

To sweeten the pot, the company is doing a deal for July that reduces the first month’s charge to $1, which is then followed by the regular $8 per month. That specific offer ends July 31st, 2023.

While Quest+ has been the subject of rumors for the past few months, it wasn’t clear which route the company would go—whether it would be a Viveport-style affair that allows you to pick from a pool of eligible games, or what they revealed today, a highly curated system like PS Plus. It’s an interesting route which could signal they’re expecting a substantial raise in new users in the coming months, as the company is set to launch its $500 Quest 3 headset September 27th, 2023, which has come along with a price reduction of Quest 2 to the original $300 price point.

Meta Launches Monthly VR Game Subscription Service for Quest Read More »

new-quest-2-&-quest-pro-update-brings-performance-boost-and-new-home-environments

New Quest 2 & Quest Pro Update Brings Performance Boost and New Home Environments

Meta says it’s has begun pushing out a software update which will bring some pretty profound performance boosts to both Quest 2 & Quest Pro.

Update (June 21st, 2023): Meta says Quest update v55 is now starting to roll out to Quest 2 & Quest Pro users. The company is promising the update will deliver a significant boost to the devices’ performance which should make the VR experience smoother overall while allowing apps to render at somewhat higher resolutions.

Update v55 also includes a standalone Messenger app and a revamped ‘Explore’ tab (which now shows Reels from Instagram and Facebook, if your accounts are connected). The update also adds multi-touch capability to the in-headset browser for hands-on zooming of web pages.

And last but not least, users will find two new home environments for their headset. The first is ‘Futurescape’, which was the backdrop of this year’s Quest Gaming Showcase; the second is ‘The Great Sand Sea’, which is exclusively available to users who have pre-ordered Asgard’s Wrath 2.

As ever, Meta advises that these updates roll out gradually to the population of headset users, so if you don’t see it right away you might need to wait a little longer.

The original article, which covered the update’s performance improvements, continues below.

Original Article (June 1st, 2023): Meta unveiled Quest 3 today, its next consumer-focused headset slated to launch in fall starting at $500. Quest 3 is going to be more powerful than Quest 2 by a good margin; the company says it has “more than twice the graphical performance as the previous generation Snapdragon GPU in Quest 2.”

Now the company says it’s tossing out a software update to both Quest 2 and Quest Pro chipsets that will provide up to 26% CPU performance increase for both. As for the headsets’ GPUS, we’re told to expect up to 19% GPU speed increase for Quest 2 and 11% for Quest Pro.

“As developers take advantage of these changes, you can expect smoother gameplay, a more responsive UI, and richer content on both headsets,” the company says in a blogpost. “And we’re enabling Dynamic Resolution Scaling for both Quest 2 and Quest Pro, so games and apps can take advantage of increased pixel density without dropping frames.”

The company hasn’t said just when to expect the update, but we’ll be keeping our eyes peeled on Meta blog and social channels in the coming days. In the meantime, check out all of our Quest 3 coverage so far which has come right ahead of the big Quest Gaming Showcase kicking off today:

New Quest 2 & Quest Pro Update Brings Performance Boost and New Home Environments Read More »

quest-3-features-confirmed-in-first-hands-on

Quest 3 Features Confirmed in First Hands-on

It seems Meta is looking to stoke some hype for its next Quest headset just days before Apple is slated to unveil its own, as Bloomberg’s Mark Gurman released Quest 3’s first hands-on, confirming a number of features from previous leaks in the process.

Gurman detailed a number of features in his hands-on with the upcoming mixed reality headset, saying that Quest 3 feels lighter and thinner than the Quest 2, featuring a stronger strap with fabric sides.

Like we’ve seen in previous renders, Quest 3 is said to feature three vertical “pill-shaped sensor areas” on the front of the device. On the left and right are color video pass-through sensors and standard cameras, while a depth sensor is placed in the middle, which is used for environment meshing and automatic identification of surrounding walls.

Tracking cameras are found on both left and right bottom sides of the device, departing from Quest 2’s four-sensor array placed on each corner of the headset. Sounds pretty similar to the image featured in a previous leak from Bradely Lynch.

Image courtesy Bradley Lynch

Quest 3 is said to come with a physical interpupillary distance (IPD) adjustment wheel next to the volume rocker which will allow users to dial in a finer IPD measurement. As a departure from its Quest Pro-esque feature set, Quest 3 is said to lack face and eye-tracking, which means none of the lauded ‘social presence’ features or foveated rendering.

Notably, Gurman says the actual clarity and VR displays within the Quest 3 feel “similar to those in the Quest 2 — despite the resolution being rumored to be slightly higher.” It seems Quest 3’s claim to fame will be its color mixed reality passthrough and faster performance thanks to a second-generation Qualcomm Snapdragon XR2.

“[V]ideo pass-through on the Quest 3 presented colors more accurately and offered an almost lifelike rendering of the real world. I was even able to use my phone while wearing the headset, something that often feels impossible on a Quest 2,” Gurman says.

There’s no mention of optics, or whether it will indeed use pancake lenses like Quest Pro or a Fresnel lens like Quest 2.

From Gurman’s description, it seems Touch controllers aren’t getting the Pro-level design either, as they appear to be optically tracked by the headset via IR markers à la Quest 2. It’s said to lack both Quest Pro’s embedded controller sensors and Quest 2’s hoop-style tracking design, which could be interesting.

Pricing for the Quest 3 isn’t finalized, however it’s expected to be higher than the Quest 2 at around $500. Meta is also expected to concurrently offer Quest 2, making for the widest headset lineup the company has ever offered at one time.

Gurman says Meta is set to target the cheaper headset segment while Apple targets the upscale market with its reported $3,000 mixed reality device. While Apple’s headset is expected to make its debut on June 5th, Gurman says Meta is bringing Quest 3 in October.

Quest 3 Features Confirmed in First Hands-on Read More »

report:-meta-in-talks-with-magic-leap-for-multiyear-ar-headset-tech-deal

Report: Meta in Talks with Magic Leap for Multiyear AR Headset Tech Deal

A report from the Financial Times maintains Meta is currently in talks with AR headset creator Magic Leap to strike a multiyear deal, which could include intellectual property licensing and contract manufacturing of AR headsets in North America.

The AR unicorn is said to possess valuable IP regarding custom components, including its optics, waveguides, and software.

It’s said a potential deal may also allow Meta to lessen its reliance on China for component manufacturing. In 2019, Magic Leap partnered with manufacturing solutions company Jabil to create a Guadalajara, Mexico plant which the report maintains can assemble headsets in “the tens of thousands a year.”

Magic Leap 2 | Photo by Road to VR

Citing people with knowledge of the talks, the report maintains however a specific joint Meta-Magic Leap headset isn’t expected.

While both companies didn’t comment on a potential partnership, Magic Leap said this to the Financial Times:

“Given the complexities of developing true augmented reality technologies and the intricacies involved with manufacturing these optics, as well as the issues many companies experience with overseas supply chain dependencies, we have entered into several non-exclusive IP licensing and manufacturing partnerships with companies looking to enter the AR market or expand their current position.”

Since it exited stealth in 2014, Magic Leap has released two AR headsets, Magic Leap 1 and Magic Leap 2, which have been compared in functionality to Microsoft’s HoloLens AR headsets.

The company has raised over $4 billion, with minority investors including Google, Alibaba, Qualcomm, AT&T, and Axel Springer. Its majority stakeholder is Saudi Arabia’s state-owned sovereign wealth fund.

In addition to Quest Pro mixed reality headset, Meta has confirmed it’s currently working on its next iteration of Quest, likely Quest 3, as well as its own AR glasses. Meta started real-world testing of Project Aria in 2020, a platform for training its AR perception systems and asses public perception of the technology.

Report: Meta in Talks with Magic Leap for Multiyear AR Headset Tech Deal Read More »

meta-&-bmw-are-integrating-ar/vr-headsets-into-cars,-release-timeline-uncertain

Meta & BMW Are Integrating AR/VR Headsets into Cars, Release Timeline Uncertain

Initially announced in 2021, Meta CEO Mark Zuckerberg shared an update on the company’s research partnership with BMW, which focuses on integrating AR and VR into vehicles to make people more productive, social, and entertained while traveling.

The ultimate aim in the BMW/Meta partnership is to accurately anchor virtual objects relative to the car’s motion by hooking into the tracking system of both the car and a Meta headset, which researchers say includes the Meta Quest Pro standalone mixed reality headset and the company’s in-development AR headset, Project Aria.

Without such a system in place, the headset’s rotational tracking would noticeably drift as the car makes turns and other adjustments, making it essentially unusable for anything but perfectly straight sections of road.

Check out the video detailing the research below:

Still considered a proof-of-concept prototype, Meta says the partnership has already overcome some key technical challenges, such as fusing the headset and car’s sensors to understand their relative position. That said, the companies don’t think it’s ready for the public just yet.

“It is too early to tell exactly how or when this technology will make it into customers’ hands, but we envision a number of potential use cases for XR devices in vehicles—from assisting the driver in locating their car in a crowded parking lot to alerting them to hazards on the road and surfacing important information about the vehicle’s condition,” said Claus Dorrer, Head of BMW Group Technology Office in the US. “The implications of future AR glasses and VR devices—for passengers as well as drivers—are promising. The research partnership with Meta will allow us to discover what immersive, in-vehicle XR experiences could look like in the future and spearhead the seamless integration of such devices into cars.”

AR and VR integration in cars isn’t an entirely new area of research. It’s been the sole focus of Audi-backed startup Holoride, which recently partnered with HTC to deliver in-car VR entertainment via HTC Vive Flow. Still, Holoride has been mostly grabbed headlines as a tradeshow mainstay; it hasn’t seen mass adoption yet despite only requiring a $200 retrofit pack, which enables Vive Flow owners to play VR in cars.

In the end, it seems car companies are now seeing the writing on the wall that riders will maybe very soon—but not right now—want to bring their own XR devices and actually use them in the car, just like you might a smartphone, albeit with more utility than any infotainment screen on offer.

Meta & BMW Are Integrating AR/VR Headsets into Cars, Release Timeline Uncertain Read More »