apple vision

can-a-$3,500-headset-replace-your-tv?-we-tried-vision-pro-to-find-out

Can a $3,500 headset replace your TV? We tried Vision Pro to find out

Apple Vision Pro Review —

We kick off our multi-part Vision Pro review by testing it for entertainment.

  • The Apple Vision Pro with AirPods Pro, Magic Keyboard, Magic Trackpad, and an Xbox Series X|S controller.

    Samuel Axon

  • You can see the front-facing cameras that handle passthrough video just above the down-facing cameras that read your hand gestures here.

    Samuel Axon

  • There are two buttons for Vision Pro, both on the top.

    Samuel Axon

  • This is the infamous battery pack. It’s about the size of an iPhone (but a little thicker) and has a USB-C port for external power sources.

    Samuel Axon

  • There are two displays inside the Vision Pro, one for each eye. Each offers just under 4K resolution.

    Samuel Axon

  • Apple offers several variations of the light seal to fit different face shapes.

    Samuel Axon

  • A close-up look at the Vision Pro from the front.

    Samuel Axon

The Vision Pro is the strangest product Apple has introduced in the time I’ve been covering the company. By now, it’s well established that the headset is both impressively cutting-edge and ludicrously expensive.

You could certainly argue that its price means it’s only for Silicon Valley techno-optimists with too much money to burn or for developers looking to get in on the ground floor on the chance that this is the next gold rush for apps. But the platform will need more than those users to succeed.

Part of Apple’s pitch behind the price tag seems to be that the Vision Pro could replace several devices, just like the iPhone did back in the late 2000s. It could replace your laptop, your tablet, your 4K TV, your video game console, your phone or other communications device, your VR headset, and so on. If it truly replaced all of those things, the price wouldn’t seem quite so outrageous to some.

And those are just the use cases Apple has put a lot of effort into facilitating for the launch. Many of the most important uses of the company’s prior new product categories didn’t become totally clear until a couple of years and generations in. The iPhone wasn’t originally intended as a meditation aid, a flashlight, and a number of other common uses until third-party developers invented apps to make it do those things. And Apple’s approach with the Apple Watch seemed to be to just throw it out there with a number of possible uses to see what stuck with users. (The answer seemed to be health and fitness, but the device’s distinct emphasis on that took a bit of time to come into focus.)

So while I could write a dense review meandering through all the possibilities based on my week with the Vision Pro, that doesn’t seem as helpful as drilling in on each specific possibility. This is the first in a series of articles that will do that, so consider it part one of a lengthy, multi-step review. By the end, we’ll have considered several possible applications of the device, and we might be able to make some recommendations or predictions about its potential.

So far, I believe there’s one use case that’s a slam dunk, closer to clarity during launch week than any of the others: entertainment. For certain situations, The Vision Pro is a better device for consuming TV shows and movies (among other things) away from a dedicated theater than we’ve ever seen before. So let’s start there.

My (perhaps too) exacting standards

I know I’m not the usual TV consumer. It’s important to note that before we get too deep.

I bought my first OLED television (a 55-inch LG B6) in 2016. I previously had a 50-inch plasma TV I liked, but it only supported 1080p and SDR (standard dynamic range), and Sony had announced the PlayStation 4 Pro, which would support 4K games (sort of) and HDR (high dynamic range). Game consoles had always driven TV purchases in the past, so I sprung for the best I could afford.

I always cared about picture quality before I bought an OLED, but that interest turned into something more obsessive at that point. I was stunned at the difference, and I began to find it hard to accept the imperfections of LCD monitors and TVs after that. Granted, I’d always disliked LCDs, going straight from CRT to plasma to avoid that grayish backlight glow. But the comparison was even harsher once I went to OLED.

My fellow Ars Technica writers and editors often talk about their robust, multi-monitor PC setups, their expensive in-home server racks, and other Ars-y stuff. I have some of that stuff, too, but I put most of my time and energy into my home theater. I’ve invested a lot into it, and that has the unfortunate side effect of making most other screens I use feel inadequate by comparison.

All that said, some have argued that the Vision Pro is a solution in search of a problem, but there is one pre-existing problem I have that it has the potential to solve.

I travel a lot, so I spend a total of at least two months out of every year in hotel or Airbnb rooms. Whenever I’m in one of those places, I’m always irritated at how its TV compares to the one I have at home. It’s too small for the space, it’s not 4K, it doesn’t support HDR, it’s mounted way too high to comfortably watch, or it’s a cheap LCD with washed-out black levels and terrible contrast. Often, it’s all of the above. And even when I’m home, my wife might want to watch her shows on the big TV tonight.

I end up not watching movies or shows I want to watch because I feel like I’d be doing those shows a disservice by ruining the picture with such terrible hardware. “Better to hold off until I’m home,” I tell myself.

The Vision Pro could be the answer I’ve been waiting for. Those two displays in front of my eyes are capable of displaying an image that stands up to that of a mid-range OLED TV in most situations, and I can use it absolutely anywhere.

Can a $3,500 headset replace your TV? We tried Vision Pro to find out Read More »

the-best-thing-about-apple-vision-pro?-meta-finally-has-big-competition

The Best Thing About Apple Vision Pro? Meta Finally Has Big Competition

Meta has undeniably been the lone looming Goliath in a field of smaller Davids in the XR scene for years now. With Apple finally making its entrance into the market, Meta won’t be able to go at its own pace.

Apple’s new headset might be an absurd $3,500, putting it in a completely different class than Meta’s upcoming Quest 3 at $500, let alone the Quest 2 now at $300. But the pressure will still be on as comparisons are made between the experience Apple has crafted and what Meta offers.

After all, there’s no denying that while the Vision Pro is packed full of hardware, and has the benefit of Apple’s proprietary and powerful M2 chips, so much of what the headset is doing right is about the software experience rather than the fidelity that’s unlocked with the hardware.

Great Hardware, Struggling Software

The thing is, Meta’s headsets are plenty capable. Quest 2 is still a solid product that is in many ways still best in class and Quest 3 only promises to up the ante later this year with more power, higher resolution, improved lenses, and better passthrough AR. Meta’s hardware has always been quite impressive, even as far back as the original Oculus Rift CV1.

But on the software side the company has seriously struggled to make usability a priority. For all the lessons the company learned about the power of reducing friction in VR—by building a standalone headset that doesn’t need a computer or external tracking beacons—there has been seemingly little emphasis on making the same reduction in friction by creating a cohesive interface between Quest’s system interface, and Meta’s own first-party apps; let alone providing a set of clear and useful guidelines so that developers and users alike can benefit from a common user experience.

Lean on Me

Meta has leaned substantially on third-party developers to make using its headsets worthwhile to use. Game developers have done the painstaking work of refining how users should control their apps and interact with their worlds in entertaining ways. When you’re inside of a VR game, the developer is fully controlling the experience to make it cohesive and enjoyable, while sussing out the pitfalls that would turn off users—like bugs, convoluted menus, and inconsistent interactions.

If Meta’s headsets didn’t have games—but still did everything else they’re capable of—they would be dead in the water because of how painful it can be to use the headset outside of carefully crafted game experiences designed to entertain. On the other hand, Apple Vision Pro has a minimal emphasis on gaming (at least at the outset), but is spending significant effort to make everything else the headset does easy and consistent. By doing so, Apple is ensuring that the headset will be great for more than just gaming.

Despite the price difference between Vision Pro and Quest headsets, Meta is still going to have to stare this thing in the face and come to grips with what it could be doing better—for users, developers, and itself. The good news, at least, is that much of the room for improvement is in the software side of things.

The Vacuum

Until now, Meta has had no serious competition in this space. Its headsets—despite the criticisms I’ve laid out here—have consistently offered the best value in their class, with great hardware and a great game library, all at a very attractive price that others have largely been unable to match.

That’s made it hard for other headset makers to compete and left Meta little need to respond even if other companies do something better or innovative. It’s also meant that developers and users have very little leverage over what Meta decides to do—after all, where else are they going to go if they want an affordable standalone headset with the best library of content?

Meta has been able to create a vacuum in the consumer VR space which on the surface might look like success… but in reality, it has left Meta unfocused on what it needs to do to make its headsets appeal to a broader audience.

Better for Everyone

Now we have Apple in the game, ready to challenge Meta on hardware and the software experience. Price advantage is clearly in Meta’s favor, but it’s going to need to up its game, otherwise it risks losing not just customers, but more importantly developers, who might see greener grass on the other side—especially if they’re looking forward to a future where Apple’s headset comes down in price.

Apple’s entrance into the market might seem like a threat, but ultimately Meta now gets to sit back and examine all the hard work Apple has done over the years, then choose the best ideas to incorporate into its own offerings, while ignoring what it sees as missteps by Apple.

In the end, Apple’s headset is going to force Meta’s headsets to get better, faster. And that’s good for everyone, including Meta.

The Best Thing About Apple Vision Pro? Meta Finally Has Big Competition Read More »

zuckerberg-gives-his-first-reaction-to-apple’s-vision-pro

Zuckerberg Gives His First Reaction to Apple’s Vision Pro

Meta founder and CEO Mark Zuckerberg hasn’t been shy about addressing the elephant in the room: with Apple Vision Pro, the Cupertino tech giant is officially entering a market that, up until now, Meta has basically owned. In a meeting with Meta employees, Zuckerberg thinks that while Apple Vision Pro “could be the vision of the future of computing […] it’s not the one that I want”

As reported by The Verge, Zuckerberg seems very confident in the company’s XR offerings, and is less impressed with Apple’s design tradeoffs. During a companywide meeting, Zuckerberg said that with Vision Pro, Appe has “no kind of magical solutions” and that they haven’t bypassed “any of the constraints on laws of physics that our teams haven’t already explored and thought of.” He calls that “the good news.”

Largely, Zuckerberg says Apple is making some telling design tradeoffs, as its higher resolution displays, advanced software, and external battery comes alongside a $3,500 price tag—or seven times more than Meta’s upcoming Quest 3 mixed reality standalone.

Photo by Road to VR

But it’s also about ethos. Zuckerberg says the companies’ respective headsets represent a divide in company philosophy, as Apple products are typically developed to appeal to high income consumers. “We innovate to make sure that our products are as accessible and affordable to everyone as possible, and that is a core part of what we do. And we have sold tens of millions of Quests,” he said.

“More importantly, our vision for the metaverse and presence is fundamentally social. It’s about people interacting in new ways and feeling closer in new ways,” Zuckerberg continued. “Our device is also about being active and doing things. By contrast, every demo that they showed was a person sitting on a couch by themself. I mean, that could be the vision of the future of computing, but like, it’s not the one that I want.”

The Meta chief echoed some of these statements on the Lex Fridman podcast where he spoke about his opinions on Apple Vision Pro, noting that Apple’s mixed reality headset offers a “certain level of validation for the category.” Because Vision Pro will cost so much though, Zuckerberg maintains Quest 3 will overall benefit as people inevitably gravitate to towards the cheaper, more consumer-friendly option.

Here’s Zuckerberg’s full statement, sourced from the companywide address:

Apple finally announced their headset, so I want to talk about that for a second. I was really curious to see what they were gonna ship. And obviously I haven’t seen it yet, so I’ll learn more as we get to play with it and see what happens and how people use it.

From what I’ve seen initially, I’d say the good news is that there’s no kind of magical solutions that they have to any of the constraints on laws of physics that our teams haven’t already explored and thought of. They went with a higher resolution display, and between that and all the technology they put in there to power it, it costs seven times more and now requires so much energy that now you need a battery and a wire attached to it to use it. They made that design trade-off and it might make sense for the cases that they’re going for.

But look, I think that their announcement really showcases the difference in the values and the vision that our companies bring to this in a way that I think is really important. We innovate to make sure that our products are as accessible and affordable to everyone as possible, and that is a core part of what we do. And we have sold tens of millions of Quests.

More importantly, our vision for the metaverse and presence is fundamentally social. It’s about people interacting in new ways and feeling closer in new ways. Our device is also about being active and doing things. By contrast, every demo that they showed was a person sitting on a couch by themself. I mean, that could be the vision of the future of computing, but like, it’s not the one that I want. There’s a real philosophical difference in terms of how we’re approaching this. And seeing what they put out there and how they’re going to compete just made me even more excited and in a lot of ways optimistic that what we’re doing matters and is going to succeed. But it’s going to be a fun journey.

Zuckerberg Gives His First Reaction to Apple’s Vision Pro Read More »

apple’s-computer-vision-tool-for-developers-now-tracks-dogs-&-cats

Apple’s Computer Vision Tool for Developers Now Tracks Dogs & Cats

Would reality really be complete without our beloved four-legged friends? Certainly not. Luckily the latest update to Apple’s ‘Vision’ framework—which gives developers a bunch of useful computer vision tools for iOS and iPad apps—includes the ability to identify and track the skeletal position of dogs and cats.

At Apple’s annual WWDC the company posted a session introducing developers to the new animal tracking capabilities in the Vision developer tool, and explained that the system can work on videos in real-time and on photos.

The system, which is also capable of tracking the skeletal position of people, gives developers six tracked ‘joint groups’ to work with, which collectively describe the position of the animal’s body.

Image courtesy Apple

Tracked joint groups include:

  • Head: Ears, Eyes, Nose
  • Front Legs: Right leg, Left leg
  • Hind Legs: Right rear leg, Left rear leg
  • Tail: Tail start, Tail middle, Tail end
  • Trunk (neck)
  • All (contains all tracked points representing a complete skeletal pose)

Yes, you read that right, the system has ‘tail tracking’ and ‘ear tracking’ so your dog’s tail wags and floppy ears won’t be missed.

The system supports up to two animals in the scene at one time and, in additional to tracking their position, can also identify a cat from a dog… just in case you have trouble with that.

Image courtesy Apple

Despite the similarity in name to the Vision Pro headset, it isn’t yet clear if Apple will expose the ‘Vision’ computer vision framework to developers of the headset, but it may well be the same foundation that allows the device to identify people in the room around you and fade them into the virtual view so you can talk to them.

That may have also been a reason for building out this animal tracking system in the first place—so you don’t trip over fido when you’re dancing around the room in your new Vision Pro headset—though we haven’t been able to confirm that system will work with pets just yet.

Apple’s Computer Vision Tool for Developers Now Tracks Dogs & Cats Read More »

apple-vision-pro-to-support-one-of-vr’s-most-prominent-social-apps

Apple Vision Pro to Support One of VR’s Most Prominent Social Apps

Apple unveiled Vision Pro on Monday, its long-awaited standalone headset capable of both virtual and augmented reality. While the Cupertino tech giant seems to be emphasizing Vision Pro’s AR capabilities thanks to its color passthrough cameras, it’s also going to pack one of VR’s most prominent social apps, Rec Room.

Apple’s launch of Vision Pro is still a good bit away—it’s coming first to the US in early 2024 at the hefty price of $3,500. Still, what apps the Fruit Company will allow on the undoubtedly very curated Vision App Store will be telling.

As first noted by UploadVR, among them will be the hit social VR game Rec Room, which so far shares cross-compatibility with SteamVR, Meta Quest, Meta PC VR, PSVR, PlayStation 4/5, Xbox, iOS, Android, and standard monitors via Steam.

Rec Room was the only native VR app shown during the part of the keynote discussing third-part apps, which are coming to the headset via Apple’s integration of the Unity game engine.

Notably, Vision Pro doesn’t offer any sort of motion controller, instead relying on hand and eye-tracking, and voice input. In the past, Rec Room has primarily targeted motion controllers for VR input, however the apps is also set to bring both full-body avatars and new hand models to the platform, which will seemingly do away with the game’s wristless mitten-hands.

Apple Vision Pro to Support One of VR’s Most Prominent Social Apps Read More »