Apple Inc.

A Tech Investor’s Take on the Apple Vision Pro

Apple Inc., apple vision pro, AR glasses, featured, Hardware, MR glasses, XR Talks / Ryan Harris / July 21, 2023

Apple’s entrance into the XR space via their announcement of the Apple Vision Pro was one of the most anticipated events in recent XR history. After years of hype build-up and frequent delays and rumors, the device itself left a lot of questions to be answered. I mulled over those questions with Neso Brands CTO Paulo Almeida in the 10th episode of the XR Talks podcast.

Years of Watching Apple

Neso Brands is an investment company specializing in tech-augmented eyewear. Naturally, their Chief Technical Officer has been carefully watching the Apple Vision Pro rumors for longer than many companies have been involved in XR at all.

“Somehow I’ve been following it for the last seven years,” said Almeida. “The job descriptions first showed up across the internet and that started the rumors, I’m going to say back in 2014, 2015.”

However, Almeida said that he had been waiting for something like an Apple headset for even longer than that – ever since he was, like so many others, disenchanted by the Google Glass device that launched in 2013. While this device first piqued Almeida’s interest in the future of XR wearables, he doesn’t think that it’s the real spiritual predecessor of consumer XR.

“The real pioneers of this are definitely Magic Leap and their waveguide lens is the future that I was expecting Apple to actually achieve some kind of breakthrough on,” said Almeida. “Magic Leap have been the true pioneers of trying to miniaturize all of these components and to make it into something that we could call smart glasses… not over-the-head displays.”

A Difference of Displays

Waveguide displays use a light engine and specialized lenses to project virtual content in front of the eye. Depending on the application, the wearer then looks at that content for a virtual screen application or through the lens to see their physical surroundings augmented by the virtual elements. It’s currently the dominant approach in lighter-weight, lower-cost AR devices.

As far as something like smart glasses go, Magic Leap is still pretty big and pretty expensive – and a fairly exclusive enterprise device. Campfire, also an enterprise-focused company, offers a smaller and lightweight headset that can offer VR as well as MR via the addition of a magnetic plate over the normally transparent lenses.

Micro-OLED displays essentially just put a screen in front of the wearer’s eyes. This approach has clear benefits in terms of image quality, brightness, field-of-view, and some other considerations at the trade-off of being more expensive and much heavier than waveguide displays. This is currently the dominant approach in VR devices – including the Apple Vision Pro.

Because the wearer can’t see through an OLED screen, AR and MR experiences are enabled through passthrough – which displays a video feed of the wearer’s surroundings which can then be augmented with virtual content. This is how virtually all AR/VR headsets – including the Apple Vision Pro – are able to offer both of those experiences on the same opaque screen.

An Extra Screen

There is one place where the benefits of a Micro-OLED display just don’t seem to justify the tradeoffs in terms of weight, cost, and power usage. That’s the giant screen on the front of the Apple Vision Pro that shows a virtual reproduction of the wearer’s eyes.

“I think it’s quite a useless feature, per se. Let’s put it this way: I think Apple just needed to put something there that would make the wow effect,” said Almeida. “They’re taking what I would call ‘The Tesla Approach’ of showing what they’re capable of and then saying ‘now wait a few more years, we’re now going to go into mass production, design something simple.’”

The fact that the headset is called “Pro” has led many to the conclusion that Apple is going to release a standard version of the headset, which might well do without some bells and whistles – like the virtual eyes.

“I definitely think that they should offer options with and without the front feature and I can almost guarantee most people would go without because it would probably be a good $500 or $600 cheaper, the battery would probably last a little bit longer,” said Almeida. “I wouldn’t be surprised if there was a version called the ‘Apple Vision Mini’ or ‘Apple Vision S’.”

Controller-Free Design

While the Apple Vision Pro has more screens than most VR headsets, it has fewer controllers. In fact, Apple is adamant about the Pro not having or needing controllers but getting along with eye and hand tracking as its only inputs.

“That’s one of the points where they’re definitely innovating,” said Almeida. “If there are a few hidden gems on the Apple Vision Pro, eye tracking and hand tracking are among them.”

I specifically brought up gaming as one use case where I feel that a controller is still necessary. Almeida had his perspective but toward the end of the episode, I also invited 3lbXR and 3lb Games founder and CEO Robin Moulder up from the audience knowing that she has an interesting perspective on game input.

Hardware Integrations and Third-Party Companies

A recurring point in the conversation was the room around the Apple Vision Pro itself for accessories, whether from Apple or from 3rd party developers. Almeida sees gaming and input in general as one of these opportunities.

“To play a game, having the feeling of a real-life controller in your hand is something that you need,” said Almeida. “I also think that they’re opening a path for haptic gloves.”

Almeida envisions a whole collection of different controllers for different kinds of games and interactions similar to that for headsets like VIVE. Earlier in the conversation, he had also mentioned the Apple Vision Pro’s battery life as one area that could be expanded through partnerships.

“If Apple is smart, they’re going to open the market to third-party companies for the existing hardware to expand over the existing options,” said Almeida. “In order to achieve more market and to grow as a company, Apple needs to invest in breakthrough technology and for that, they need to let third-party partners come to complement the ecosystem.”

Calling on Developers

Moulder had a different perspective on the Apple Vision Pro and seemed eager for the opportunity to develop controller-free applications.

“I am super stoked about Apple and from my perspective, there’s a whole lot to unpack,” said Moulder. “On the input side, the thing that I keep bringing up to people is that video showed the woman with her hand in her lap. (…) I’m looking at that thinking ‘If I could move my hands around in that kind of field-of-view, hand-tracking works a lot better.’”

Here we’re not talking about field-of-view in terms of what the wearer sees in the headset, we’re talking about what the headset sees around the wearer. Headsets have the ability to track the location of controllers no matter where they are but can only track the hands when the hands are in view of the cameras, which puts huge limitations on how effective hand-tracking can be.

“I don’t have to predict the location of where the hands are going to be in a bunch of nonsensical math just to make up for that limitation of the technology now,” said Moulder. “That’s really nice for us from the gaming perspective because that means we can lean into hand-tracking even more than we’re doing right now.”

Moulder said that this would mean “working with the user to train them” on more nuanced hand interactions, but it also sounds very optimistic for a controller-free headset that doesn’t feel like the 3DoF models of yesteryear. The wide range of the Apple Vision Pro does require a huge number of cameras, so it’s likely that other makers won’t emulate the move any time soon.

Parting Thoughts on the Apple Vision Pro

The Apple Vision Pro still remains something of a mystery to me. But, I have another perspective on where Apple might be going with a potential future product line built around it, and that’s exciting. I also have a whole new perspective on controller-free headsets in general, and that’s very exciting.

You can listen to the whole “XR Talks with ARPost: Episode 10 – Another Take on Apple’s Entrance” below, or on Spotify.

A Tech Investor’s Take on the Apple Vision Pro Read More »

Apple Vision Pro: A Catalyst for the Growth of the XR Industry

Apple Inc., apple vision pro, extended reality, featured, MR glasses, MR headsets, Sponsored / Blake Jones / July 4, 2023

A New Era in Immersive Technology

The Vision Pro’s unveiling at Apple’s Worldwide Developer Conference (WWDC) generated a buzz in the XR world. It has triggered both commendations and criticisms from the global XR community, with its future potential and implications for the broader XR landscape hotly debated.

Apple’s Vision Pro is a spatial computer that seamlessly blends digital content with the physical world, marking a significant step forward in immersive technology.

Apple Vision Pro - headset

According to the company, it uses a “fully three-dimensional user interface controlled by the most natural and intuitive inputs possible – a user’s eyes, hands, and voice.” This marks a departure from traditional interaction methods, offering a more immersive experience for users.

A panel of global executives from the immersive tech industry weighed in on the device, discussing its potential use cases, and how it would impact the global XR community. The consensus was that the Vision Pro represented a significant leap forward in the development of XR technology, setting the stage for exciting advancements in the field.

The Potential of the Vision Pro

The Vision Pro’s introduction has been described as one of the “watershed moments” for the VR and AR industry. The device with enormous potential is poised to breathe new life into the XR space, with two of the world’s largest tech giants, Apple and Meta Platforms (formerly Facebook), now vying for market share.

The Vision Pro’s announcement has spurred conversations and expectations that “spatial computing” will become an integral part of everyday life, much like how other Apple devices have seamlessly integrated into our daily personal and professional lives.

Apple has a remarkable track record of introducing technology that resonates with individuals on a personal level. The company’s knack for creating products that enhance individuals’ lives, work, and well-being has been a crucial factor in their widespread adoption.

Vision Pro: Design and Features

The Vision Pro comes with a clean, sleek design, and high-quality features – a standard we’ve come to expect from Apple. The device is controlled using our hands, rather than external controllers, making it more intuitive and user-friendly.

Apple has prioritized its use cases within its existing ecosystem of apps and content. This strategic move sets Vision Pro apart from its competitors, providing a unique selling proposition.

The device’s hardware is impressive, but its real strength lies in the software experience it offers. Vision Pro introduces a new dimension to personal computing by transforming how users interact with their favorite apps, enhancing productivity and entertainment experiences.

The Impact on the XR Market

The Vision Pro’s introduction has the potential to reshape the XR market. Apple’s entry into the XR space is expected to boost confidence, incite competition, and accelerate advancements in other headsets. This would lead to more people using mixed reality headsets in their day-to-day lives, accelerating use cases for enterprises and industries.

On the other hand, the device’s high price point suggests that it will initially find more success among corporate entities and developers. Companies could use the Vision Pro to create immersive experiences at events, while developers could use it to build innovative apps and content for the device.

At VR Vision, for example, we see enormous potential in the application of virtual reality training for enterprise applications, and the Vision Pro will only enable further innovation in that sector.

It is much safer and cost-effective to operate heavy machinery in the virtual world than in the real world for training. This has applicability across a wide array of industries and use cases and it will be interesting to see just how impactful it truly becomes.

The Vision Pro’s Presentation

Apple’s presentation of the Vision Pro was impressive, ticking many boxes. It showcased significant advancements in hardware and software, demonstrating how the device could offer a hands-free, intuitive experience. The demonstration also highlighted how spatial computing and the new user experience could spur creative content development.

However, some critics felt that the presentation didn’t fully demonstrate the range of VR activities that Vision Pro could achieve. There was a focus on ‘looking and clicking’ functions, which could also be performed on a smartphone. More emphasis could have been placed on the device’s potential for workplace and communication applications.

The Target Audience and Use Cases

The Vision Pro’s high price point suggests that its target audience will initially be businesses and developers. The device could revolutionize workplace training and education, enhancing engagement with learning materials, and streamlining work processes.

Apple Vision Pro

For developers, the Vision Pro represents an opportunity to experiment and innovate. Apple’s established App Store and developer community provide a strong launchpad for the creation of apps and content for Vision Pro. These early adopters may not create polished work initially, but their experiments and ideas will likely flourish in the coming years.

The Role of Vision Pro in the XR Market

Apple’s history of developing proprietary technology and working internally suggests that the Vision Pro will likely follow a similar path. The company’s commitment to quality control, unique design processes, and product development control has given Apple devices their distinctive look and feel.

While it’s difficult to predict the future, interoperability between headsets will likely mirror the landscape of Android and Apple smartphones or Mac and Windows computers. The Vision Pro will likely stand out in the market for its unique feel, best-in-class visuals and technology, and intuitive user experiences, maintaining the overall cohesion between various Apple devices.

Enhancing App Development With Unity

The integration of Unity’s development platform with Vision Pro enables developers to leverage the device’s capabilities and create compelling AR experiences.

Unity’s robust toolset offers a wide range of features, including real-time rendering, physics simulation, and advanced animation systems, all optimized for the Vision Pro’s hardware.

This seamless integration allows developers to focus on unleashing their creativity and designing immersive experiences that blur the line between the physical and virtual worlds.

The Vision Pro holds immense potential for a wide range of industries. From gaming and entertainment to education, healthcare, and industrial training, the device opens up avenues for innovative applications. Imagine interactive virtual tours of historical sites, immersive educational experiences, or real-time collaborative design and engineering projects. The Vision Pro’s spatial computing capabilities pave the way for a future where digital content seamlessly blends with our physical reality, transforming the way we learn, work, and entertain ourselves.

Apple’s Vision Pro: A Boost for Meta

Apple’s entry into the XR market could be a boon for Meta. Despite the criticisms and challenges Meta has faced, its headsets have consistently offered the best value in their class, with excellent hardware and a great game library, all at an attractive price.

The introduction of the Vision Pro could force Meta to step up its game, enhancing its software offerings and improving its user experience. The competition from Apple could ultimately lead to better products from Meta, benefiting users and developers alike.

Conclusion

The introduction of the Apple Vision Pro represents a significant milestone in the XR industry. Its potential impact extends beyond its impressive hardware and software features, setting the stage for exciting advancements in the field.

With Apple now a major player in the XR space, the industry is poised for a surge in growth and evolution. The Vision Pro’s introduction could lead to more investment in R&D, a flourishing supply chain, and an influx of developers eager to create innovative experiences for the device.

Undoubtedly, the Vision Pro marks the beginning of a new era in immersive technology, and its impact on the XR industry will be felt for years to come.

Written by Lorne Fade, COO at VR Vision

Apple Vision Pro: A Catalyst for the Growth of the XR Industry Read More »

Is Apple Vision Pro Ready for Mainstream Use?

Apple Inc., apple vision pro, AR glasses, featured, interview, Mixed Reality, MR glasses, opinion, trending / Mike M. / June 28, 2023

The long wait for a mixed reality headset from Apple will soon be over with the recent launch of Apple Vision Pro. Earlier this month, Apple unveiled its highly anticipated XR headset at the WWDC 2023 event. The Apple Vision Pro is set to hit US Apple stores in early 2024.

Being the first major hardware launch of Apple after almost a decade, the Vision Pro is expected to be received with great enthusiasm. While it’s an undoubtedly powerful device packed with state-of-the-art features, the question remains: Is the Apple Vision Pro truly ready for mainstream use?

To delve deeper into how this development impacts the future of XR, we asked some experts to share their insights on Apple Vision Pro.

Apple Vision Pro: Pushing the Boundaries of Mixed Reality Technology

Compared with other available AR and MR headsets, Apple Vision Pro has raised the bar in several aspects. For Dominik Angerer, CEO of headless CMS Storyblok, this launch could potentially be another “‘iPhone moment’ for Apple, pushing the boundaries of how we perceive and interact with digital content.”

Nathan Robinson, CEO of Gemba, finds the technology sleek, responsive, comfortable, and highly performant. According to him, Apple’s user-centric design philosophy is evident in the Vision Pro’s external battery pack, wide articulated headband, and visual passthrough capabilities—all ensuring comfort and convenience even for extended use.

Michael Hoffman, Mesmerise Head of Platform and CEO of IQXR, also highlights the unparalleled ergonomics of the Vision Pro. For him, the Fit Dial that enables adjustment for a precise fit, the Light Seal that creates a tight yet comfortable fit, and multiple size options will all be crucial to the success of the product.

Performance-wise, experts agree that Vision Pro is powerful. Emma Ridderstad, CEO of Warpin Reality, believes that the use of two chips, R1 and M2, will improve real-time processing, reducing the amount of lag time experienced while using the headset.

However, some experts aren’t that impressed. Eric Alexander, founder and CEO of Soundscape VR, thinks that the Vision Pro is strong for a mobile headset but still pales in comparison to PC VR. “The sprawling, highly-detailed, 3D rendered worlds we build here at Soundscape won’t be possible on the Vision Pro yet as their M2 chip has less than 10% of the rendering horsepower of an Nvidia GPU,” he told us.

For Joseph Toma, CEO of the virtual meetings and events platform Jugo, the Vision Pro’s hardware can be overkill, no matter how powerful it is. He notes that advances in spatial AI, augmented reality, and mixed reality AI make bulky hardware unnecessary. “Apple’s Vision Pro may not be the product that ushers in this new era. While the tech is great, the future is about building something that includes everyone and can deliver mixed reality experiences without the constraints of bulky hardware,” Toma said.

Is the Apple Vision Pro Truly Ready for Mainstream Use?

While the Apple Vision Pro represents a significant leap forward in mixed reality technology, experts have varying opinions on its readiness for mainstream adoption.

apple vision pro

Some argue that its current price point and the need for continuous advancements in software and content might limit its appeal. Others point out that existing platforms already offer immersive experiences without the need for bulky hardware, and Apple might face challenges in convincing the masses to invest in the Vision Pro.

Retailing at $3,499, the cost of the Apple Vision Pro is several times over the $499 price tag of the Meta Quest 3. For Robinson, this prohibitive price will be a large contributing factor to a slow adoption curve. However, he believes as the price falls and the number of applications grows over time, this technology will gain a much wider audience.

While Hoffman also sees the need for more cost-effective options, he believes that Vision Pro is ready for mainstream adoption. “Vision Pro is absolutely ready for mainstream adoption, especially because it’s made by Apple,” he said. “Once Apple launches a product, users typically flock to it.”

Still, some experts believe that Vision Pro isn’t ready for mainstream adoption yet. While initially impressed with the headset, Ridderstad noticed features that were centered around “looking and clicking” rather than 3D VR interactions. “I do think that Vision Pro won’t be ready for mainstream adoption until there’s been a few iterations of the headset,” she told us. “We’ll need to see some evolution from Apple in order to make mixed reality truly mainstream.”

For Alexander, the mainstream adoption of Vision Pro is still a few years out. Although he doesn’t see the price point being a hindrance to adoption, he believes that developers need time to build compelling apps that give people something to do on these devices outside of the novelty factor.

Toma, sharing a similar sentiment, said that, even though “the merging of the tangible and virtual worlds is an impending reality,” we’re still far from seeing these tools adopted on a massive scale by consumers and businesses. “The Vision Pro’s success depends on whether consumers will embrace a bulky, expensive piece of hardware they don’t need for the immersive experience Apple is promoting,” he said.

However, as Angerer points out, “Every technological leap comes with its share of skepticism.” While he understands why there are those who argue that Apple’s headset is not ready for mainstream adoption because of its size, he believes it’s important to remember that Apple has consistently placed high importance on balancing aesthetics with practicality. “Existing platforms may offer similar experiences, but Apple’s unique selling proposition often lies in its seamless user experience and integration across devices, which could give Vision Pro an edge,” he said.

Reshaping Industries: Applications of Apple Vision Pro and Other MR Headsets

Regardless of their readiness for mainstream use, mixed reality headsets like the Apple Vision Pro have the potential to transform various industries. Experts foresee numerous applications in fields such as healthcare, education, architecture, and entertainment.

In healthcare, for instance, mixed reality can aid in surgical simulations and remote medical consultations. In education, immersive learning experiences can enhance student engagement and comprehension. Architects can utilize mixed reality to visualize designs in real-world environments, while the entertainment industry can create entirely new levels of interactive experiences for consumers.

According to Hoffman, Vision Pro will be a game changer that unlocks high-value enterprise use cases. “Collaboration is essential for most scenarios that merge the physical and virtual. To be viable, eye contact is key for co-located participants, and faithfully conveying gaze and facial expressions is key for remote participants,” he explained. “Apple masterfully tackles both, making it possible to collaborate with any combination of co-located and remote participants where everyone wears a device. This combining of the physical and virtual worlds is critical for so many scenarios: task guidance, IoT digital twins, skills training, AI-enhanced inspections, augmented surgery, logistics, and space planning.”

A Promising Outlook for Apple Vision Pro and Mixed Reality Technology

As industry experts have highlighted, factors such as pricing, content availability, and competing platforms could influence its widespread acceptance. Nonetheless, Vision Pro and other mixed reality headsets are set to reshape industries and open new possibilities. The future of mixed reality holds immense promise with continued advancements and a growing ecosystem, and the Apple Vision Pro stands at the forefront of this transformative journey.

Is Apple Vision Pro Ready for Mainstream Use? Read More »

Meta Quest 3 and Apple Vision Pro: A Tale of Two Headsets

Apple Inc., apple vision pro, AR glasses, featured, quest 3, trending, VR headsets, XR Headsets / Ryan Harris / June 8, 2023

Both Apple and Meta revealed highly anticipated headsets in the last seven days. The hype is just about the only thing they have in common. The two headsets have different audiences, different affordances and requirements, and drastically different price points. As such, they illuminate two drastically different approaches to the XR space.

The Meta Quest 3

The Meta Quest 3 has been the subject of rumors, speculation, leaks, and outright fabrication probably since before the Quest 2 came out. But, it was officially announced last week and is set to launch this fall.

The headset has been relatively easy to speculate on, seeing as it is the fourth iteration of flagship headsets in a familiar and built-out hardware and software ecosystem. As was largely expected, the Quest 3 appears to largely be a blend of the successful elements of the Quest 2 and some of the more advanced features that we saw from the Quest Pro.

From fairly early on, the Quest Pro was largely seen as a dev kit and a testing ground for future products. Pro hallmarks coming to the Quest 3 include color passthrough and the Pro controllers. The price of the Quest 3 is significantly less expensive than the Quest Pro, if slightly more expensive than the Quest 2, coming in at $499.

Following the announcement, most of what we have to go on as far as what kind of punch the Quest 3 packs still does largely come from speculation. Where previous Quest headsets were announced at last year’s Connect – Meta’s biggest annual event – the Quest 3 was announced through a relatively low-key social media campaign on the morning of the Meta Gaming Showcase.

Meta Quest 3 headset

As anticipated as the Quest 3 has been, it might not be the most hyped headset of all time – or even the most hyped headset to come out this week. Meta’s seemingly hasty announcement of the Quest 3 seems to have been timed to come out before Apple’s announcement of the Vision Pro.

The Apple Vision Pro

Apple’s entry into XR has long been awaited – if only because the company has repeatedly put off announcing a product. So, after all of the wait, what can the headset actually do?

The headset’s 12 cameras, five sensors, and six mics enable controller-free tracking, voice interactions, and impressive audio. Connected to a device it can run all day, but a battery pack will let it run on its own for two hours. Apple reported over 10 million pixels per eye, but did not release familiar resolution metrics or field-of-view.

The headset is capable of handling 3D assets sent via messages, and it constructs a 3D avatar that can be used in video calls. Developers with early access include JigSpace, and the headset’s software is compatible with Unity.

All of that said, currently available material doesn’t show a lot of actual XR content. The headset arguably looks more like what industry insiders call an “AR viewer” – that is, rather than providing spatial content, it provides a spatial interface for 2D content. That also made up the bulk of Apple’s demonstrations of the headset – and their justification for its massive price tag.

“If you purchased a new state-of-the-art TV, surround-sound system, powerful computer with multiple high-definition displays, a high-end camera, and more, you still would not have come close to what Vision Pro delivers,” Apple’s Technology Development Group VP Mike Rockwell said in the WWDC event that introduced the device. “Apple Vision Pro starts at $3,499.”

Apple Vision Pro headset

That raises an interesting question for the XR community. An Apple Vision Pro might be able to replace all of those things. But, could it replace a Meta Quest?

New Headsets and the XR Ecosystem

Both the Quest 3 and the Apple Vision Pro had XR experts excited. Many aren’t necessarily viewing the two headsets as in competition, but are rather thinking about how the headsets’ introduction will affect the general XR ecosystem.

“The Quest 3 has finally been announced, which is great for everyone in the industry,” 3lbXR and 3lb Games CEO Robin Moulder said in a talk at this year’s Augmented World Expo. “Next week is going to be a whole new level when Apple announces something – hopefully.”

On the morning of the third day of AWE, the Quest 3 had been announced just an hour or so earlier and the Apple announcement had yet to be aired. However, a number of speakers presented the same idea – this is an exciting time for XR and Apple is contributing to that momentum rather than creating that momentum on its own.

A Bushel of Apples in XR…

One of the XR community’s biggest hopes regarding Apple’s entrance into the market is that XR will be catapulted to the mainstream by Apple’s gravitas. One of the main concerns is that Apple tends to play by their own rules, so a wave of new Apple XR users might be disruptive (or at least, not additive) to XR’s established ecosystem. Not all share this concern.

“If Apple does announce something, they’ll do a lot of education,” Khronos Group President Neil Trevett said during a panel at AWE. “It will progress how people use the tech whether they use open standards or not.”

Now that we’ve seen from Apple, it’s worth wondering how much education would be involved. The Vision Pro seems largely intent on offering a spatial view of Apple’s apps rather than on incorporating existing XR solutions and uses.

“Apple is not seeking to build a wide XR ecosystem with a cheaper device, like Meta with the Quest line-up,” XR analyst Tom Ffiske wrote on the headset. “The company instead seeks to monetize an already-lucrative subsection of its audience with high-margin subscriptions and software, accessible at a $3,499 price tag.”

Make no mistake: at least for now, Apple Reality Pro is another Apple device within the Apple hardware ecosystem. It is not a new XR device within anything like a metaverse ecosystem.

Apple Vision Pro

“Apple Reality Pro’s biggest advantage is integration into the Apple ecosystem,” VRDirect founder and CEO Rolf Illenberger said in an email shared with ARPost. “The all-important ability to go from the iPhone, to iPad, to Apple Watch with a similar user experience and low barrier to entry… That’s where we believe the potential exists to create believers in AR.”

Mesmerise Head of Platform, Michael Hoffman, is of the same opinion, “Compatibility with other iOS devices will also help the headset integrate more seamlessly into daily life.”

…Or a Rush on Pears?

The next question is whether Apple can bring people into XR without the Vision Pro. Meta (ignoring its various evils) did a lot to introduce people into the XR universe through incredibly low price points. This is not a game that Apple is playing at all – there probably won’t be too many Vision Pro headsets sitting under Christmas trees this year.

That doesn’t mean that Vision Pro doesn’t have a future. After all, this is the first iteration and it hasn’t even hit the market yet.

“The wire may prevent some users from purchasing the product, and the price tag will scare away many people,” Mytaverse CTO and co-founder Jamie Lopez said in an email shared with ARPost. “But Apple has a long history of lowering prices and making new hardware easier to use. Time will tell how Vision Pro changes the world.”

Still, the announcement may have brought people’s attention to XR in the shorter term. If the sticker shock scares them away from the Vision Pro but doesn’t scare them away from XR, they may find that a lot of what the Vision Pro announcement demoed is already possible on far more affordable headsets.

#WWDC23 pic.twitter.com/FVB2iu5zy0

— XREAL 👓 (@XREAL_Global) June 6, 2023

XREAL (formerly Nreal) made this connection on Twitter and, (potentially unpopular opinion) I didn’t see Apple showing the Vision Pro doing a whole lot of things that the XREAL Air can’t do – and the XREAL Air is literally a tenth of the price.

To be clear, Apple claims sarcastically high resolution for the Vision Pro. This allows users to do things like read emails and webpage text in-headset. This is still a bit of a tall order for products like XREAL.

Advancing Next-Generation Inputs

“By the time we have the Apple headset and the new Quest 3, everybody is going to be freaking out about how great hand tracking is and moving into this new world of possibilities,” said Moulder.

Hand-tracking does play a huge part in the Vision Pro announcement, as the Vision Pro doesn’t have controllers. While it can connect to other devices like Bluetooth keyboards, the headset uses a combination of gaze tracking, hand tracking, and voice commands – which was a first sign that the headset might not be particularly robust for applications like gaming.

Meta, on the other hand, has been experimenting with inputs like voice and gesture controls since the Quest 2, but is by no means ditching the controllers. As cool as gesture recognition is, more robust applications like games and enterprise applications require more nuanced controls – and for now, that still means buttons.

For what it’s worth, Moulder advocated for an input system that uses one controller for things like conjuring menus and one free hand for fine interactions. I would like to see a system like that work with applications like Nanome that provides intuitive interactions that would be great with hand tracking, but provides enough interactions that controllers are still the only way to go.

“Current hand tracking technology does not meet the needs that 6DoF controllers can provide, which consumer AR glasses don’t,” Nanome co-founder and CEO Steve McCloskey told ARPost in a recent in-platform interview.

Time Will Tell

Will flocks of people buy the Apple Vision Pro? Will those that don’t, pick up headsets like the Quest 3 or even consumer AR glasses? Do Quest 3 and Apple Vision Pro exist in the same market, or was Zuckerberg wrong to time his announcement in a way that forced the two headsets into an artificial narrative? All I know is, it’s going to be an interesting couple of years.

Meta Quest 3 and Apple Vision Pro: A Tale of Two Headsets Read More »

AWE USA 2023 Day Three: Eyes on Apple

AI, Apple Inc., AR/VR events, augmented reality, AWE, Events, extended reality, featured, Meta, trending / Ryan Harris / June 6, 2023

The last, third day of AWE USA 2023 took place on Friday, June 2. The first day of AWE is largely dominated by keynotes. A lot of air on the second day is taken up by the expo floor opening. By the third day, the keynotes are done, the expo floor starts to get packed away, and panel discussions and developer talks rule the day. And Apple ruled a lot of those talks.

Bracing for Impact From Apple

A big shift is expected this week as Apple is expected to announce its entrance into the XR market. The writing has been on the wall for a long time.

Rumors have probably been circulating for longer than many readers have even been watching XR. ARPost started speculating in 2018 on a 2019 release. Five years of radio silence later and we had reports that the product would be delayed indefinitely.

The rumor mill is back in operation with an expected launch this week (Apple’s WWDC23 starts today) – with many suggesting that Meta’s sudden announcement of the Quest 3 is a harbinger. Whether an Apple entrance is real this time or not, AWE is bracing itself.

Suspicion on Standards

Let’s take a step back and look at a conversation that happened on AWE USA 2023 Day Two, but is very pertinent to the emerging Apple narrative.

The “Building Open Standards for the Metaverse” panel moderated by Moor Insights and Strategy Senior Analyst Anshel Sag brought together XR Safety Initiative (XRSI) founder and CEO Kavya Pearlman, XRSI Advisor Elizabeth Rothman, and Khronos Group President Neil Trevett.

Apple’s tendency to operate outside of standards was discussed. Even prior to their entrance into the market, this has caused problems for XR app developers – Apple devices even have a different way of sensing depth than Android devices. XR glasses tend to come out first or only on Android in part because of Android’s more open ecosystem.

“Apple currently holds so much power that they could say ‘This is the way we’re going to go.’ and the Metaverse Standards Forum could stand up and say ‘No.’,” said Pearlman, expressing concern over accessibility of “the next generation of the internet”.

Trevett expressed a different approach, saying that standards should present the best option, not the only option. While standards are more useful the more groups use them, competition is helpful and shows diversity in the industry. And diversity in the industry is what sets Apple apart.

“If Apple does announce something, they’ll do a lot of education … it will progress how people use the tech whether they use open standards or not,” said Trevett. “If you don’t have a competitor on the proprietary end of the spectrum, that’s when you should start to worry because it means that no one cares enough about what you’re doing.”

Hope for New Displays

On Day Three, KGOn Tech LLC’s resident optics expert Karl Guttag presented an early morning developer session on “Optical Versus Passthrough Mixed Reality.” Guttag has been justifiably critical of Meta Quest Pro’s passthrough in particular. Even for optical XR, he expressed skepticism about a screen replacement, which is what the Apple headset is largely rumored to be.

karl guttag AWE 2023 Day 3 — *Karl Guttag*

“One of our biggest issues in the market is expectations vs. reality,” said Guttag. “What is hard in optical AR is easy in passthrough and vice versa. I see very little overlap in applications … there is also very little overlap in device requirements.”

A New Generation of Interaction

“The Quest 3 has finally been announced, which is great for everyone in the industry,” 3lbXR and 3lb Games CEO Robin Moulder said in her talk “Expand Your Reach: Ditch the Controllers and Jump into Mixed Reality.” “Next week is going to be a whole new level when Apple announces something – hopefully.”

robin moulder AWE 2023 Day 3 — *Robin Moulder*

Moulder presented the next round of headsets as the first of a generation that will hopefully be user-friendly enough to increase adoption and deployment bringing more users and creators into the XR ecosystem.

More on AI

AI isn’t distracting anyone from XR and Apple isn’t distracting anyone from AI. Apple appearing as a conference theme doesn’t mean that anyone was done talking about AI. If you’re sick of reading about AI, at least read the first section below.

Lucid Realities: A Glimpse Into the Current State of Generative AI

After two full days of people talking about how AI is a magical world generator that’s going to take the task of content creation off of the shoulders of builders, Microsoft Research Engineer Jasmine Roberts set the record straight.

jasmine roberts AWE 2023 — *Jasmine Roberts*

“We’ve passed through this techno-optimist state into dystopia and neither of those are good,” said Roberts. “When people think that [AI] can replace writers, it’s not really meant to do that. You still need human supervisors.”

AI not being able to do everything that a lot of people think it can isn’t the end of the world. A lot of the things that people want AI to do is already possible through other less glamorous tools.

“A lot of what people want from generative AI, they can actually get from procedural generation,” said Roberts. “There are some situations where you need bespoke assets so generative AI wouldn’t really cut it.”

Roberts isn’t against AI – her presentation was simply illustrating that it doesn’t work the way that some industry outsiders are being led to believe. That isn’t the same as saying that it doesn’t work. In fact, she brought a demo of an upcoming AI-powered Clippy. (You remember Clippy, right?)

Augmented Ecologies

Roberts was talking about the limitations of AI. The “Augmented Ecologies” panel moderated by AWE co-founder Tish Shute, saw Three Dog Labs founder Sean White, Morpheus XR CTO Anselm Hook, and Croquet founder and CTO David A. Smith talking about what happens when AI is the new dominant life form on planet Earth.

Tish Shute, Sean White, Anselm Hook, and David Smith - AWE 2023 Day 3 — *From left to right: Tish Shute, Sean White, Anselm Hook, and David Smith*

“We’re kind of moving to a probabilistic model, it’s less deterministic, which is much more in line with ecological models,” said White.

This talk presented the scenario in which developers are no longer the ones running the show. AI takes on a life of its own, and that life is more capable than ours.

“In an ecology, we’re not necessarily at the center, we’re part of the system,” said Hook. “We’re not necessarily able to dominate the technologies that are out there anymore.”

This might scare you, but it doesn’t scare Smith. Smith described a future in which AI becomes the legacy that can live in environments that humans never can, like the reaches of space.

“The metaverse and AI are going to redefine what it means to be human,” said Smith. “Ecosystems are not healthy if they are not evolving.”

“No Longer the Apex”

On the morning of Day Two, the Virtual World Society and the VR/AR Association hosted a very special breakfast. Invited were some of the most influential leaders in the immersive technology space. The goal was to discuss the health and future of the XR industry.

The findings will be presented in a report, but some of the concepts were also presented at “Spatial Computing for All” – a fireside chat with Virtual World Society Founder Tom Furness, HTC China President Alvin Graylin, and moderated by technology consultant Linda Ricci.

The major takeaway was that the industry insiders aren’t particularly worried about the next few years. After that, the way in which we do work might start to change and that might have to change the ways that we think about ourselves and value our identities in a changing society.

AWE Is Changing Too

During the show wrap-up, Ori Inbar had some big news. “AWE is leveling up to LA.” This was the fourteenth AWE. Every AWE, except for one year when the entire conference was virtual because of the COVID-19 pandemic, has been in Santa Clara. But, the conference has grown so much that it’s time to move.

AWE 2024 in LA

“I think we realized this year that we were kind of busting at the seams,” said Inbar. “We need a lot more space.”

The conference, which will take place from June 18-20 will be in Long Beach, with “super, super early bird tickets” available for the next few weeks.

Yes, There’s Still More

Most of the Auggie Awards and the winners of Inbar’s climate challenge were announced during a ceremony on the evening of Day Two. During the event wrap-up, the final three Auggies were awarded. We didn’t forget, we just didn’t have room for them in our coverage.

So, there is one final piece of AWE coverage just on the Auggies. Keep an eye out. Spoiler alert, Apple wasn’t nominated in any of the categories.

AWE USA 2023 Day Three: Eyes on Apple Read More »

Apple AR Glasses Put on Hold to Make Way for MR Glasses – VR and Metaverse Expert Weighs In

Apple Inc., AR glasses, augmented reality, featured, interview, metaverse, virtual reality, women in XR / Mike M. / February 21, 2023

Has Apple bitten more than it could chew? It appears that the long-awaited AR glasses won’t be hitting the shelves any time soon. A Bloomberg article published recently says that the Apple AR glasses are facing technical challenges, so their release has been delayed indefinitely and the project scope pared back. The report also revealed that Apple may instead opt to release a more affordable mixed reality headset.

Emma Ridderstad, CEO and Co-founder of Warpin Reality, shares her insights on the delayed release of the Apple AR glasses and the development of its mixed reality headset, probably to be called Reality Pro. She also shares her thoughts on what these developments mean for the industry, the consumers, and the future of AR/VR.

Apple AR Glasses Shelved to Make Way for an MR Headset

For a couple of years now, Apple has been developing AR glasses that resemble real eyeglasses. The design has already gone through several iterations but still, apparently, fails to meet expectations. While it is unclear where the real problem lies, it is clear that we won’t be seeing through the Apple AR glasses this year.

According to Bloomberg, what we may see soon are MR headsets that combine virtual and augmented reality elements. It was reported that Apple is shifting its focus towards developing a bulkier but less complicated MR headset with a projected price tag of $3,000. The company then plans to follow this with a more affordable version priced at just around $1,500, closer to Meta Quest Pro, though still with a higher price tag.

A Wise Move by Apple

When asked whether the delay of the Apple AR glasses will affect businesses that have already adopted the technology, Ridderstad believes that it would have little impact. Aside from the limited number of businesses currently using Apple’s AR technology, those that have adopted it are not fully reliant on it.

According to Ridderstad, AR/VR technology is still in its infancy. As immersive as these headsets are, they aren’t very convenient. The use cases are still quite limited, and the high cost of both hardware and software can be restrictive. “VR headsets need to become useful to people. Right now, they solve business-to-business problems but they’re still mostly just fun for the end consumer,” Ridderstad explained. So, Apple’s shift from AR glasses to MR headsets makes sense given the broader need to make immersive technology more accessible and affordable.

Ridderstad also believes that Apple will remain a key player in the industry, despite delays on its AR glasses. Consumers continue to trust Apple to produce well-researched and designed products. Considering the price, design, and content of these headsets, the market needs to see more affordable and functional headsets. “Since most people are just starting to see what these new technologies can do, we have to remind ourselves that this evolution is going to take time,” she said. “The real end consumer adoption will probably happen with Apple this time too.”

The True Value of XR Goes Beyond Gaming and Entertainment

XR technology has long been associated with gaming. But Ridderstad argues that the true value of XR lies in its potential in business, training, and education.

Her company, Warpin Reality, has developed a platform called Xelevate, which allows companies to launch customizable VR training courses for their employees. These courses range from safety drills to customer experience simulations and personality development workshops. Platforms like this have allowed construction companies to train their people on safety and equipment use and taught employees what to do during emergencies.

Ridderstad believes that VR/AR can optimize focus, learning, and training. She cites a PwC study that found that VR learners are more focused, learn more quickly, and are more emotionally engaged than e-learners. It could also create opportunities in remote work for those who struggle with in-person demands such as people with disabilities.

Diversity and Accessibility in Tech

For years, the tech industry has been known to be a boys’ club. This still remains true in the metaverse. A McKinsey report found that in organizations shaping metaverse standards, 90% of leadership roles are held by men. Ridderstad warns, “The metaverse is not going to be an environment that people want to be in unless everyone feels welcome and comfortable. I think it is safe to say that unless women play their part in building the metaverse, and take their place among its architects, it won’t be.”

These technologies have the potential to revolutionize the future, so it’s important that they are designed for both men and women to see a higher level of adoption.

Apple AR Glasses Put on Hold to Make Way for MR Glasses – VR and Metaverse Expert Weighs In Read More »