extended reality

with-music-in-new-realities,-we-can-go-deeper-together

With Music In New Realities, We Can Go Deeper Together

 

A look around the media landscape will make it clear that virtual reality has become a major player in the music industry and virtual concerts are on the rise with performances by mainstream artists in popular games and other platforms.

Yet, with all the hope promised by the “metaverse,” not only do these events fail to optimally leverage the innovation of VR, but they also fall short in using music to help create immersive social spaces for people to gather virtually where they feel connected to each other and their humanity.

Today, music-related virtual reality and augmented reality content falls into 3 major categories:

  1. Virtual concerts and music videos by mainstream, popular artists represented by their avatar likeness;
  2. “Rhythm games” and music-making apps focused on popular music;
  3. Music visualizers.

Audiences and Artists Still Adjusting

In the wake of the COVID-19 pandemic and social distancing, many artists are including virtual and hybrid events as part of their tour schedules.

Last year, United Talent Agency (UTA) polls indicated that three out of four people attended online events during the pandemic and, of those, 88% planned to continue even when in-person events came back.

Given the investment in this virtual space by companies including Meta, HTC, ByteDance’s Pico, and soon… Apple with their anticipated headset likely to be announced in 2023, the AR/VR market is a major player in the music industry, even spawning the “Best Metaverse Performance” category in the 2022 MTV VMAs.

With virtual concerts on the rise, major artists like Eminem and Snoop Dogg, Travis Scott, Ariana Grande, and BTS are presenting in-game music events—albeit with mixed results.

Some of these events are being called nothing more than a “kiddie cash grab,” leaving audiences wanting more out of the virtual experience that will truly make use of VR as a medium and a new form of expression.

Possibility for a New Mode of Discovery

There are, however, burgeoning examples of innovative and thoughtful approaches to VR/AR music experiences. The 2018 Sigur Rós and Magic Leap collaboration, Tónandi, demonstrated what can be possible with an immersive and interactive AR music experience, though not currently available on all platforms. This ambitious project featured the Icelandic pop-rock band in a music experience for a high-end AR device that brought music, visuals, and interaction together equally to create a synesthetic experience.

Tónandi - an interactive audio-visual exploration
An interactive audio-visual exploration Tónandi

One of the promises of the metaverse is to bring people together virtually. Traditionally, live music events have been a place where people could gather for a communal experience. This is the missing piece to current VR music events, which have yet to find an organic way for audience members to interact both with the artist and with each other.

Then, there is the possibility of bringing composed scores into virtual spaces, to connect with people’s psyches and emotions as music has done in concert halls, films, and television shows for a long time.

Music and… Miniature Golf?

While not a music-centered app, Mighty Coconut’s Walkabout Mini Golf – a virtual reality game for which I compose the original scores – gives an example of how VR/AR can become a gathering space for people to experience visuals and music while exploring the virtual world or just hanging out together.

VR and music - game Walkabout Mini Golf
VR game Walkabout Mini Golf

Each course presents a captivating world with a distinct mood, created by the music, visuals, and course design that present an alternative to typical VR/AR games and music experiences. Players consider it a place as much as a game, and their connection to the soundtrack has led them to stream it on various services just to bring them back to that sense of place.

VR Music Experience Is Here to Stay

Virtual reality music experiences are here to stay. While VR/AR is currently most strongly associated with games and major companies, there is much to hope for with content put out by independent studios and artists, who are able to be more flexible in adapting to changes in technology and audience demographics. This virtual space will offer new and exciting possibilities for musicians and audiences.

Anyone invested in music going forward—artists, academia, fans, bookers, labels, music supervisors, and even advertisers—would be well advised to keep an eye on VR/AR and to start learning what’s happening in this space.

Like music albums and films, these tools are just another mode of expression for artists to connect to audiences and, hopefully, encourage people to connect with each other.

Guest Post


With Music In New Realities, We Can Go Deeper Together Read More »

how-ar-and-vr-technologies-help-create-phygital-experiences

How AR and VR Technologies Help Create Phygital Experiences

 

The widespread adoption of the so-called “phygital experiences” in consumer markets shows that they have now become the standard. By delivering highly personalized and seamless experiences, they ensure consumers’ unique needs are met and their expectations are exceeded. For brands, phygital is no longer just a trend. It’s also now integral to business sustainability and future growth.

The Increasing Demand for Phygital Experiences

One report shows that a majority of shoppers today feel more comfortable using digital technology. Currently, consumers are going back to in-store shopping post-pandemic. And they continue to look for digital options that make their buying journey more enjoyable. They have come to expect the same personalized experiences that brands offer online when they visit physical stores.

Contactless payments, curbside pickup options, and in-store ordering kiosks are some of the ways brands are delivering these phygital experiences. They offer seamless transitions between digital and physical touchpoints.

These solutions are now commonplace in airports, banks, restaurants, and many other establishments. To enhance in-store experiences, some brands leverage immersive technologies that elevate the digital experiences of consumers.

The Role of AR and VR in Creating Phygital Experiences

To create immersive experiences while ensuring smooth omnichannel journeys, AR and VR play a crucial role. Innovative AR and VR applications effectively meet the consumer demand for phygital experiences in the various channels they use.

Many of us already use these technologies at home. Farfetch, L’Oreal, Wacoal, Warby Parker, and other brands transformed online shopping with virtual try-ons.

Apps like IKEA Place use AR to enable shoppers to virtually place realistically rendered and true-to-scale furnishings into their real physical space.

Marriott International uses VR to help customers plan their events. Used with a headset, their VR app renders three-dimensional views of hotel venues with setups customized for specific social and corporate events.

Brands are bringing these at-home phygital experiences consumers have come to love into their brick-and-mortar shops. For instance, BMW makes car shopping more fun with an AR app that allows shoppers to customize the colors and styles of cars. They also offer VR headsets that let customers experience what it feels like to drive the cars.

Many Nike outlets today are equipped with AR solutions that allow shoppers to scan items to view more detailed information about them. A few years ago, Adidas also launched a unique AR experience in its Paris flagship store. Today, shoppers enjoy immersive experiences at home and in-store through the Adidas app.

Toms offers a similar VR experience that transports shoppers to Peru to see how their contributions to Toms initiatives are helping communities there. This type of immersive experience deepens the connection of consumers to a brand as they get fully immersed in the actual impact of the brand’s advocacy on society.

Other AR and VR applications also elevate shopping experiences. These include in-store navigation, immersive product catalogs, and customization tools. They make phygital experiences more captivating. They also connect consumers to brands on an immersive and more emotional level.

Immersive Technologies Are the Core of Phygital

Phygital experiences will be an inherent part of our future. People will come to expect seamless transitions between digital and physical modes in virtually every aspect of life.

Immersive technologies are fundamental to delivering these experiences. Thus, brands that haven’t done so yet must incorporate immersive solutions into their growth strategy. Aside from allowing brands to meet new consumer demands, immersive tech also enables them to deliver more value that gives them a competitive advantage.

How AR and VR Technologies Help Create Phygital Experiences Read More »

nvidia-and-autodesk-bring-collaborative-xr-experiences-to-the-cloud

NVIDIA and Autodesk Bring Collaborative XR Experiences to the Cloud

 

XR technology is evolving quickly. Today, millions of people use AR and VR as they go through their daily lives. While many of the popular use cases of AR and VR are still in the realm of gaming and entertainment, other industries are finding practical use cases unique to their sectors.

Developments in extended reality are expanding from innovating hardware to elaborating experiences through advanced technologies and accessible systems. In October, tech giants NVIDIA and Autodesk announced the official launch of NVIDIA CloudXR and Autodesk VRED on Amazon Web Services (AWS), a cloud computing platform for users to run their choice of applications and software.

The joint NVIDIA-Autodesk release is available as a “Quick Start” deployment system on AWS. Virtually, any user has access to leverage Autodesk VRED with the powerful NVIDIA CloudXR infrastructure. Embracing a collaborative environment of manipulating and designing high-fidelity immersive XR experiences on the cloud hastens the design workflows of industry professionals. In addition, it advocates accessible extended reality environments, accelerating the adaptability of XR technologies.

Bolstering the Future of Accessible XR Technologies

The world’s first virtual reality (VR) machine was built in 1956 (and patended in 1961)—the Sensorama was a movie booth incorporating 3D, audio, and video with a vibrating seat for an immersive viewing experience.

Inspired by the Sensorama came the development of the world’s first VR headset in 1961. The Headsight headset was built for military operations, complete with motion tracking technology. By 1968, the world witnessed the creation of the first augmented reality headset. Invented by Ivan Sutherland, a Harvard professor, the Sword of Damocles set the blueprint for generating present-day immersive AR experiences.

The long and exciting evolution of XR has yet to reach its turning point: becoming accessible for mainstream use. The general public has yet to have firsthand experience of using extended reality technologies.

The World Economic Forum states that user experience is pivotal to the mainstream success of many technologies, including XR and the metaverse. For now, the target demographic is strongly engaged in 2D platforms, sharing and communicating content in 2D format. Web3 developers have yet to devise a solution for users to relay their immersive experiences to one another.

The Significance of Collaboration for Globally Immersive XR Experiences

The joint decision of NVIDIA and Autodesk to launch their technologies as a “Quick Start” option on AWS is a step forward toward closing the gap between extended reality technologies and mainstream use. Users can now execute NVIDIA CloudXR and Autodesk VRED to create high-quality and immersive XR experiences, anytime, anywhere.

NVIDIA Autodesk VRED on AWS

Autodesk VRED is a 3D visualization solution that professionals in the architecture, engineering, and construction (AEC) industries are familiar with. VRED users design dynamic presentations and interactive environments with real-time 3D assets.

NVIDIA CloudXR is based on NVIDIA RTX technology, delivering seamless streaming of extended reality experiences across various networks—on the cloud, from data centers, or mobile data networks.

Anyone can easily access these technologies via AWS Quick Start. VRED users can maximize designing and streaming immersive XR experiences with the support of NVIDIA CloudXR with dedicated NVIDIA RTX graphic cards and virtual workstation platforms.

Transformative Partnerships to Scale XR Across Industries

The collaborative effort between Autodesk and NVIDIA did not come out of the blue. In fact, NVIDIA has been sealing partnership deals with various tech and automotive firms to scale extended reality in industrial action.

For instance, NVIDIA collaborated with automaker BMW to showcase a digital twin of the brand’s car assembly system. This summer, both NVIDIA and Autodesk collaborated with Lenovo and Varjo to bring Porsche Mission R to life with AR and MR demo.

Germany-based infrastructure company Siemens engaged with NVIDIA to leverage extended reality technologies and the metaverse for the production and manufacturing industries. NVIDIA Omniverse enables digital twin design and simulation of workflows in factories.

Autodesk also collaborated with game developer Epic Games to streamline workflows and tools for AEC designers. In fact, XR headsets manufacturer Varjo worked with Autodesk VRED for AR/VR headset support and remote collaboration through its Reality Cloud platform.

The recent Autodesk University event welcomed industry professionals to discover more of the CloudXR Quick Start option. Featured courses were led by David Randle, the Global Head of GTM for Spatial Computing at AWS.

NVIDIA and Autodesk Bring Collaborative XR Experiences to the Cloud Read More »