VR Tracking

new-quest-dev-tools-to-add-leg-estimation-for-more-convincing-avatars

New Quest Dev Tools to Add Leg Estimation for More Convincing Avatars

Meta announced that it’s offering new developer tools for Quest headsets to make avatars more realistic. The company also unveiled a Quest 3-exclusive upper body tracking feature that supports a much wider range of body motion.

Announced at Connect 2023 late last week, Meta showed off some new features coming both to Quest 3 and the rest of the Quest platform.

On Quest 3, Meta says it will be able to use inside-out sensor data to optically track wrists, elbows, shoulders, and torso—or something the company is calling ‘Inside Out Body Tracking’ (IOBT). The Quest 3-exclusive feature also tracks where your legs are relative to your torso, making avatars capable of bending forward and peering over a cliff.

Image courtesy Meta

By using this upper body data to extrapolate lower body actions, the company says it can make avatars replicate more natural movements than traditional inverse kinematics (IK)-based methods.

The company also announced a feature called ‘Generative Legs’, which is headed to Quest 2/3/Pro in December. The developer tool is said to create more realistic leg movement using either three-point body tracking or the Quest 3-exclusive IOBT. It’s capable of recreating more natural standing and sitting poses, a more lifelike gait when walking, and also supports jumping, ducking and squatting.

Since it’s essentially guessing where your legs might naturally be in any given situation, Generative Legs won’t account for individual leg movement like a dedicated tracker might, such as a SteamVR tracking puck or Sony’s Mocapi motion capture device—that means your avatar can’t do karate or breakdance.

Still, it’s pretty impressive how much better the whole system is in comparison to standard IK. Granted, Quest users won’t be able to pull of the fancy footwork CEO Mark Zuckerberg did on the virtual stage at Connect 2022 last year, but it’s starting to look pretty close.

Check out Meta’s Generative Legs and the new Quest 3 upper body tracking feature in action in a Meta-built showcase app called Dodge Arcade:

New Quest Dev Tools to Add Leg Estimation for More Convincing Avatars Read More »

sony’s-mocap-device-lets-‘vrchat’-users-unleash-their-inner-anime-girl

Sony’s Mocap Device Lets ‘VRChat’ Users Unleash Their Inner Anime Girl

There are a few body tracking solutions on the market to help you on your quest to finally transform into a dancing anime girl, and Sony is now releasing its own previously Japan-only device in the US. 

Mocopi, which gets its name from motion capture (mocap), was initially announced in late 2022, becoming available exclusively in Japan in early 2023. While a ton of vTubers worldwide already jumped the gun and ordered direct from Japan, now Sony is making it officially available in the US, priced at $450.

Mocopi comes with six small and lightweight inertial measurement unit (IMU) sensors that hook into a dedicated smartphone app (iOS and Android), letting you do full-body motion tracking both in and outside of VR.

Image courtesy Sony

And while Mocopi seems to be squarely targeting those would-be vTubers, another use case the company is trumpeting is undoubtably the device’s ability to give avatars better full-body tracking for things like VRChat. Yes, there’s a built-in VRChat integration, which means you can grab your Quest 2 or PC VR headset, hook up Mocopi to your extremities, and get dancing for all to see.

Like many such IMU-based tracking devices, positional drift is a real concern, although it seems Sony is pitching this more as a way to casually jump into body tracking and not get that 100 percent accuracy you’ll need when doing the [fill in a popular dance] on TikTok.

Coming from Sony, you’d think there would be some sort of integration with PSVR 2, although that doesn’t seem to be a possibility. The company hasn’t mentioned any such integration since it initially launched in Japan in January.

Mocopi is already available for purchase, available exclusively from Sony for $450. Sony says Mocopi orders will ship to customers starting July 14th, 2023. Check out the Sony’s quick start guide below to get see just what you’re signing up for.

Sony’s Mocap Device Lets ‘VRChat’ Users Unleash Their Inner Anime Girl Read More »

hands-on:-htc’s-new-standalone-vive-tracker-effortlessly-brings-more-of-your-body-into-vr

Hands-on: HTC’s New Standalone Vive Tracker Effortlessly Brings More of Your Body Into VR

With three versions of SteamVR trackers under its belt, HTC has been a leading enabler of full-body tracking in VR. Now the company’s latest tracker could make it even easier to bring your body into VR.

HTC’s new standalone Vive tracker (still unnamed) has a straightforward goal: work like the company’s existing trackers, but easier and on more platforms.

The ‘easier’ part comes thanks to inside-out tracking—using on-board cameras to allow the device to track its own position, rather than external beacons like those used by the company’s prior trackers.

Photo by Road to VR

To that end, things seem really promising so far. I got to demo the new Vive tracker at GDC 2023 this week and was impressed with how well everything went.

Photo by Road to VR

With two of the new Vive trackers strapped to my feet, I donned a Vive XR Elite headset and jumped into a soccer game. When I looked down at my feet, I saw a pair of virtual soccer shoes. And when I moved my feet in real-life, the soccer shoes moved at the same time. It took less than two seconds for my mind to say ‘hey those are my feet!’, and that’s a testament to both the accuracy and latency being very solid with the new tracker.

That’s not a big deal for older trackers that use SteamVR Tracking, which has long been considered the gold standard for VR tracking. But to replicate a similar level of performance in a completely self-contained device that’s small and robust enough to be worn on your feet… that’s a big deal for those who crave the added immersion that comes with bringing more of your body into VR.

Throughout the course of my demo, my feet were always where I expected to see them. I saw no strange spasms or freezing in place, no desync of coordinate planes between the tracker and the headset, and no drifting of the angle of my feet. That allowed me to easily forget that I was wearing anything special on my feet and simply focus on tracking to kick soccer balls into a goal.

While the tracker worked well throughout, the demo had an odd caveat—I had feet but no legs! That makes it kind of weird to try to juggle a soccer ball when you expect to be able to use your shin as a backboard but watch as the ball rolls right over your virtual foot.

Ostensibly this is the very thing that trackers like this should be able to fix; by attaching two more trackers to my knees, I should be able to have a nearly complete representation of my leg movements in VR, making experiences like ‘soccer in VR’ possible when they simply wouldn’t work otherwise.

I’m not sure if the demo app simply wasn’t designed to handle additional tracking points on the knees, or if the trackers are currently limited to just two, but HTC has confirmed the final inside-out Vive tracker will support up to five trackers in addition to the tracked headset and controllers.

Trackers can, of course, be used to track more than just your body, though apps that support these kinds of tracked accessories are rare | Photo by Road to VR

So the inside-out factor is the ‘easier’ part, but what about the other goal of the tracker—to be available on more platforms than just SteamVR Tracking?

Well, the demo I was playing was actually running purely on the standalone Vive XR Elite. To connect the trackers, a small USB-C dongle needs to be connected to the headset to facilitate the proprietary wireless connection between the dongle and the trackers. HTC says the same dongle can plug into a PC and the trackers will work just fine through SteamVR.

The company also says it’s committed to making the trackers OpenXR compatible, which means (in theory) any headset could support them if they wanted.

– – — – –

I only got to use it in one configuration (on my feet) and in one environment (a large office space). So there’s still the question of how robust they will be. For now though, I’m suitably impressed.

If these trackers really work as well as they seem from their first impression, it could open the door to a new wave of people experiencing the added immersion of full-body tracking in VR… but there’s still the lingering question of price, which historically never seems to be quite right consumer VR market when it comes to HTC. Until then, our fingers shall remain crossed.

Hands-on: HTC’s New Standalone Vive Tracker Effortlessly Brings More of Your Body Into VR Read More »