Binaural Monitoring of Surround mixes, with head tracking, pick your budget

QuadraphonicQuad

Help Support QuadraphonicQuad:

This site may earn a commission from merchant affiliate links, including eBay, Amazon, and others.

zeerround

Moderator
Staff member
Moderator
QQ Supporter
Joined
Apr 11, 2010
Messages
1,007
Starting a separate thread on Binaural Mixing of Surround with head tracking.

Why? Because (once you go beyond 7.1) it becomes challenging for people with home theatre systems to get audio from their computer to their system.

Sure, there are pro Audio devices with more than 8 outputs, but most upmixers aren't going to have AVRs with more than 8 line ins.

HDMI "Should" be the solution, given that the spec (these days) is for 32 channels of un-encoded audio, but sadly I've never seen a computer audio hdmi driver supporting more than 8, and very few AVRs support more than 8 (un-encoded) channels via HDMI.

When it comes to encoded audio via HDMI, there is a solution, coming from me, for windows, but that will be another thread (program is ready but documentation is not).

So that leaves us with using headphones to monitor via virtual surround (Binaural). Turns out there are quite of few products for that these days, some free, and most commercial products starting at around $80 US and going up to the Smyth Realiser A16, at well over $4K US.

In this thread we can discus what we've tested, what we like, and how much it costs, with my goal being hoping to find something that works "good enough" for surround/immersive surround up-remixing, at the lowest possible price, as a fair bit of upmixers are retired, etc.

I'd also like to limit the discussion to those that offer headtracking, as to me that is a critical component to the realism of monitoring surround with headphones. So discussion of head tracking hardware is also on topic. There seem to be a few of those, from build it yourself for less than $20 to the sky is the limit as well.

I've tested a few free plugins, and will write about those, and am currently testing DearVR Monitor (although it may turn out that you also need DearVR Spatial Connect, to get the headtracking (which kicks it out of the budget range), and APL Virtuoso.

I'm using this build it yourself headtracker, in my tests: https://github.com/trsonic/nvsonic-head-tracker which works fine (with some drift over time) and I will be building a second one to see if the drift is any better.

Many plugins refer to this hardware: https://supperware.co.uk/headtracker-overview so I may get one of those to test as well.

Somewhere I have one from Waves: https://www.waves.com/hardware/nx-head-tracker which I bought years back with Waves NX, but stopped using because the camera based headtracking that is part of Waves NX worked better for me.

I guess it needs to be said that how some of these plugins perform for you will be based on your own head and ear shape, as the free and lower priced solutions do not offer self made custom profiles (like the A16 does). Some offer the ability to you a custom profile (SOFA format) if you have one, but getting one made is costly in itself (?).
 
Update on DearVR Monitor. It DOES come with the Spatial Connect Adapter, needed for head tracking. It's just an option in the installer which is unchecked by default.

1737566727370.png


Testing can go forward now.

I also ordered a supperware headtracker. It should arrive the next few days.
 
Yup, and info from the same Youtube channel:

If you have AirPods, and an iPhone/iPad, you should be able to use them with a DAW plugin for headtracking and binaural monitoring, even on Windows.

Added to the pile of stuff to test.
 
Not that this is much help for hobbyists, but I have managed to get the nvsonic tracker working with Dolby Atmos Renderer (binaural).

1737601468136.png


That's a 7.1 bed with 4 objects for the Height channels.

Just in case, here are the nvsonic OSC Bridge settings:

1737601521465.png


Very handy for configuring the nvsonic OSC Bridge for all these different audio apps is the Profiles.txt file that comes with the supperware tracker:

Quaternion (composite)
/quaternion
qw,qx,qy,qz
local 8000

Yaw/Pitch/Roll (learnable)
/[yaw,pitch,roll]
yaw:0,pitch:0,roll:0
local 8000

a1Rotate
/[yaw,pitch,roll]
-yaw,pitch,roll
local 9001

Ambi Head HD
/[yaw,pitch,roll]
-yaw:0,pitch:0,-roll:0
local 4040

APL Virtuoso
/Virtuoso/quat
qw,qy,-qx,qz
local 8000

Audio Brewers
/[yaw,pitch,roll]
yaw:0,pitch:0,roll:0
local 8585

DaVinci Resolve
/ypr
yaw,pitch,roll
local 8000

dearVR
/ypr
yaw,pitch,roll
local 7001

Dolby Atmos Renderer
/ypr
yaw,pitch,roll
local 8000

EAR Production Suite (EBU)
/ypr
-yaw,-pitch,roll
local 8000

Genelec Aural ID
/[euler_x,euler_y,euler_z]
-pitch__,yaw,-roll
local 5005

IEM Scene Rotator quaternion
/SceneRotator/[qw,qx,qy,qz]
qw,-qy,qx,-qz
local 9000

IEM Scene Rotator YPR
/SceneRotator/[yaw,pitch,roll]
yaw,-pitch,-roll
local 9000

Mach1 (M1-Monitor)
/orientation
yaw,pitch,roll
local 9898

Mach1 (M1-VideoPlayer)
/orientation
-yaw,pitch,roll:0
local 9902

Nuendo (HeadPose, 25Hz)
/head_pose
0,0,0,0,-pitch,-yaw,-roll
local 7000

SPARTA
/ypr
-yaw,-pitch,roll
local 9000

SPAT Revolution
/room/1/ypr
yaw,pitch,roll
local 8000

Spatial Audio Designer
/yaw
yaw:0
local 7000
 
I got my Supperware head tracker today. So far so good and one plus is that it hides on or in your headphone band, so people don't tease you about "extra" stuff on top of your head.

From watching the video instructions I learned that if you have headphones with a metal headband, you probably want to turn off headtraker compasses and rely on the gyros. This may apply to any head tracker.

Also I've been reading about these sensors and drift, and the <$20 homemade nvsonic tracker uses a really old sensor and modern sensors have bettor tech and better on board fusion/filtering software to help avoid drift. Problem is the cost of those is getting close to what you would spend on a supperware tracker.

I probably need to do more rigorous testing but so far it looks like supperware for head tracking and APL Virtuoso for monitoring is likely to be winners.


I'm testing two lower cost but popular for mixing headphones (APL Virtuoso support both of them and many more):

Sony MDR 7506​
Beyer DT 7070 Pro (250 ohms)​

Again this reasonable performance at affordable prices (The gold standard being the Smyth Realizer A16 and very high end headphones).
 
1738101098921.png


On the left is supperware bridge, an app that controls and connects the head tracker to plugins. In Reaper, we have the APL Virtuoso plugin, configured for 7.1.4 input and virtual speaker layout, and binaural monitoring via head tracked headphones.

The audio is from a .mogg multitrack of the white stripes 7 Nation Army. Each track has an Rea Surround Pan (included with Reaper), to place the audio into the 7.1.4 space.

Here you can see the supperware headtracker, installed under the headband of the Beyer DT 770 headphones:
1738101582807.png
 
So I’m curious, how does this get implemented?

I’m guessing that a user would have MCH files on a computer and the head-tracker would connect via USB, with the headphones plugged into a stereo jack, but I’m a long ways from being sure. Hell, I still haven’t figured out Roon, so the idea of having a PC as an active element in the signal chain is a bit north of my experience and expertise.
 
Yes you pretty much nailed it. The use case is for up-remixing of stereo to immersive surround formats (would also work for 5.1 or 7.1).

The reason this is needed (for hobbyists) is the cost/complication of more than 8 channel audio interfaces and AVRs with more than 8 channel (analog) line ins. Going Digital vs. Analog (HDMI) there is also a lack of consumer drivers and AVRs that do more than 8 channels of (unencoded) audio (although I have a solution for that, on Windows, coming).

So, this solution is to have virtual 7.1.4, etc. via binaural 2 ch. audio with head tracking.
 
More testing this morning. I'm concluding that the EAR Production Suite Binaural Monitoring is also a good (and free) alternative to APL Virtuoso. It's more complex to setup (I'll work on a single track submaster implementation) and doesn't have headphone, speaker, or room options, but is working pretty good for my head/ears/headphones (Beyer DT 770 Pro 250 ohm).

1738173445967.png


This is with the Supperware head tracker. I'll have to test again with the home brew nvsonic less than $20 to build tracker. So far with every tracker there is going to be some amount of clicking something to recenter as they all "drift". Even with my Smyth Realiser A16, however in that case mine is worse than normal because the A output tracker jack is damaged, so I'm on the B output, which doesn't support optical tracking (in addition to gyro/compass).

Smyth Realiser A16 tracker on Sennheiser HD 800S headphones:

1738173274337.png
 
Back
Top