Binaural Monitoring of Surround mixes, with head tracking, pick your budget

QuadraphonicQuad

Help Support QuadraphonicQuad:

This site may earn a commission from merchant affiliate links, including eBay, Amazon, and others.

zeerround

Moderator
Staff member
Moderator
QQ Supporter
Joined
Apr 11, 2010
Messages
996
Starting a separate thread on Binaural Mixing of Surround with head tracking.

Why? Because (once you go beyond 7.1) it becomes challenging for people with home theatre systems to get audio from their computer to their system.

Sure, there are pro Audio devices with more than 8 outputs, but most upmixers aren't going to have AVRs with more than 8 line ins.

HDMI "Should" be the solution, given that the spec (these days) is for 32 channels of un-encoded audio, but sadly I've never seen a computer audio hdmi driver supporting more than 8, and very few AVRs support more than 8 (un-encoded) channels via HDMI.

When it comes to encoded audio via HDMI, there is a solution, coming from me, for windows, but that will be another thread (program is ready but documentation is not).

So that leaves us with using headphones to monitor via virtual surround (Binaural). Turns out there are quite of few products for that these days, some free, and most commercial products starting at around $80 US and going up to the Smyth Realiser A16, at well over $4K US.

In this thread we can discus what we've tested, what we like, and how much it costs, with my goal being hoping to find something that works "good enough" for surround/immersive surround up-remixing, at the lowest possible price, as a fair bit of upmixers are retired, etc.

I'd also like to limit the discussion to those that offer headtracking, as to me that is a critical component to the realism of monitoring surround with headphones. So discussion of head tracking hardware is also on topic. There seem to be a few of those, from build it yourself for less than $20 to the sky is the limit as well.

I've tested a few free plugins, and will write about those, and am currently testing DearVR Monitor (although it may turn out that you also need DearVR Spatial Connect, to get the headtracking (which kicks it out of the budget range), and APL Virtuoso.

I'm using this build it yourself headtracker, in my tests: https://github.com/trsonic/nvsonic-head-tracker which works fine (with some drift over time) and I will be building a second one to see if the drift is any better.

Many plugins refer to this hardware: https://supperware.co.uk/headtracker-overview so I may get one of those to test as well.

Somewhere I have one from Waves: https://www.waves.com/hardware/nx-head-tracker which I bought years back with Waves NX, but stopped using because the camera based headtracking that is part of Waves NX worked better for me.

I guess it needs to be said that how some of these plugins perform for you will be based on your own head and ear shape, as the free and lower priced solutions do not offer self made custom profiles (like the A16 does). Some offer the ability to you a custom profile (SOFA format) if you have one, but getting one made is costly in itself (?).
 
Update on DearVR Monitor. It DOES come with the Spatial Connect Adapter, needed for head tracking. It's just an option in the installer which is unchecked by default.

1737566727370.png


Testing can go forward now.

I also ordered a supperware headtracker. It should arrive the next few days.
 
Yup, and info from the same Youtube channel:

If you have AirPods, and an iPhone/iPad, you should be able to use them with a DAW plugin for headtracking and binaural monitoring, even on Windows.

Added to the pile of stuff to test.
 
Not that this is much help for hobbyists, but I have managed to get the nvsonic tracker working with Dolby Atmos Renderer (binaural).

1737601468136.png


That's a 7.1 bed with 4 objects for the Height channels.

Just in case, here are the nvsonic OSC Bridge settings:

1737601521465.png


Very handy for configuring the nvsonic OSC Bridge for all these different audio apps is the Profiles.txt file that comes with the supperware tracker:

Quaternion (composite)
/quaternion
qw,qx,qy,qz
local 8000

Yaw/Pitch/Roll (learnable)
/[yaw,pitch,roll]
yaw:0,pitch:0,roll:0
local 8000

a1Rotate
/[yaw,pitch,roll]
-yaw,pitch,roll
local 9001

Ambi Head HD
/[yaw,pitch,roll]
-yaw:0,pitch:0,-roll:0
local 4040

APL Virtuoso
/Virtuoso/quat
qw,qy,-qx,qz
local 8000

Audio Brewers
/[yaw,pitch,roll]
yaw:0,pitch:0,roll:0
local 8585

DaVinci Resolve
/ypr
yaw,pitch,roll
local 8000

dearVR
/ypr
yaw,pitch,roll
local 7001

Dolby Atmos Renderer
/ypr
yaw,pitch,roll
local 8000

EAR Production Suite (EBU)
/ypr
-yaw,-pitch,roll
local 8000

Genelec Aural ID
/[euler_x,euler_y,euler_z]
-pitch__,yaw,-roll
local 5005

IEM Scene Rotator quaternion
/SceneRotator/[qw,qx,qy,qz]
qw,-qy,qx,-qz
local 9000

IEM Scene Rotator YPR
/SceneRotator/[yaw,pitch,roll]
yaw,-pitch,-roll
local 9000

Mach1 (M1-Monitor)
/orientation
yaw,pitch,roll
local 9898

Mach1 (M1-VideoPlayer)
/orientation
-yaw,pitch,roll:0
local 9902

Nuendo (HeadPose, 25Hz)
/head_pose
0,0,0,0,-pitch,-yaw,-roll
local 7000

SPARTA
/ypr
-yaw,-pitch,roll
local 9000

SPAT Revolution
/room/1/ypr
yaw,pitch,roll
local 8000

Spatial Audio Designer
/yaw
yaw:0
local 7000
 
Back
Top