In-Car 6-DoF Mixed Reality for Rear-Seat and Co-Driver Entertainment

Conventional VR tracking methods inside a driving vehicle fail out-of-the-box. We present two novel tracking solutions for experiencing a virtual scene on a head-mounted display in a moving vehicle. We leverage advanced vehicle positioning via sensor fusion of existing car sensors to extract an accurate vehicle pose, which we use to mirror car movements virtually. For 6-DoF head-tracking, we exploit IMU-only tracking for two separate approaches - with and without additional hardware. The virtual car, in which the demo user is situated, moves in a virtual urban scene with diverse and appealing VR scenery generated from real world map data.