Live Music Enters 3D Worlds

BBC R&D | The BBC’s contribution to the MAX-R EU collaborative project trials the streaming of live music performances into 3D environments, blending volumetric capture with broadcast camera setups. Using multiple angles and video billboards, performances are rendered in virtual spaces like video games. This approach enhances audience interaction, allowing users to experience live music immersively. Ongoing trials refine the integration of lighting, stage effects, and 3D environments, paving the way for future interactive, live music experiences in virtual worlds.

Read More – https://www.bbc.co.uk/rd/articles/2024-09-immersive-augmented-virtual-reality-metaverse-3d

Image – Example of the calibration software being used to match points in the video to an accurate 3D model of the performance space (BBC R&D)