Partnership Between Bandai Namco Music Live & Bandai Namco Research Institute's VTuber Business

Bandai Namco Music Live and Bandai Namco Research have signed a business alliance to integrate real-time XR technology into the company's MEWLIVE VTuber project. The partnership, announced today, aims to replace traditional post-production compositing with live 3D rendering in real-world environments.

To demonstrate the new pipeline, Bandai Namco released a video today starring MEWLIVE talent Kumano Beatrice at the Asakawa International Trout Fishing Area. Beatrice's official lore establishes her as a magical bear plushie who was adopted by voice actress Koiwai Kotori. This makes her presence at a real-world Japanese trout stream a surreal collision of fiction and reality. Instead of recording the 3D avatar against a green screen and masking it into the live-action footage later, the production used Bandai Namco Research's ELMIRAIVE CX system to composite the character into the physical location in real time.

Rendering a bear in a river

The ELMIRAIVE CX system is a portable character control setup developed by Bandai Namco's R&D wing. Bandai Namco Research usually focuses on AI, IoT, and broader XR applications for the company's arcade and facility entertainment divisions. By bringing that hardware to Bandai Namco Music Live, the goal is to make location shoots and live stage events viable for virtual talents without the massive rendering delays usually associated with AR broadcasting.

There is something inherently funny about deploying cutting-edge, proprietary corporate rendering technology just to watch an anime girl try to catch a trout. The technical implications, however, are solid. Location shoots for VTubers typically require massive post-production work to match lighting, shadows, and camera movement. Doing it live on a portable rig cuts that bottleneck entirely.

Unpredictable sunlight

Real-time compositing in an uncontrolled outdoor environment is notoriously difficult. A studio setting allows engineers to lock down the lighting and camera tracking. A riverbank introduces unpredictable sunlight, moving water, and uneven terrain. The ELMIRAIVE CX system has to track the physical camera's position and adjust the virtual character's lighting and shadows on the fly to prevent the avatar from looking like a flat sticker pasted over the video feed.

The new XR pipeline will be integrated into the MEWLIVE PROJECT production starting this summer.

The VTuber market has ballooned since the early days of static Live2D models. Major agencies are constantly looking for ways to bridge the gap between virtual talents and physical spaces. If Bandai Namco can reliably stream 3D avatars interacting with real-world environments on the fly, it opens up a lot of weird, interesting possibilities for live broadcasting.