Retour au Lab

The XRaoke, an XR Karaoke Experience

January, 2023

The XR Karaoke experience is the latest hybrid performance prototype by Moment Factory. A hybrid performance is characterized by taking place simultaneously in multiple locations (physical or digital) and engaging a multitude of audiences by connecting them to the performance in a participatory manner.

In an ever-changing entertainment industry and with the convergence of audiences towards the virtual realm, live performance continues to evolve and adapt to a set of new needs. As part of a research and development (R&D) initiative in collaboration with Disguise, we have developed the XR Karaoke, an experience that explores the potential uses of extended reality through the technology of an XR Stage. The goal was to push the physical boundaries of an XR stage and simultaneously engage audiences in-person or remotely.

During a 5-week development period followed by 2 weeks of production, Moment Factory’s Innovation team deconstructed all the elements of a traditional karaoke to create a hybrid experience that can be enjoyed on-site or at home through interactive features that invite viewers, wherever they may be, to participate.

The research and creation process surrounding the XR Karaoke led to the development of a functional, versatile, and modular prototype through collaboration among multiple talents from our creative, interactive, and innovation teams.

Projects of this nature hold significant importance as they provide an opportunity to design and test proof of concepts that influence our future experiences. R&D plays a vital role within Moment Factory, as they allow our innovation team to have the time and resources needed to envision, experiment, learn, and enhance our skills by utilizing unique tools and generating original ideas.

With the XR Karaoke, our team has enriched its expertise in ID and object tracking, real-time responsive content, audio-reactive elements, and dynamic bi-directional DMX control. We created a 3D karaoke stage in Unreal Engine, crafting a set of integrated features and establishing an interactive and responsive ecosystem specifically tailored to the essence of karaoke. This includes a “dynamic” virtual lighting that automatically adjusts to the real lighting of the XR Stage and vice versa.

Projects of this nature hold significant importance as they provide an opportunity to design and test proof of concepts that influence our future experiences. R&D plays a vital role within Moment Factory, as they allow our innovation team to have the time and resources needed to envision, experiment, learn, and enhance our skills by utilizing unique tools and generating original ideas.

 

With the XR Karaoke, our team has enriched its expertise in ID and object tracking, real-time responsive content, audio-reactive elements, and dynamic bi-directional DMX control. We created a 3D karaoke stage in Unreal Engine, crafting a set of integrated features and establishing an interactive and responsive ecosystem specifically tailored to the essence of karaoke. This includes a “dynamic” virtual lighting that automatically adjusts to the real lighting of the XR Stage and vice versa.

https://player.vimeo.com/progressive_redirect/playback/831265961/rendition/1080p/file.mp4?loc=external&signature=3d708348537122b550bfaf529136a60691c66902015e5ec86c5b4efe6f097905

The XR Karaoke is part of a series of prototypes that leverage the XR Stage technologies combined with other Moment Factory proprietary technologies, aiming to create new collaborative, gamified, and participatory XR experiences.

Various prototypes of mixed reality experiences utilizing the XR Stage are currently in development to further explore our artistic and technological vision and creative approach, envisioning the next generation of hybrid performances.

 

If you would like to learn more about the XR Karaoke, you can watch the demo below.

Voici une sélection de projets qui illustrent ce que nous pouvons créer ensemble.