Ben Kee, founder, creative director, and executive producer of Anomalyst Studio in Singapore recently executed the first mixed reality performance in real time. His team brought a live virtual element to the artist ShiGGa Shay’s live performance at the Global Esports game in 2021. Mixed reality is perhaps a precursor for live events in the metaverse and, as a stakeholder in the performance industry, Kee provides an insight on what the future of events could look like as virtual and ‘real’ realities - will they collide or thrive?
ShiGGa Shay’s live performance at the Global Esports game 2021.
“The pandemic has created a drive towards virtual production even for traditional broadcasters”, Kee explained. Traditional broadcasting is no longer a ‘must’ nor is a show that is entirely subversive and virtual. Mixed reality allows companies like Anomalyst to “experiment with new tools like broadcast AR and live motion capture and create a hybrid experience that is customized so that each event is accessible.” Broadcasting, like any other industry, has to continue to innovate, create engaging content and stay on top of trends. Kee talks about the possibilities in film and TV for Anomalyst: “we have a very mature production company so we could lead the industry in this direction. When filmmakers or show directors look into using these tools they might invest in them. I think TV shows could get better and better with a lot of these virtual elements and the technology involved.”
As a company spearheading the blend of ‘realities’ by combining real-life performance with digitized virtual experiences, Anomalyst Studio have investigated how to improve their events, the technology they use, and their performance goals as a studio: “We want to get to a stage where we can have live virtual characters performing, interacting in real-time with the audience and with other performers.“ said Kee. In the studio founder’s experience, a digital world can mean bringing people closer to a performance and finding more aspects to intrigue and delight them. Technology will be the tool that facilitates more connection, not less: “With live events and virtual experiences, we want to create accessibility and connect every person in a moment. When the metaverse arrives, people will be more exposed to digital content and digital experiences.“
Kee talks about mixed reality performance centering around the art of storytelling, with digital elements adding a layer of energy and vibrancy to the performance - a way to enhance the feeling of connection. "The metaverse provides a chance to come together globally. What I think companies should do is say, 'you could still experience something amazing when you're watching something in a virtual realm- it does not need to be completely virtual.’ There are still live components of the experience and you are still very much connected to reality.” The metaverse will be an actual community rather than just a one-off event and show.
Kee continues, “At the same time, with the development of the metaverse, we are waiting for a new internet that exists in a singular language, and a world which is interoperable so everyone can access it and build on it. “
Kee’s excitement comes from the shared interest there is around the metaverse, "different people, different practitioners are coming together to build something using very similar tools that have been made virtual. The metaverse is a convergence of many different industries and practices. You have the filmmakers, game designers, you have fashion, and you have performance." Having so many stakeholders, there are endless opportunities for what can be done and created in a virtual world, with so many perspectives and insights.
New, improved technology - like motion capture by Xsens has facilitated the creation of a mixed reality world, with creatives like Anomalyst as architects. The Xsens suit, for example, was pivotal in bringing the dancers’ performance to life on stage at Esports Games. “We are mixing realities” delights Kee, “using our own LED volume for XR and AR systems for all in-venue events. What would be exciting for us this year would be to blend live motion capture and AR for a live performance much like League of Legend did in 2019 when there was pre-recorded motion capture.”
Anomalyst Studio is keen to share the storytelling power of hybrid reality performances around with the world: “We’re excited to bring something new to the table. We see our role as warming people up to the live shows and virtual formats that could be very exciting as the metaverse approaches”.
There is a sense of excitement from Anomalyst Studio for what a virtual, mixed reality world could look like and the possibilities for convergence between creative industries. The team is gearing up for the future by adding LED volume for XR and continuing to add interactive elements to their mixed reality performances. Anomalyst Studio looks to improve their work, so they become more and more in tune with the skills needed in the metaverse.’
Choosing the best Xsens mocap setup is not always as straightforward as we like it to be. There will be different options, requirements, and challenges based on each individual's situation.
This is why we've put together a blog to help you make the best decision.