VFX and content creation studio SoKrispy supported post-apocalyptic sensation The Last Of Us, delivering complex previsualization for a one-shot scene using Xsens motion capture technology.
The production team needed to make an impact in the pilot episode, which included detailed shots that required extensive planning. But Covid-19 lockdowns stood in the way.
SoKrispy used industry-leading technology to produce real-time, accurate previs that could be accessed remotely.
Based on the award-winning video game, there were high expectations for The Last of Us, which is why the production team turned to SoKrispy for detailed previsualisation. “We were responsible for a key scene in the pilot where the main character and his daughter are fleeing the outbreak,” says Sam Wickert, CEO of SoKrispy. “This was incredibly complex and would be filmed in one take, so we needed to nail the planning.”
The pandemic meant that the crew needed to find a different approach to previsualization, and the pressure was on for the pilot episode. “Restrictions for the cast and crew meant that everything had to be done remotely,” says Sam. “So we stepped up to find an innovative and efficient way to envisage the scene.”
SoKrispy opted for Xsens inertial motion capture. By pairing Xsens with a digital environment from Unreal Engine and a real-time virtual camera, the previs was streamed directly to the production team via Zoom – no in-person collaboration required.
“The team found Xsens incredibly easy to set up and put into use,” Sam continues. “It doesn’t require a full on-set crew like traditional motion capture techniques.” This made it the perfect option for a production team under lockdown.
Sam and the SoKrispy team worked closely alongside DoP Ksenia Sereda. Over Zoom, she could monitor the process in real time and suggest immediate tweaks.
“Ksenia was able to watch the camera feed as we filmed it,” says Sam. “This made it easy for her to visualize how she would film the scene. As it was a oner within a moving car, it was more complicated than usual, so it was important she could assess the advantages and limitations before going on set.”
Thanks to Unreal Engine world building, the SoKrispy team could create the interior of a car to show through the live feed. The combination of virtual scenery and motion capture meant that the production team had highly accurate footage that could be directly referenced when filming began. Xsens played a major part in enabling fast feedback and an efficient workflow.
The final product bore a striking similarity to the previsualized scene. “Because of Unreal Engine and Xsens, the visuals were clear to the production team,” explains Sam. “This process could have taken weeks, but was instead polished in short web meetings.”
SoKrispy also pioneered facial motion capture in previs, something that was uncommon during the process at the time. Usually, productions expect the general overview of the setting and character movements, but adding facial expressions added an extra layer of detail that was so crucial at a time when everything had to be done digitally.
After their work on the pilot episode, the team traveled to SIGGRAPH for a live showcase using Xsens in the previsualization process. “We were so confident in the suit’s ability to perform,” concludes Sam. “It will be a continuous addition to our future projects.”
Take a look at Xsens inertial motion capture products.