All of It Now delivered a mix of augmented reality experiences
USA - All of it Now (AOIN), a virtual art department and in-camera VFX integration solutions provider, never shies away from pushing the boundaries of creativity. Coachella 2023 proved to be the perfect canvas for their latest artistic endeavour, which involved crafting augmented reality (AR) experiences to captivate one of the most demanding audiences on the festival circuit.
AOIN turned to Stage Precision’s SP software, a powerful data and control management software they had used before, but now hoped to deploy on a much grander scale.
As the sun rose on Coachella 2023, AOIN faced several challenges. The project brief included enhancing the main stage livestream broadcast to create a new augmented reality platform for artists including Gorillaz, Bad Bunny and Blackpink.
As a central component of Coachella's 2023 marketing campaign, Coachella introduced the "mirage effect", an interstitial element that combined real-world objects with digital elements, a task undertaken within Unreal Engine's real-time compositing pipeline. To achieve this, AOIN collaborated closely with Nexus, and stYpe's team to develop a custom compositing solution.
"The Coachella project was challenging because we had to manage a large amount of content as well as send out a large amount of data to trigger specific events and effects,” recalls Berto Mora, CTO at AOIN. “This difficulty was compounded by the fact that we were working with multiple teams, which created logistical programming challenges."
Amidst the challenges, SP by Stage Precision emerged as the operator controller, bringing together the entire workflow. "We used SP board views to create a user interface to monitor all engines and cue lists at a glance,” remarks Vishal Sharma, UE operator at AOIN. “This removed our need to visit each individual machine; a game-changer as we were able to control all six engines from one desk, with timecode, tracking data and genlock united into a single source of truth.”
Alongside control and monitoring capabilities, SP offered the AOIN team other advantages to traditional workflows. "The 3D visualiser allowed us to visualise in 3D space, as opposed to 2D, which helped us to think differently about the environment and space that we were augmenting," says Mora, highlighting the versatility of SP’s software features. “Additionally, we used SP to control our video router to switch between mains and backup engines, whilst the robust cue list system provided us with a method of triggering all engines simultaneously via OSC, with scalable control via unicast commands.”
Using SP by Stage Precision, All of It Now delivered a mix of augmented reality experiences. Looking to the future, the team considers Stage Precision a key tool in their mission to usher in a new era of AR experiences. “At this year’s festival, we supported three artists as well as Coachella’s marketing team. SP allowed us to maintain the cues and commands for each specific artist, segmenting them so there was no chance of mistakenly cueing the wrong content during a performance,” explains Mora.
“With this workflow, we are prepared to scale to support more artists in 2024 and beyond, as well as open the possibilities to support more tracked cameras and engines in the future.”

Latest Issue. . .