Immersion VR were engaged to produce content for an interactive AR experience to be created on the Microsoft Hololens [link to hololens info]. This would be a world-first – fusing live action footage, CGI visual effects and AR technology in a non-linear, interactive experience.
Following the famous story of Robin Hood of Sherwood Forest, the viewer is taken on an adventure through space and time – where we meet Robin’s gang of Merry Men (and women!) and defeat the evil forces which threaten Sherwood Forest.
Featuring an exciting and talented cast of actors, including Black Mirror’s Dominic Le Moignan – with the script co-written by BAFTA award-winning CBBC writer and producer Nick Hutchings. The viewer is not only able to choose the story arc, with multiple scenes and endings depending on their choices throughout the journey, but they are also able to interact with the characters by firing arrows from their hands.
Shot in a studio environment by our talented team, the mixed reality experience combines live action, stunts, special effects and CGI to create a truly immersive and unique experience. ‘Robin Hood – Arrow Through Time’ has been championed as a world first in this field.
Featuring an exciting and talented cast of actors, including Black Mirror’s Dominic Le Moignan – with the script co-written by BAFTA award-winning CBBC writer and producer Nick Hutchings. The viewer is not only able to choose the story arc, with multiple scenes and endings depending on their choices throughout the journey, but they are also able to interact with the characters by firing arrows from their hands.
The Microsoft HoloLens2 is the second iteration of Microsoft’s revolutionary head-mounted mixed reality device. It’s a device you put on your head, with a visor over your eyes, which enables a completely new way of interacting with information.
The Hololens is Microsoft’s take on augmented reality, which they call “mixed reality”. Using multiple sensors, advanced optics, and holographic processing that melds seamlessly with its environment, These holograms can be used to display information, blend with the real world, or even simulate a virtual world.
Combined with the incredible AR technology of the Hololens2, this pioneering project also utilised wearable sound technology to add deeper levels to the sense of immersion.
The Subpac is a haptic feedback vest which makes the user able to not only hear the sound, but feel it. We designed the audio to mimic things like hits from arrows, lightning bolts and heartbeat sounds to ratchet up the tension.
Our team’s extensive background both in 360VR and in traditional filmmaking was invaluable throughout this project – as our filmmaking approach combined both disciplines – as well as creating many new workflows and ways of shooting that were specific to this individual project.
Throughout the pre-production phase, we worked closely with the app developers GOOII [link] to design and execute different R&D testing – from camera equipment, to lighting setups, and special effects – and refined these throughout the pre-production process to create an entirely new filmmaking workflow for the Microsoft Hololens.
Our team helped co-write the script and cast well known acting talent such as Black Mirror’s Dominic Le Moignan and comedian Marek Larwood. As this is a new medium for the actors as well, our Director and ADs ensured the actors were comfortable in the new filming environment to ensure the best performance.
As well as creating new shooting workflows, we also built new post-production workflows specific for Hololens experiences. As the filming process involved using a single fixed camera – we used custom made live keying technology to create cutting points. Transparency and colours behaved differently on the Hololens and this had to be adapted into our VFX workflow. Even the blocking of the actors had to be adapted in ways to suit the display of the Hololens.
A special mention also has to go to our talented Costume, Hair & Make Up and Art Departments. Many custom props were created for the experience, including soft weapons. The Costume Designer and Hair and Make Up department created multiple period looks for our characters to enhance the story. Even fine details such as colour of costume, or style of hats, had to be considered carefully as the Hololens replicates images differently to conventional screen displays.
The audio post production plays a huge part in the experience of the viewer. As well as designing an original score for the entire experience, we focused on harnessing the technology of the wearable Subpac [link to Subpac site] to enhance the story. The Subpac is a wearable device which enables the user to ‘feel’ the sound. By using low frequency audio, we were able to recreate effects that the user can feel – such as impact from arrow hits and lightning bolts.
The experience can be viewed at the home of Robin Hood – Nottinghamshire’s famous Sherwood Forest. You can more about the project deployment in this BBC News article – https://www.bbc.com/news/uk-england-nottinghamshire-58906285
After the post production process, the film was built into an AI app to be viewed on the Microsoft Hololens 2. This unique app enables not only an interactive story arc, but also viewer interaction including firing arrows. You can read more about the app development here with our client GOOII [link to relevant GOOII website article]
This pioneering AR filmmaking approach was also used on another project “The Rufford Ghost Walk” – you can read more about this project here [link].