If you watched the Disney + series The Mandalorian, you̵
Industrial Light and Magic partnered with Epic Games and NVIDIA to build Stagecraft, which itself revolves around ‘the volume’. This is a physical set surrounded by huge LED panels on the back and top of the set, which can display virtual sets. The software that powers and controls StageCraft allows the director, cameraman and other crewmembers to visualize and plan shots in advance, make on-the-fly adjustments to lighting and other specific elements, and film faster because you can exchange sets directly.
This also provides a richer and more immersive movie experience. Both the actors and director can see more of the set and other elements in real time (compared to working in front of a green screen or with motion capture suits) and adjust each shot while filming. With the ability to adjust everything from lighting to different sets with just a few quick taps on an iPad, directors and actors also have more time (and mental energy) to focus on the performance as well. The technology also makes it possible to film 30-50% more pages every day.
ILM originally partnered with Epic Games and NVIDIA to build Stagecraft, and they continued to make improvements in preparation for season two of The MandalorianThey increased the size of the LED stage and made other enhancements to Helios, ILM’s internal rendering engine, which then enabled even more interactive customization options for the show’s production team.
“We now have the ability to grab every tree in a forest, of which there are hundreds and hundreds and hundreds, and move them independently to reset the clothes on the day based on what we saw through the camera, said Richard Bluff, visual effects supervisor for the show.
ILM says it is always improving Stagecraft and pushing its boundaries. The technology will certainly affect the way other shows and movies are made in the future, and can inspire even more amazing technology later on.