Incredible Real-Time Visual Effects Tech Replaces Green Screens with LED Walls

Real-time in-camera VFX might sound like a pipe dream, but Unreal Engine has just published a demo that shows exactly that with Project Spotlight. Using “next-generation virtual production tools,” Project Spotlight is able to render and manipulate real-time environments with startling realism, replacing green or blue screens with LED walls.

The demo was filmed at SIGGRAPH 2019, where Epic Games partnered with Lux Machina, Magnopus, Profile Studios, Quixel, ARRI, and DP Matt Workman to show the latest Unreal Engine production tools in action. Unlike other real-time VFX demos we’ve seen lately, this technology actually uses LED walls to create virtual environments that can be manipulated digitally.

Not only that, the walls provide real-world lighting at the same time, “so the entire scene can be captured in camera in a single pass.” In other words, the colors from the projected scene wash over the actors on set, creating realistic lighting in-camera and saving hours of grading in post. Changing the scene realistically changes the ambient light:

Check out the full demo above to see the technology in action, and watch as DPs go in and test different focal lengths, move parts of the environment around, and alter the lighting to suit their needs.

(via Fstoppers)