Production in virtual environments

Virtual Production is the latest frontier of real-time virtual production that is already radically changing the production process of films, TV shows, and commercials all around the world. Virtual production is the integration of augmented reality, VR (virtual reality), and computer graphics with the purpose of combining real-life shots with different virtual environments and elements generated in real-time.

The possibility offered by this technology to instantly switch from one setting to another allows, on one hand, to concentrate the shooting within a single location and, on the other hand, to significantly impact the production timeline and thus the overall economy of the production.

Virtual Production (VP) is the ability to blend live-action footage and computer graphics in real-time to receive feedback and make decisions on set regarding visual effects and animations. It involves real-time CGI that can alter the director's approach, allowing them to visualize the effect without having to wait for the end of shooting and the subsequent post-production phase.

ADVANTAGESCompared to previous technology (e.g., Viz), the "new generation" VP brings numerous advantages, including:

Image Quality: The rendering engine of Unreal Engine is capable of producing photorealistic images with real-time lighting calculations.Open-Source Platform: Epic Games provides its rendering engine for commercial use without royalties until the project reaches $3 million in profit.Easy Integration on Traditional Sets: Similar to the previous technology, the system is flexible and can be used standalone or integrated into existing film or television production workflows that have not yet adopted this technique.

BODY/FACE TRACKERThe system is optimized to seamlessly integrate real-time motion capture of an actor or performer's movements within the virtual scene.

INTEGRATION WITH THE SETAs with the previous technology, the strength of this system lies in its ability to integrate with the techniques already in place on a regular film and television set. By simply attaching a sensor to the Motion Data Processor (MDP), directors, DOPs (Director of Photography), and camera operators can work according to their usual procedures while achieving an innovative result: on the control monitor, the green screen will be replaced in real-time by a photorealistic three-dimensional environment.

OBJECTIVES

1. Technical support on the set for real-time visualization and recording of backgrounds or set extensions in green screen directly IN-CAMERA: no need for keying or rotoscoping post-production work. The effect is recorded directly onto an external video recorder.
2. Creation of real-time virtual sets for TV series and commercials on green screen sets. The ability to insert animated 3D characters in real-time, interacting with real actors. Real-time compositing recorded directly in-camera while retaining the option to refine the scene in post-production.