As early as 12 weeks prior to the first virtual production shoot day, production should be thinking about engaging the production designer, director, DP, and VAD. This core group working early and often will lead to a successful and efficient shoot. It is worth noting that ASVP does not have a full internal VAD team. We will work closely with production to build a team or source vendors to create assets for the project.
The VAD is used for many purposes including:
- Creating the virtual environments to be displayed on the LED volume to act as the digital background to complement the practical set. See below in the Virtual Environment section for a more detailed explanation.
- Figuring out the Volume placement, scene setup, what needs to be virtually built and what needs to be practically built.
- Driving the location scouting session with the filmmakers.
- Creating the virtual props which drive the creation of the practical props.
- Assisting the DP in pre-lighting the sets, for both the virtual and practical. So when the DP comes in on the lighting day with his crew, he has the exact look ready.
- Assisting the Production Designer in realizing the design in full 3D and seeing it in Virtual Reality before creation of the large set pieces.
The amount of time and cost it takes to create these full CG virtual environments vary greatly depending on complexity and methodology, like any practical sets or visual effects sets. The good rule of thumb is that it will take roughly the same amount of time to create the virtual environment as it would take a visual effects company to create the same thing to be used in a VFX shot. The big difference is that the VAD environments must be completed prior to filming, unlike VFX sets.
Virtual Environments
The Virtual Environments are created by the VAD under the guidance of the Production Designer and utilizing lighting input from the DP. The virtual environments to be used in the Volume come in many flavors. The type of shots will determine what kind of virtual environment techniques will be used. Most virtual sets can be created in 6 to 12 weeks.
Static 360 Photography
A 360 degree panoramic photograph is created by combining multiple photographs captured at the desired real world location. This spherical photograph is then projected as a backdrop on the LED Volume.
- Pros: Proper lighting and reflection and background. Photorealistic. Inexpensive. Fast turnaround.
- Cons: No parallax. Extremely limited flexibility. No animation.
Stitched Video Playback
Video plates are captured via a camera array and stitched together to playback seamlessly in the Volume. Alternatively, a rendered sequence of a camera moving through a fully CG environment can be used. The movies are rendered out spherically to be projected on the Volume. This is great for driving, flying or any types of traveling shots.
- Pros: Correct lighting and reflection. Moving background.
- Cons: No parallax. Extremely limited modifications.
Unreal CG Environment
A full CG environment is created using various techniques such as: Photogrammetry, Lidar/Laser Scans or creating from scratching using a DCC.
- Pros: Accurate parallax, lighting and reflection. Extremely flexible and adjustable. Not limited to being based on any real physical locations. Ability to virtually location scout in VR.
- Cons: Most expensive of the methods. Takes the longest amount of time to create. Not as realistic as the other two methods.