Virtual Production
This course brings The Mandalorian technology to the classroom. “Virtual Production” (VP) replaces green screens with LED volumes and real-time game engines. Students will learn the workflow of shooting live-action actors against digital backgrounds that move in perfect parallax with the camera. The curriculum covers In-Camera Visual Effects (ICVFX), Unreal Engine nDisplay, and camera tracking systems.
§ 01 By the end you can
- Understand the ICVFX (In-Camera VFX) workflow vs. Traditional Green Screen
- Operate Camera Tracking systems (Vive/Mo-Sys) to sync physical and digital worlds
- Optimize 3D environments in Unreal Engine for real-time playback (Frame rate)
- Master "The Volume": Managing LED wall moiré, color, and spill light
- Calibrate the "Inner Frustum" and "Outer Frustum" for seamless blending
§ 02 Sixteen sessions
The whole semester.
- 01Evolution of VP: Rear Projection to LED
- 02The Tech Stack: Unreal Engine, nDisplay, & Hardware
- 03Camera Tracking Basics (6 Degrees of Freedom)
- 04Building the Digital Set: Asset Optimization
- 05Pre-Visualization (Previs) & Techvis
- 06The LED Wall: Pixel Pitch & Viewing Angle
- 07nDisplay: Projecting onto multiple screens
- 08 · MidtermMidterm Examination
- 09Lighting the Volume: Digital vs. Physical Light
- 10Color Management: ACES workflow
- 11The Art Department in VP (VAD)
- 12Managing Latency & Frame Rates
- 13Moiré Patterns & Camera Sensors
- 14Green Screen vs. LED: Hybrid workflows
- 15Post-Production in VP: Fix it in Prep
- 16Final Project: The Virtual Production Scene
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
§ 03 Final project
Final Project: The Virtual Production Scene
Recommended reading
- The Filmmaker's Guide to Virtual Production by Noah Kadner
- Virtual Production: A Manual for the 21st Century Filmmaker by Bild Studios
- Unreal Engine 5 Documentation (Virtual Production section)
- The VES Handbook of Visual Effects (VP Chapters)
- Real-Time Rendering by Tomas Akenine-Möller
More in Film & TV
| Acting for Film & Film Analysis | This hybrid course combines practical performance training with critical film theory. Students will learn the specific techniques of screen acting—minimalism, eye lines, and continuity—while simultaneously analyzing legendary performances from cinema history. |
| Acting for the Camera | The camera lens acts as a microscope for human behavior. This practical course helps actors transition from the projection required for stage to the intimacy required for screen. |
| Advanced Camera Techniques | This technical course is designed for aspiring cinematographers who wish to master the visual language of cinema. |
| Advanced Film Editing (MS elective) | This course moves beyond the basics of cutting to explore editing as an art of storytelling and emotional manipulation. |
| Advanced Film Editing | This course covers advanced techniques and concepts in film editing, focusing on narrative structure, pacing, continuity, and the creative use of editing software. |
| AI-Driven Cinematography | This futuristic course explores the convergence of Artificial Intelligence and the Director of Photography (DoP). |