Premier Graphics
& Animation
Film & TV · MS elective · 3 credit hours · 16 sessions

Virtual Production

This course brings The Mandalorian technology to the classroom. “Virtual Production” (VP) replaces green screens with LED volumes and real-time game engines. Students will learn the workflow of shooting live-action actors against digital backgrounds that move in perfect parallax with the camera. The curriculum covers In-Camera Visual Effects (ICVFX), Unreal Engine nDisplay, and camera tracking systems.

§ 01 By the end you can
  1. Understand the ICVFX (In-Camera VFX) workflow vs. Traditional Green Screen
  2. Operate Camera Tracking systems (Vive/Mo-Sys) to sync physical and digital worlds
  3. Optimize 3D environments in Unreal Engine for real-time playback (Frame rate)
  4. Master "The Volume": Managing LED wall moiré, color, and spill light
  5. Calibrate the "Inner Frustum" and "Outer Frustum" for seamless blending
§ 02 Sixteen sessions

The whole semester.

  1. 01Evolution of VP: Rear Projection to LED
  2. 02The Tech Stack: Unreal Engine, nDisplay, & Hardware
  3. 03Camera Tracking Basics (6 Degrees of Freedom)
  4. 04Building the Digital Set: Asset Optimization
  5. 05Pre-Visualization (Previs) & Techvis
  6. 06The LED Wall: Pixel Pitch & Viewing Angle
  7. 07nDisplay: Projecting onto multiple screens
  8. 08 · MidtermMidterm Examination
  9. 09Lighting the Volume: Digital vs. Physical Light
  10. 10Color Management: ACES workflow
  11. 11The Art Department in VP (VAD)
  12. 12Managing Latency & Frame Rates
  13. 13Moiré Patterns & Camera Sensors
  14. 14Green Screen vs. LED: Hybrid workflows
  15. 15Post-Production in VP: Fix it in Prep
  16. 16Final Project: The Virtual Production Scene

Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.

§ 03 Final project

Final Project: The Virtual Production Scene

How it’s judged

Recommended reading
  1. The Filmmaker's Guide to Virtual Production by Noah Kadner
  2. Virtual Production: A Manual for the 21st Century Filmmaker by Bild Studios
  3. Unreal Engine 5 Documentation (Virtual Production section)
  4. The VES Handbook of Visual Effects (VP Chapters)
  5. Real-Time Rendering by Tomas Akenine-Möller
More in Film & TV