Premier Graphics
& Animation
Film & TV · MS elective · 3 credit hours · 16 sessions

AI-Driven Cinematography

This futuristic course explores the convergence of Artificial Intelligence and the Director of Photography (DoP). Students will study how AI is revolutionizing the image pipeline—from pre-visualization and automated focus tracking to Virtual Production (LED volumes) and Neural Radiance Fields (NeRFs). The course prepares cinematographers to collaborate with algorithms to achieve impossible shots.

§ 01 By the end you can
  1. Understand the principles of Computational Photography and Neural Rendering
  2. Utilize AI tools for Pre-visualization (Midjourney for storyboards/Moodboards)
  3. Operate AI-assisted camera systems (Auto-framing, Subject Tracking)
  4. Introduction to Virtual Production: Shooting in an LED Volume
  5. Experiment with NeRFs (Neural Radiance Fields) and Gaussian Splatting for 3D video
§ 02 Sixteen sessions

The whole semester.

  1. 01The History of Computational Imaging
  2. 02AI in Pre-Production: Script to Storyboard
  3. 03AI-Assisted Focus & Gimbal Tracking
  4. 04Denoising & Upscaling (Super Resolution)
  5. 05Generative Fill for Set Extension
  6. 06Deep Compositing & AI Matte Generation
  7. 07Digital Humans & AI Lighting Simulation
  8. 08 · MidtermMidterm Examination
  9. 09Virtual Production I: Parallax & Frustum
  10. 10Virtual Production II: Lighting with LED Walls
  11. 11Volumetric Video & Holographic Capture
  12. 12Introduction to NeRFs (Neural Radiance Fields)
  13. 13Gaussian Splatting: The Future of 3D Scene Capture
  14. 14Style Transfer for Video
  15. 15Ethics: The End of Reality?
  16. 16Final Project: The Hybrid AI/Live-Action Scene

Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.

§ 03 Final project

Final Project: The Hybrid AI/Live-Action Scene

How it’s judged

Recommended reading
  1. The Filmmaker's Guide to Virtual Production by Noah Kadner
  2. Computers and Film by The Editors of Cinefex
  3. Artificial Intelligence for Filmmakers (Industry Whitepapers)
  4. Deep Learning for Computer Vision by Rajalingappaa Shanmugamani
  5. Virtual Production: A Manual for the 21st Century Filmmaker by Bild Studios
More in Film & TV