AI-Driven Cinematography
This futuristic course explores the convergence of Artificial Intelligence and the Director of Photography (DoP). Students will study how AI is revolutionizing the image pipeline—from pre-visualization and automated focus tracking to Virtual Production (LED volumes) and Neural Radiance Fields (NeRFs). The course prepares cinematographers to collaborate with algorithms to achieve impossible shots.
§ 01 By the end you can
- Understand the principles of Computational Photography and Neural Rendering
- Utilize AI tools for Pre-visualization (Midjourney for storyboards/Moodboards)
- Operate AI-assisted camera systems (Auto-framing, Subject Tracking)
- Introduction to Virtual Production: Shooting in an LED Volume
- Experiment with NeRFs (Neural Radiance Fields) and Gaussian Splatting for 3D video
§ 02 Sixteen sessions
The whole semester.
- 01The History of Computational Imaging
- 02AI in Pre-Production: Script to Storyboard
- 03AI-Assisted Focus & Gimbal Tracking
- 04Denoising & Upscaling (Super Resolution)
- 05Generative Fill for Set Extension
- 06Deep Compositing & AI Matte Generation
- 07Digital Humans & AI Lighting Simulation
- 08 · MidtermMidterm Examination
- 09Virtual Production I: Parallax & Frustum
- 10Virtual Production II: Lighting with LED Walls
- 11Volumetric Video & Holographic Capture
- 12Introduction to NeRFs (Neural Radiance Fields)
- 13Gaussian Splatting: The Future of 3D Scene Capture
- 14Style Transfer for Video
- 15Ethics: The End of Reality?
- 16Final Project: The Hybrid AI/Live-Action Scene
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
§ 03 Final project
Final Project: The Hybrid AI/Live-Action Scene
Recommended reading
- The Filmmaker's Guide to Virtual Production by Noah Kadner
- Computers and Film by The Editors of Cinefex
- Artificial Intelligence for Filmmakers (Industry Whitepapers)
- Deep Learning for Computer Vision by Rajalingappaa Shanmugamani
- Virtual Production: A Manual for the 21st Century Filmmaker by Bild Studios
More in Film & TV
| Acting for Film & Film Analysis | This hybrid course combines practical performance training with critical film theory. Students will learn the specific techniques of screen acting—minimalism, eye lines, and continuity—while simultaneously analyzing legendary performances from cinema history. |
| Acting for the Camera | The camera lens acts as a microscope for human behavior. This practical course helps actors transition from the projection required for stage to the intimacy required for screen. |
| Advanced Camera Techniques | This technical course is designed for aspiring cinematographers who wish to master the visual language of cinema. |
| Advanced Film Editing (MS elective) | This course moves beyond the basics of cutting to explore editing as an art of storytelling and emotional manipulation. |
| Advanced Film Editing | This course covers advanced techniques and concepts in film editing, focusing on narrative structure, pacing, continuity, and the creative use of editing software. |
| Animated Documentaries | How do you film a memory? This course explores the powerful genre of the animated documentary. Students will learn how to use animation to depict un-filmable events, protect the identity of vulnerable subjects, and visualize internal emotional states. |