AI-Assisted Animation
This cutting-edge course integrates Artificial Intelligence into the traditional animation pipeline to accelerate production. Students will learn to use AI tools for markerless motion capture, automated lip-syncing, and generative texturing. The goal is not to replace the animator, but to use AI to handle repetitive tasks (clean-up, in-betweening) so the artist can focus on performance.
§ 01 By the end you can
- Utilize AI Motion Capture tools (e.g., Wonder Dynamics, Move.ai) to turn video into keyframes
- Automate Lip-Sync and facial animation using audio-driven AI
- Apply Style Transfer AI to render 3D scenes in 2D painterly styles
- Generate textures and background assets using diffusion models
- Navigate the ethics of AI, copyright, and the changing role of the animator
§ 02 Sixteen sessions
The whole semester.
- 01The AI Animation Pipeline: Overview
- 02Markerless Mocap: Video-to-Animation
- 03Cleaning AI Data: Retargeting & Polish
- 04AI Lip-Sync: Audio-Driven Facial Performance
- 05Generative In-Betweening (Frame Interpolation)
- 06Text-to-Motion: Prompting Movement
- 07AI Rigging: Auto-Rigging Tools (AccuRIG)
- 08 · MidtermMidterm Examination
- 09Generative Texturing & UVs
- 10AI Concept Art for Character Design
- 11Neural Rendering & NeRFs in Animation
- 12Style Transfer: Anime/Oil Paint Filters
- 13AI Physics assistance (Cascadeur)
- 14Rapid Prototyping/Animatics with AI
- 15Ethics: Deepfakes & Artist Rights
- 16Final Project: The Hybrid AI Short
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
§ 03 Final project
Final Project: The Hybrid AI Short
Recommended reading
- Artificial Intelligence for Filmmakers (Industry Whitepapers)
- The Future of Animation by S. D. Katz
- Deep Learning for Computer Vision by Rajalingappaa Shanmugamani
- Generative Deep Learning by David Foster
- Online Documentation: Wonder Dynamics / RunwayML
More in Animation & VFX
| 2D Animation | A comprehensive introduction to the foundational principles and practical techniques of 2D animation. This course covers the 12 Principles of Animation, character design, storyboarding, and digital production pipelines. |
| 3D Animation Director | This capstone leadership course prepares students to steer a 3D production from concept to completion. Bridging the gap between creative vision and technical reality, students will learn to direct animators, manage the "Pipeline," and make critical artistic decisions. |
| 3D Environment Artist | An environment artist does more than place trees; they are the architects of virtual worlds. This course teaches the "Modular Workflow," where students create versatile kits of walls, floors, and props that can be assembled into vast, seamless levels. |
| 3D Modeling & Animation Techniques | This course provides a comprehensive introduction to 3D modeling for digital artists, focusing on professional object creation, surface modeling, lighting, and rendering workflows. |
| 3D Modeling for Interior Architects | This specialized course equips interior designers with the digital skills to translate 2D floor plans into immersive 3D environments. |
| 3D Pen Modeling & Sculpture | "Drawing in thin air." This hands-on studio course explores the bridge between 2D illustration and 3D prototyping using 3D printing pens. |