Generative AI Video Art
This cutting-edge studio course focuses on the use of text-to-video and image-to-video models to create surreal and experimental video art. Students will learn to “direct” AI, mastering prompt engineering, camera control within latent space, and style transfer techniques to produce visuals that were previously impossible to film.
§ 01 By the end you can
- Master Prompt Engineering for temporal media (Text-to-Video)
- Control AI camera movement and motion brushes (Runway/Pika)
- Maintain character and style consistency across generated clips
- Explore "Dream Logic" and morphing aesthetics unique to AI
- Navigate the ethics of AI generation and copyright in the arts
§ 02 Sixteen sessions
The whole semester.
- 01Introduction to Diffusion Models for Video
- 02Text-to-Video: The Syntax of Prompts
- 03Image-to-Video: Animating Static Art
- 04Camera Control: Pan, Tilt, Zoom in Latent Space
- 05Motion Brushes: Directing Specific Movement
- 06Consistency: The "Flicker" Problem & Fixes
- 07In-Painting & Out-Painting for Video
- 08 · MidtermMidterm Examination
- 09Style Transfer: Anime to Realism & Back
- 10Lip-Syncing & AI Audio Generation
- 11Deforum & Stable Diffusion Animation
- 12Upscaling & Frame Interpolation (60fps)
- 13AI Music Visualization
- 14Ethics: Deepfakes & Artist Rights
- 15Post-Processing AI Footage (Grain & Grading)
- 16Final Project: The AI-Generated Music Video
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
§ 03 Final project
Final Project: The AI-Generated Music Video
Recommended reading
- The Age of AI by Henry Kissinger and Eric Schmidt
- Generative Deep Learning by David Foster
- AI Art: Machine Visions and Warped Dreams by Joanna Zylinska
- Introduction to Generative AI (Online Courseware/Papers)
- Prompt Engineering Guide (OpenAI/Anthropic documentation)
More in AI & Digital Arts
| Advanced AI Techniques for Creative Practice | This capstone-level technical course is for students who have mastered basic prompting and wish to push the engine to its limits. |
| AI as Co-Creator | This course challenges the "Man vs. Machine" narrative, proposing instead a symbiotic relationship where Artificial Intelligence acts as a collaborator. |
| AI as Creative Partner | This interdisciplinary studio course reframes Artificial Intelligence from a "tool" to a "collaborator." It focuses on the psychological and workflow dynamics of working with a non-human intelligence. |
| AI, Code, & Art (AI & Art track) | Designed for the technical artist, this advanced track dives under the hood of generative tools. While other courses focus on using interface-based tools (like Midjourney), this course focuses on programming them. |
| AI, Design, and Immersive Experiences | This capstone immersive course merges Virtual Reality (VR) with Artificial Intelligence. Students will learn to create "Smart Environments"—virtual worlds populated by AI agents that can converse, navigate, and react to the user. |
| AI-Driven Fashion Design | This specialized course explores the intersection of high fashion and artificial intelligence. Students will learn to use generative tools to predict trends, design textiles, and visualize garments without the need for physical waste. |