Premier Graphics
& Animation
AI & Digital Arts · MS elective · 3 credit hours · 16 sessions

Generative AI Video Art

This cutting-edge studio course focuses on the use of text-to-video and image-to-video models to create surreal and experimental video art. Students will learn to “direct” AI, mastering prompt engineering, camera control within latent space, and style transfer techniques to produce visuals that were previously impossible to film.

§ 01 By the end you can
  1. Master Prompt Engineering for temporal media (Text-to-Video)
  2. Control AI camera movement and motion brushes (Runway/Pika)
  3. Maintain character and style consistency across generated clips
  4. Explore "Dream Logic" and morphing aesthetics unique to AI
  5. Navigate the ethics of AI generation and copyright in the arts
§ 02 Sixteen sessions

The whole semester.

  1. 01Introduction to Diffusion Models for Video
  2. 02Text-to-Video: The Syntax of Prompts
  3. 03Image-to-Video: Animating Static Art
  4. 04Camera Control: Pan, Tilt, Zoom in Latent Space
  5. 05Motion Brushes: Directing Specific Movement
  6. 06Consistency: The "Flicker" Problem & Fixes
  7. 07In-Painting & Out-Painting for Video
  8. 08 · MidtermMidterm Examination
  9. 09Style Transfer: Anime to Realism & Back
  10. 10Lip-Syncing & AI Audio Generation
  11. 11Deforum & Stable Diffusion Animation
  12. 12Upscaling & Frame Interpolation (60fps)
  13. 13AI Music Visualization
  14. 14Ethics: Deepfakes & Artist Rights
  15. 15Post-Processing AI Footage (Grain & Grading)
  16. 16Final Project: The AI-Generated Music Video

Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.

§ 03 Final project

Final Project: The AI-Generated Music Video

How it’s judged

Recommended reading
  1. The Age of AI by Henry Kissinger and Eric Schmidt
  2. Generative Deep Learning by David Foster
  3. AI Art: Machine Visions and Warped Dreams by Joanna Zylinska
  4. Introduction to Generative AI (Online Courseware/Papers)
  5. Prompt Engineering Guide (OpenAI/Anthropic documentation)
More in AI & Digital Arts