Premier Graphics
& Animation
AI & Digital Arts · MS elective · 3 credit hours · 16 sessions

Advanced AI Techniques for Creative Practice

This capstone-level technical course is for students who have mastered basic prompting and wish to push the engine to its limits. The curriculum focuses on “under the hood” customization: building complex node-based workflows (e.g., ComfyUI), fine-tuning Large Language Models (LLMs) on private datasets, and integrating generative AI into 3D engines like Unreal or Unity. This is a rigorous, production-focused module.

§ 01 By the end you can
  1. Master node-based generation workflows (ComfyUI) for precise control
  2. Fine-tune Stable Diffusion models using Dreambooth and LoRA on custom datasets
  3. Integrate AI assets into Real-Time 3D Engines (Unreal/Unity)
  4. Utilize Python scripting to automate complex batch-generation tasks
  5. Train and deploy a custom "Small Language Model" for specific creative tasks
§ 02 Sixteen sessions

The whole semester.

  1. 01Review of Architecture: U-Nets & Transformers
  2. 02Node-Based Workflows: ComfyUI Basics
  3. 03Advanced ControlNet & IP-Adapters
  4. 04Latent Space Manipulation & Animation
  5. 05Data Curation: Preparing Sets for Training
  6. 06Training: Textual Inversion vs. LoRA
  7. 07Training: Dreambooth for Characters
  8. 08 · MidtermMidterm Examination
  9. 09LLM Fine-Tuning: Dataset Preparation
  10. 10LLM Fine-Tuning: Training & Evaluation
  11. 11AI in Game Engines: Texture & Asset Gen
  12. 12AI NPCs: Integrating LLMs in Games
  13. 13Audio-Reactive AI Generation
  14. 14Multi-Agent Systems & Swarm Intelligence
  15. 15Cloud Deployment vs. Local Optimization
  16. 16Final Capstone: The Integrated Pipeline

Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.

Recommended reading
  1. Deep Learning for Creators (release pending/community docs)
  2. Programming PyTorch for Deep Learning by Ian Pointer
  3. Generative Deep Learning (2nd Edition) by David Foster
  4. The Little Book of Deep Learning by François Fleuret
  5. Hugging Face Documentation & CivitAI Community Guides (Primary Resources)
More in AI & Digital Arts