Advanced AI Techniques for Creative Practice
This capstone-level technical course is for students who have mastered basic prompting and wish to push the engine to its limits. The curriculum focuses on “under the hood” customization: building complex node-based workflows (e.g., ComfyUI), fine-tuning Large Language Models (LLMs) on private datasets, and integrating generative AI into 3D engines like Unreal or Unity. This is a rigorous, production-focused module.
§ 01 By the end you can
- Master node-based generation workflows (ComfyUI) for precise control
- Fine-tune Stable Diffusion models using Dreambooth and LoRA on custom datasets
- Integrate AI assets into Real-Time 3D Engines (Unreal/Unity)
- Utilize Python scripting to automate complex batch-generation tasks
- Train and deploy a custom "Small Language Model" for specific creative tasks
§ 02 Sixteen sessions
The whole semester.
- 01Review of Architecture: U-Nets & Transformers
- 02Node-Based Workflows: ComfyUI Basics
- 03Advanced ControlNet & IP-Adapters
- 04Latent Space Manipulation & Animation
- 05Data Curation: Preparing Sets for Training
- 06Training: Textual Inversion vs. LoRA
- 07Training: Dreambooth for Characters
- 08 · MidtermMidterm Examination
- 09LLM Fine-Tuning: Dataset Preparation
- 10LLM Fine-Tuning: Training & Evaluation
- 11AI in Game Engines: Texture & Asset Gen
- 12AI NPCs: Integrating LLMs in Games
- 13Audio-Reactive AI Generation
- 14Multi-Agent Systems & Swarm Intelligence
- 15Cloud Deployment vs. Local Optimization
- 16Final Capstone: The Integrated Pipeline
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
Recommended reading
- Deep Learning for Creators (release pending/community docs)
- Programming PyTorch for Deep Learning by Ian Pointer
- Generative Deep Learning (2nd Edition) by David Foster
- The Little Book of Deep Learning by François Fleuret
- Hugging Face Documentation & CivitAI Community Guides (Primary Resources)
More in AI & Digital Arts
| AI as Co-Creator | This course challenges the "Man vs. Machine" narrative, proposing instead a symbiotic relationship where Artificial Intelligence acts as a collaborator. |
| AI as Creative Partner | This interdisciplinary studio course reframes Artificial Intelligence from a "tool" to a "collaborator." It focuses on the psychological and workflow dynamics of working with a non-human intelligence. |
| AI, Code, & Art (AI & Art track) | Designed for the technical artist, this advanced track dives under the hood of generative tools. While other courses focus on using interface-based tools (like Midjourney), this course focuses on programming them. |
| AI, Design, and Immersive Experiences | This capstone immersive course merges Virtual Reality (VR) with Artificial Intelligence. Students will learn to create "Smart Environments"—virtual worlds populated by AI agents that can converse, navigate, and react to the user. |
| AI-Driven Fashion Design | This specialized course explores the intersection of high fashion and artificial intelligence. Students will learn to use generative tools to predict trends, design textiles, and visualize garments without the need for physical waste. |
| AI-Empowered Creativity | This course focuses on the cognitive and procedural aspects of creativity, exploring how Artificial Intelligence can serve as a catalyst for human imagination. |