AI, Design, and Immersive Experiences
This capstone immersive course merges Virtual Reality (VR) with Artificial Intelligence. Students will learn to create “Smart Environments”—virtual worlds populated by AI agents that can converse, navigate, and react to the user. Moving beyond static VR experiences, this course teaches the creation of dynamic, living worlds where the narrative and environment shift in real-time based on AI processing of user behavior.
§ 01 By the end you can
- Build immersive VR environments using game engines (Unity/Unreal)
- Integrate Large Language Models (LLMs) to power non-player character (NPC) dialogue
- Implement "NavMesh" AI for character movement and pathfinding
- Design adaptive audio and lighting systems that respond to user emotion
- Create a fully interactive "Smart World" prototype for the final review
§ 02 Sixteen sessions
The whole semester.
- 01The Psychology of Immersion & Presence
- 02Intro to Game Engines (Unity/Unreal)
- 03VR Development Fundamentals
- 04Spatial UX/UI Design
- 05The "Smart" Environment Concept
- 06Basic AI: Finite State Machines
- 07Pathfinding & Navigation
- 08 · MidtermMidterm Examination
- 09AI NPCs: Connecting ChatGPT to Unity
- 10Lip Sync & Facial Animation AI
- 11Adaptive Audio & Generative Sound
- 12Procedural Level Generation
- 13Emotion Recognition in VR
- 14Optimization for Headsets (Quest/Vision Pro)
- 15User Testing & Iteration
- 16Final Immersive Experience Showcase
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
Recommended reading
- Unity Artificial Intelligence Programming by Dr. Davide Aversa
- Virtual Reality by Samuel Greengard
- Storytelling for Virtual Reality by John Bucher
- Artificial Intelligence for Games by Ian Millington
- The VR Book: Human-Centered Design for Virtual Reality by Jason Jerald
More in AI & Digital Arts
| Advanced AI Techniques for Creative Practice | This capstone-level technical course is for students who have mastered basic prompting and wish to push the engine to its limits. |
| AI as Co-Creator | This course challenges the "Man vs. Machine" narrative, proposing instead a symbiotic relationship where Artificial Intelligence acts as a collaborator. |
| AI as Creative Partner | This interdisciplinary studio course reframes Artificial Intelligence from a "tool" to a "collaborator." It focuses on the psychological and workflow dynamics of working with a non-human intelligence. |
| AI, Code, & Art (AI & Art track) | Designed for the technical artist, this advanced track dives under the hood of generative tools. While other courses focus on using interface-based tools (like Midjourney), this course focuses on programming them. |
| AI-Driven Fashion Design | This specialized course explores the intersection of high fashion and artificial intelligence. Students will learn to use generative tools to predict trends, design textiles, and visualize garments without the need for physical waste. |
| AI-Empowered Creativity | This course focuses on the cognitive and procedural aspects of creativity, exploring how Artificial Intelligence can serve as a catalyst for human imagination. |