Premier Graphics
& Animation
AI & Digital Arts · MS elective · 3 credit hours · 16 sessions

AI, Design, and Immersive Experiences

This capstone immersive course merges Virtual Reality (VR) with Artificial Intelligence. Students will learn to create “Smart Environments”—virtual worlds populated by AI agents that can converse, navigate, and react to the user. Moving beyond static VR experiences, this course teaches the creation of dynamic, living worlds where the narrative and environment shift in real-time based on AI processing of user behavior.

§ 01 By the end you can
  1. Build immersive VR environments using game engines (Unity/Unreal)
  2. Integrate Large Language Models (LLMs) to power non-player character (NPC) dialogue
  3. Implement "NavMesh" AI for character movement and pathfinding
  4. Design adaptive audio and lighting systems that respond to user emotion
  5. Create a fully interactive "Smart World" prototype for the final review
§ 02 Sixteen sessions

The whole semester.

  1. 01The Psychology of Immersion & Presence
  2. 02Intro to Game Engines (Unity/Unreal)
  3. 03VR Development Fundamentals
  4. 04Spatial UX/UI Design
  5. 05The "Smart" Environment Concept
  6. 06Basic AI: Finite State Machines
  7. 07Pathfinding & Navigation
  8. 08 · MidtermMidterm Examination
  9. 09AI NPCs: Connecting ChatGPT to Unity
  10. 10Lip Sync & Facial Animation AI
  11. 11Adaptive Audio & Generative Sound
  12. 12Procedural Level Generation
  13. 13Emotion Recognition in VR
  14. 14Optimization for Headsets (Quest/Vision Pro)
  15. 15User Testing & Iteration
  16. 16Final Immersive Experience Showcase

Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.

Recommended reading
  1. Unity Artificial Intelligence Programming by Dr. Davide Aversa
  2. Virtual Reality by Samuel Greengard
  3. Storytelling for Virtual Reality by John Bucher
  4. Artificial Intelligence for Games by Ian Millington
  5. The VR Book: Human-Centered Design for Virtual Reality by Jason Jerald
More in AI & Digital Arts