Advanced Interaction Techniques and Technologies
This technical design course explores the future of Human-Computer Interaction (HCI) beyond the traditional screen and keyboard. Students will investigate “Natural User Interfaces” (NUI) including gesture recognition, haptics, eye-tracking, and Brain-Computer Interfaces (BCI). The course focuses on designing intuitive, immersive interactions for spatial computing environments (VR/AR) and smart physical objects, preparing students for the next hardware paradigm shift.
§ 01 By the end you can
- Design and prototype Natural User Interfaces (NUI) using hand tracking and gestures
- Implement haptic feedback to enhance digital immersion and usability
- Utilize eye-tracking technology for active input and passive attention analysis
- Explore the basics of Brain-Computer Interfaces (BCI) and neuro-feedback
- Evaluate interaction techniques for ergonomics, accessibility, and cognitive load
§ 02 Sixteen sessions
The whole semester.
- 01History of HCI: From Punch Cards to Neural Links
- 02Spatial Computing Fundamentals (XR)
- 03Hand Tracking & Gesture Design
- 04Eye Tracking: Gaze as Input
- 05Eye Tracking: Heatmaps & Analytics
- 06Body Computing: Skeletal Tracking
- 07Tangible User Interfaces (TUI)
- 08 · MidtermMidterm Examination
- 09Voice & Speech Recognition Systems
- 10Multimodal Interaction (Voice + Gesture)
- 11Haptics: Tactile Feedback Design
- 12Wearable Technology & Bio-Sensors
- 13Brain-Computer Interfaces (BCI) Intro
- 14Accessibility in Advanced Interfaces
- 15Prototyping Hardware (Arduino/Sensors)
- 16Final Prototype: The Next Interface
Midterm around session 8. Final project briefed at session 8 or 9 and developed in stages until the juries.
Recommended reading
- The Design of Everyday Things by Don Norman
- Brave NUI World: Designing Natural User Interfaces by Daniel Wigdor and Dennis Wixon
- 3D User Interfaces: Theory and Practice by LaViola et al.
- Make: Wearable Electronics by Kate Hartman
- Grimm’s Law of HCI (Research Papers on Fitts’s Law etc.)
More in Digital & Interactive
| Advanced Interaction & Service | This advanced course moves beyond simple interface design to explore complex service ecosystems. Students will learn how to design end-to-end experiences that bridge the physical and digital worlds ("phygital"). |
| Design for Wearable Tech | This course explores the intersection of fashion, product design, and technology. Students will design for the "Intimate Interface," focusing on devices worn on the body—from smartwatches to smart textiles. |
| Digital Workflow and Asset Management | "Amateurs talk about cameras; professionals talk about backups." This technical course saves careers. It teaches the unglamorous but vital skill of managing thousands of digital assets. |
| Holographic & Mixed Reality Design | This futuristic course introduces students to the field of Spatial Computing, specifically Mixed Reality (MR) and Augmented Reality (AR). |
| Hologram Production | This specialized course prepares students for the future of display technology: Holography. Moving beyond screens, students will learn to create content for volumetric displays (like Looking Glass), holographic fans, and large-scale "Pepper's Ghost" stage illusions (similar to the ABBA Voyage). |
| Holographic Color Grading | As screens evolve from 2D planes to 3D volumes, color grading must adapt. This advanced course focuses on grading for Volumetric Video, Light Fields, and Holographic Displays (e.g., Looking Glass, VR headsets). |