Syllabus

Week

Topic

Report & Lab

Lecture Slides
Week 1A
 Week1: Introduction to VR/AR Systems
Report 1: MVP Report Assignment
 Lecture 1: Introduction to CS396 VR/AR Systems
Week 1B
Lecture 2: Minimum Viable Product (MVP) of a VR/AR System
Week 2A
Week2: Graphics Rendering Pipeline on Embedded Systems
Lab 1: WebGL Programming with Three.JS
Lecture 3: Graphics Rendering Pipeline: Vector Graphics Part
Week 2B
Lecture 4:  Graphics Rendering Pipeline II: Raster Graphics Part
Week 3A
Week3: Human Binocular Vision System
Lab 2: Stereo Camera Rendering
Lecture 5:  Human Binocular Vision System
Week 4A
Week 4: Leveraging Depth Cue and Visual Acuity for Building Better VR/AR Systems
Lab 3: Vignette Compensation and Lens Distortion Correction
Lecture 6:  Human Binocular Vision System II: Depth Cue and Visual Acuity
Week 4B
Lecture 7:  GPU and GLSL Shader Programming
Week 5A
Week 5: Near-Eye 3D Display Optics
Lab 4: Raspberry Pi 4B Mini Computer Setup and Code Migration
Lecture 8: Optics and Displays for Video See-through VR/AR Systems
Week 5B
Lecture 9: Advanced Optical Solution for See-through VR/AR Systems
Week 6A
Week 6: Embedded System Prototyping and IMU Hardware
In Class Lab 4: Raspberry Pi 4B Mini Computer Setup and Code Migration
Lecture 10: A Practical Guide to Embedded System Prototyping
Week 6B
Lab 5 A: BNO08x IMU Soldering, Wiring, Reading with Raspberry Pi 4B
Lecture 11: Inertial Measurement Unit Hardware
Week 7A
Week 7: Build VR/AR without Dizziness
Lab 5 Part B: Camera Update with IMU Data
Lecture 12: VR/AR Interaction Rendering and Quaternion
Week 7B
Lecture 13: VR/AR Dizziness Solutions
Week 8A
Week 8: BNO08x IMU and ESP32CAM Lab Week
 IMU Reading for Camera Rendering
Week 8B
Lab 6: ESP32 CAM Setup
ESP32 CAM Setup
Week 9A
Week 9: Deep Learning for VR/AR Interaction and 3D Scene Understanding
Lab 7: Transform VR to Passthrough AR
Option A: Build Stereo Camera Using 2 ESP32 CAMs
Option B: AI for Hand Tracking
Lecture 14: Hand, Eye, Voice and Neurons: Deep Learning for VR/AR Interaction
Week 9B
Lecture 15: Understand and Augment the World: 3D Scene Understanding and Content Generation
Week 10A
Week 10: Current VR/AR Systems in Academia and Industry (Guest Lectures)
Aug 22nd Industry Speaker: President Karl Guttag
Practical Issues in Mixed Reality Display and Optics
Week 10B
Demo Day
Final Project Report
Lecture 16:Introduction to Computer Generated Hologram and Demo Day