VR/AR Fundamentals Outline
Fresh from 5 presentations for my VR/AR Fundamentals class at NYU Shanghai, Fall 2017. On the one hand, still a little rough. On the other hand, based on earlier work supported by Apple Computer in the early 1990s.
1: Audiovisual Resolution and Fidelity
Fooling a single static eye and single static ear experiencing a framed representation.
Presentation (PDF minus videos, 44 slides, 1.4MB)
—- Pixels & Color
—- Dynamic Range & Brightness
—- Photo-Realism, Abstraction, & Cartoonishness
Special to VR / AR
—- Motion & Frame Rate
—- —- Frequency Range
—- —- Dynamic Range & Loudness
—- —- Audio-Realism, Abstraction, & Cartoonishness
2: Audiovisual Spatiality and Immersion
Fooling two static eyes and ears, then two moving eyes and ears, then removing the frame.
Presentation (PDF minus videos, 89 slides, 2.5MB)
Stereoscopic & Stereophonic Displays
—- Parallax & Disparity
—- Interpupillary Distance (IPD)
—- Stereo & Binaural Sound
Multiscopic & Multiphonic Displays
—- Head Tracking
—- Volumetric Video
—- Spatial Sound
—- Monoscopic Panoramas & Nodal Points
—- Stereoscopic Panoramas & Head Rotation
—- Multiscopic Panoramas
Putting It All Together
3: Other Senses (Haptic, Smell, Taste, Mind)
Fooling the other senses.
Presentation (PDF minus videos, 48 slides, 1.2MB)
—- Haptics & Force-Feedback
—- Seats & Motion Platforms
—- Skin as Input
—- Hands & Controllers
—- Touching Real Things / Mixed Reality
—- Non-Contact Haptics
Smell & Taste
—- Smell-O-Vision & the Food Simulator
—- Current Work
—- Remote Viewing (ESP), Brainstorm (the movie), & Science
—- When is suggestion good enough?
4: Input and Interactivity
Using our effectors and intentions as inputs and how they shape interactive experiences.
Presentation (PDF minus videos, 56 slides, 1.1MB)
—- Position & Movement (IMUs)
—- Biometric & Environment
—- Voice Control
—- Smart Mics
—- Electrodes & Big Machines
—- Optical Imaging & Holography
—- Psi & Consciousness Research
UI & UX
Navigation v Manipulation
Control v Illusion of Control
5: Live and Social
Being immersed in live media with other people.
Presentation (PDF minus videos, 60 slides, 1.6MB)
— What is Live?
— Live before the Telegraph
— Remote Control
— Live Bits
— How to Democratize Webcams?
— Symmetry (again)
— Early Live Social
— MUDSs, MOOs, and MMORPGs
— Second Life
— Facebook and Social VR