Outline

VR/AR Fundamentals Outline

1: Audiovisual Resolution and Fidelity
Fooling a single static eye and single static ear experiencing a framed representation.


Presentation
 (PDF minus videos, 44 slides, 1.4MB)

Static Elements
—- Pixels & Color
—- Dynamic Range & Brightness
—- Photo-Realism, Abstraction, & Cartoonishness

Special to VR / AR
—- Accommodation
—- Orthoscopy

Dynamic Elements
—- Motion & Frame Rate
—- Sound
—- —- Frequency Range
—- —- Dynamic Range & Loudness
—- —- Audio-Realism, Abstraction, & Cartoonishness

2: Audiovisual Spatiality and Immersion
Fooling two static eyes and ears, then two moving eyes and ears, then removing the frame.

         


Presentation
(PDF minus videos, 89 slides, 2.5MB)

Stereoscopic & Stereophonic Displays
—- Parallax & Disparity
—- Interpupillary Distance (IPD)
—- Convergence
—- Stereo & Binaural Sound

Multiscopic & Multiphonic Displays
—- Holography
—- Head Tracking
—- Volumetric Video
—- Spatial Sound

Panoramic Displays
—- History
—- Monoscopic Panoramas & Nodal Points
—- Stereoscopic Panoramas & Head Rotation
—- Multiscopic Panoramas

Putting It All Together

Hacks

3: Other Senses (Haptic, Smell, Taste, Mind)
Fooling the other senses.


Presentation
 (PDF minus videos, 48 slides, 1.2MB)

Haptics
—- Haptics & Force-Feedback
—- Seats & Motion Platforms
—- “4D”
—- Skin as Input
—- Hands & Controllers
—- Touching Real Things / Mixed Reality
—- Non-Contact Haptics

Smell & Taste
—- Smell-O-Vision & the Food Simulator
—- Current Work

Mind
—- Remote Viewing (ESP), Brainstorm (the movie), & Science
—- Hacks

Issues
—- When is suggestion good enough?
—- Synaesthesia

4: Input and Interactivity
Using our effectors and intentions as inputs and how they shape interactive experiences.

Presentation (PDF minus videos, 56 slides, 1.1MB)

Input
I/O
Computation
Sensors (Non-AV)
—- Mechanical
—- Position & Movement (IMUs)
—- Biometric & Environment
Vision/Cameras
—- Body
—- Hands
—- Eyes
Sound/Microphones
—- Voice Control
—- Smart Mics
Mind
—- Electrodes & Big Machines
—- Optical Imaging & Holography
—- Psi & Consciousness Research

Interactivity
UI
Navigation v Manipulation
Symmetry
Responsiveness
Inference
Control v Illusion of Control

5: Live and Social
Being immersed in live media with other people.

Presentation (PDF minus videos, 60 slides, 1.6MB)

Live
— What is Live?
— Live before the Telegraph
— Broadcasting
— Webcams
— Remote Control
— Live Bits
— How to Democratize Webcams?

Social
— Symmetry (again)
— Early Live Social
— Teleconferencing
— MUDSs, MOOs, and MMORPGs
— Second Life
— Facebook and Social VR