Leap Motion & Projection Mapping
- Assignment review
- Introduction to Leap Motion
- Practice the button states (triggered, pressed and released) with Leap Motion
- Gestures with Leap Motion
- Introduction to Projection Mapping
- Basics of Syphon and MadMapper
- Keystone library and Syphon library in Processing
- In-class Exercise: Practice Projection Mapping onto multiple surfaces
References – Leap Motion
- Video: Leap Motion Demo
- Video: Leap Motion Tracking Comparison V2 vs Orion
- Video: eMotion with the Leap Motion – Pepper’s Ghost technique
- Leap Motion (Official website)
- Leap Motion – Setup
- Leap Motion Finger(Joint) – github
References – Projection Mapping
- Official Website: http://madmapper.com/try-buy/try-madmapper/
- Official Tutorials: http://madmapper.com/tutorials/
- Other youtube video tutorials by Wesley Buskirk.
- MadMapper Tutorial – Part 1: Introduction
- MadMapper Tutorial – Part 2: Interface Basics
- MadMapper Tutorial – Part 3: Import and Play
- MadMapper Tutorial – Part 4: Masking
- MadMapper Tutorial – Part 5: Mesh Warping
- MadMapper Tutorial – Part 6: More Quad Settings
- MadMapper Tutorial – Part 7: Other Surfaces
- MadMapper Tutorial – Part 8: Exporting
Other Projection Mapping Tools
- Spout – Syphon for Windows!
- For Processing
- Prepare Midterm Project Concept Presentation.
- Create a simple interaction with Leap Motion, including the button states (triggered, pressed and released).
- Utilize “abstract” button and button states, that were topics covered in week 3.
- If you want to challenge yourself, integrate projection mapping into your leap motion sketch. For example, with your finger, you will be able to press a button projected on a table or trigger movements of particles on the surrounding area.
- Please feel free to reach out to the instructor if you struggle with coming up with ideas.
- The exercise should be uploaded to Kinetic Interfaces google drive folder by midnight every Saturday so that the instructor has enough time to review your work. You should upload not only your source code but also all of your media assets, such as image, sound and video so that the instructor is able to execute the program.
- Additionally, your work process should be documented on the documentation blog. Your documentation needs to include sufficient amount of screenshots and video captures along with descriptions.
- Download Leap Motion App here!
- And the processing library below.
_Tips for Projection Mapping
Fabric Material for Screen
- Reflective (but not too much)
- Mesh (The grid size can be bigger if the distance between the screen and the audience is further away)
- Not elastic (should not be extended easily)
Steps of Projection Mapping Set Up:
- Hardware (with projector):
- SET UP THE PROJECTOR
- As close as possible with minimal use of zoom
- With slight overflow of screen for the desired area
- This will allow for the brightest and clearest projection possible
- LENS SHIFT: Adjust position with Lens Shift (if the projector has this function)
- ZOOM: Adjust zoom in adequate amounts
- FOCUS: Adjust the focus until the projection becomes as sharp as possible.
- KEYSTONE: Adjust the projection area to be as straight as possible using Keystone
- SET UP THE PROJECTOR
- Software (for example, with MadMapper):
- GRID & GUIDELINES: Project a grid or guidelines
- QUAD ADJUSTMENT: Make fine adjustments to the 4 corners of the projection area utilizing the grid or guidelines
- EDGE BLENDING: Blend the edges (if creating one screen with multiple projections)
- Add more details (segments or curves)
What Is Projection Mapping?
ENVISION – Step into the sensory box(2010)
3D video mapping projection brings buildings alive(2009)
Shanghai Disneyland fireworks
Amazing Dance and Video Mapping Performance
Tracking + Projection Mapping
Most Insane Immersive Movie Experience EVER, Part 1
Most Insane Immersive Movie Experience EVER, Part 2
3D Mapping on a transparent Jaguar car Full HD
Face Projection Mapping
FLUIDIC – Sculpture in Motion – (kinetic sculpture) full documentation 2014
ADIDAS SUPERSTAR PROJECTION MAPPING EXPERIMENT
pinwall | interactive game projection | augmented reality
Roger Waters – The Wall