Week 5+6

Color Tracking & Face Tracking

Class Overview

Lecture 1

  • Assignment review
  • Methods of getting the center coordinates of an area detected by selected colors
  • Using a Threshold(Tolerance) variable to control the sensing area
  • Using a Threshold(Tolerance) variable effectively to improve sensing accuracy and stability
  • Using the lerp() function to smooth the tracking x, y coordinate

Lecture 2

  • Getting color difference between the current frame and previous frame
  • Using the color difference as a motion tracking method.
  • Counting the number of pixels in a button to trigger the button.
  • Detecting faces, eyes, nose, bodies utilizing OpenCV library in Processing
  • Improving the performance(speed) of face detection.
  • Introduction to FaceOSC by Kyle McDonald
  • In-class Exercise: Combining the methods of Pixel Manipulation and creating buttons in order to create a Color Tracking
  • Discussion about usage of Color Tracking and Face Tracking



  • Program an interactive sketch with Color Tracking or Face Tracking.
    • Utilize “abstract” button and button states, that were topics covered in week 3.
    • If you want to challenge yourself, think of new ways to increase the sensing quality. Then please share your method with other students in class
    • This could be a simple game using the position of a certain color, or a drawing tool that uses the whole body. It could also be a musical instrument that uses the facial expressions. You will be able to get inspirations from the presentations of week 2.
    • Please feel free to reach out to the instructor if you struggle with coming up with ideas.
  • The exercise should be uploaded to Kinetic Interfaces google drive folder by midnight every Saturday so that the instructor has enough time to review your work. You should upload not only your source code but also all of your media assets, such as image, sound and video so that the instructor is able to execute the program.
  • Additionally, your work process should be documented on the documentation blog. Your documentation needs to include sufficient amount of screenshots and video captures along with descriptions.



Please download the libraries below!