Kyle’s Notes of ‘Scrape Web‘:

bit.ly/IMA_ScrapeWeb

GIT INSTALLATION

(Mac laptop should come with git pre-installed)

Reference: https://confluence.atlassian.com/bitbucket/set-up-git-744723531.html

CLASS CODEBASE

link: https://github.com/xyfeng/expressing-data

STEPS

( Git is a language/tool for people to write code in a collaborated way, we only use it to store our example code, you can always download the whole package by click on the zip link. Please don’t modify any file inside the repository folder, always make a copy outside of the folder, unless you know how to use git properly)

1. Open Terminal App
2. Go to a folder where do you want to put the repository, for example: cd Desktop
3. Pull the latest code from the remote server: git clone https://github.com/xyfeng/expressing-data.git
4. When there is an update of the code, instead of downloading the whole package, you can use these command to pull the latest code, first of all, make sure you are in the folder of the repository, for example: cd Desktop/expressing-data then pull the latest code: git pull

Assignment

Think about your final project, pick an idea, requirements (involves with color mapping, pixel/shapes drawing and geo location elements). Write a blog post of your progress, focus on the research of dataset and conceptual sketches).

Class Notes

Learned how to draw Great Circle Arc. ( Algorithm )

Sample Code: download

Note: You can switch map region inside setupMap() function by giving right coordinates. You may noticed the horizontal lines across the globe, it may be caused by the drawArc() function I ported from python, will update when I have time to dig into the code.

China Flights Map:

World Flights Map:

Learn:

1. PVector https://processing.org/tutorials/pvector/
2. Projection http://www.gicentre.net/utils/mapprojection/
3. Shape Data http://www.amcharts.com/svg-maps/
4. Image Export http://learnosm.org/en/map-design/tilemill/

References:

Keynote

Class.05.01

Assignment

1. Download and track your locations use Moves app.
2. Read and write a blog post: ‘Envisioning information‘ by Edward Tufte (Chapter 3 & 5)

Image Metadata

• Common Command Lines in Mac Terminal
  • change directory: cd
  • check current directory: pwd
  • create new folder: mkdir folder_name
  • check items in current folder: ls
• Software: http://www.sno.phy.queensu.ca/~phil/exiftool/  (Command Line Tool)
• Exif Wiki: https://en.wikipedia.org/wiki/Exchangeable_image_file_format
• Exiftool commands
  • reference page: http://www.sno.phy.queensu.ca/~phil/exiftool/faq.html
  • read metadata: exiftool image_file_name
  • read metadata with tag name: exiftool -s image_file_name
  • read metadata in groups: exiftool -G image_file_name
  • save metadata in csv format: exiftool -csv *.jpg > metadata.csv
  • save specific metadat fields in csv format: exiftool -csv -FileSize *.jpg > metadata.csv
• Reference Code:
  • 0401/image_metadata

Face Detection

• OpenCV (processing lib only works on processing 2)
• How openCV works: https://vimeo.com/12774628
• Dlib and CLM-Framework Explained: http://www.learnopencv.com/facial-landmark-detection/
• Facial Landmark dectection: https://matthewearl.github.io/2015/07/28/switching-eds-with-python/
• Average Photos Example Code:
  • 0401/image_face_01
  • 0401/image_face_02
• Average Portrait installing instructions

Assignment

• Work on your photo project and post image/video on blog
• Deadline: midnight this Sunday
• Reference Code: zip

Week 3, Class 2

• Assignments
  • Read Two Chapters and write down your thoughts on our blog
  • Play with code samples
• Code: zip
• Reading: download

Week 3, Class 1

• Keynote: Class.03.01
• Assignments: link

Nov 8th:

09:00 – 09:30:

10:00 – 10:30:

10:30 – 11:00: Gabriela

11:00 – 11:30:

11:30 – 12:00:  Cindy