Project Overview

Fall 2022

Max/MSP/Jitter
Interaction Design
Multimedia
Arduino

The works shown here were from the class 18-090 Twisted Signals: Multimedia Processing for the Arts. Throughout the course, I learned various way of manipulating and synthesizing sound, video, and control signals through using Max/MSP/Jitter, a visual programming language for music and multimedia.

I later on made a physical version of this game on a 8*8 LED matrix. I used a JavaScript face recognition API library to access the player’s facial expression as the input for the game. After routing out 4 different expressions, I assigned a direction to each of them, which allows the player to control the x and y position of the pixel by performing different expressions.

Once the player managed to catch the target pixel with the moving pixel, the target red pixel will appear on a random spot on the matrix again.