Conceptualization
This week, we are asked to create something using machine learning. And I thought: what is one of the most fundamental ways we categorize something? I immediately thought of shapes. I wanted to create a system that would recognize the shape you make with your hands and initiate something both in real life and the digital realm
Sketch
In this sketch, I delineated how I will create a box that holds my arduino. In the center would sit a webcam. When the viewer makes the designated shapes, the shapes would light up and the projection behind will projection onto the viewer and the wall in front.
Adobe After Effects
I decided to create all of my videos on adobe after effects. Thanks to communication lab, which taught me all the basic knowledge of how to use adobe after effects, I can now make simple animations.
I created the shapes on illustrator and imported them into adobe after effects. I wanted to create a feeling of shapes expanding continuously.
After Effects Videos
Coding + Arduino
P5
The coding was relatively easy. The majority of the code was designed so that after the video stopped playing, the webcam would read the hand signal and play a new video. Most of the code was copied from the template given.
The arduino side was simple as well. I did have trouble getting arduino to receive the data, but with the help of people at the shop, we were able to figure it out.
The LED took more soldering, which I'm starting to enjoy more and more. Definitely not enjoying the toxic fume though.
One thing I did want to say is that training the machine learning thing was absolutely GRUESOME. IT WOULD NOT WORK ON P5. I gave it so many samples but it still won't recognize the heart shape. I'm wondering why that is.
Arduino
Building
This was one of my favorite builds I've done, probably because WE FINALLY FIXED OUR LASER MACHINES. I could actually cut out the shapes with one run, which I thought wasn't possible. I wanted to extend my biggest thanks to the IMA and ITP faculty for finally getting it fixed. It made this project a lot easier.
To connect the pieces, I used a mixture of wood glue and super glue. I matched the led to the corresponding shapes, and added the same translucent paper as a filter layer.
Setup
FINAL
*click on bottom right speaker to turn on sound