︎

Work.          Archive.       Info.

APRIL 12, 2022

Two shapes having anxiety


p5 libraries used: http://molleindustria.github.io/p5.play/

I decided to prototype a video gamesque controller that allows you to give anxious shapes more anxiety. Almost like a mating dance.
Original p5 sketch uses mouse/keyboard input to animate





Motion Differentiation


What is a motion? When does the TinyML stop recording the gesture?
— what motions are too similar? 
— what happns when one motion is a part of another motion?
— adjusting how fast should the training happen, when should it refresh to collect a new dataset for training
— getting motion to stop once the signal has been received once


I trained with roughly 40 instances each. Still, the motion-paths aren’t distinguished enough from each other properly, so sometimes it behaves at random.





I was frustrated and randomly named the motions “lo” (forward motion), “round” (circular) and “ee” (diagonal) in classic train-wreck-naming-convention fashion.




Other qualms: 


  • It was tricky to get bluetooth to work at first. I finally felt in control of this project when the arduino light stopped blinking RGB and became a stable Blue.

    This was after Scott turned my Bluetooth on/off, after trying other more complex ways to get to devices to pair.

    Juggling a bunch of p5 libraries was also simply lovely, sometimes I was confused about the order in which the serial versus the draw stuff 
  • should happen.


MARCH 29, 2022

Wekinator



I did get this one to work:


(Scott’s Max Patch)

https://youtu.be/XpskMdiP1eA

buuut the duck doesn’t really change. i can see the values changing but not sure where to view my output. The lolcalhost server won’t connect. 


Finally got it to work! Turns you can’t simply open a patch with Max, copy pasting works better. 


Fail #1

I used this word2vec plugn for Wekinator to give it input from the command line. This didn’t really work, I wasn’t sure where to observe the output. The local host server wouldn’t run.
I will probably open an issue and see if I get a response. 




Fail #2

I tried the p5 tutorials next but it also had some components that weren’t responding. Not sure something has depreciated. Also, the recommended input and putput ports were 3333/3334 respectively, but the local host URL from the local live server didn’t reflect that. Not sure if that matters.

https://github.com/genekogan/p5js-osc/blob/master/Applications.md


fwiw, Gene in these videos is running his p5 code locally, it doesn’t seem to work on the web editor. 





Fail #3

At this point I’m probably giving up too soon. I tried a max patch but couldn’t understand that input and output for audio. 

I should probably come back to this. 


APRIL, 2022

Forager’s friend


I trained mymodel on some early spring flowers, both edible and toxic. I captured the flowers from a variety of angles, and labelled them.




Fai

Teachable Machine Link: https://teachablemachine.withgoogle.com/models/6-sQeA4nl/

p5 sketch:https://editor.p5js.org/tanvi/sketches/IdR7OB02q







I then classified the 9 samples as toxic and non toxic and mapped them to green and red LEDs respectively. 


in action :

APRIL, 2022

🥨 Pretzels et al.


I trained my model on three shapes/gestures: Hourglass, Shuffle and Pretzel! Here is the documentation for pretzel, which was arguably the most complicated.

The ‘drawing tool’ is pretty low fidelity, something like a cat is identificable as a pretzel at best. 

TIP: record more than you think you’ll need and clean. My sample set went from 130 -> 116 real quick.
The starting points here are inconsistent, (in red), I found it hard to docus on the gesture rather than the final form.

 
she’s perfect, but she’s hard to get right. 





Initially, I was trying to do a Z instead of the Hourglass but I realised that it kept capturing my motion to reset my drawing gesture to the starting point at the end of one sample. I realised that closed shapes with the same starting and ending point might work better with our capturing system. 

Error 1: I had some labelling issues too. Not sure why these happen, went into the JSON to fix.


Error 2: This was caused by running the Colab notebook on Safari! 🚫





Training


Here is training for all three. Training for one goes smoothly.






A Pretzel! Not a Pretzel!
via GIPHY

APRIL, 2022

Color detector


I am still working on getting the circuit right ...
I’m not a 100% sure how to configure the button. I’ll consult friends to understand whats wrong with my circuit right now.

I looked at this diagram to understand how to photocells connect. 

diagram for photocells

Is this what I should be following as the diagram for button?

I’lll keep working on it.....



 

Thanks for watching!


Reach out to chat:  
︎ chronictanvi@gmail.com



Projects © 2024.
Typeset in Guyot Text, Diatype Variable