(Progress pictures)
The idea of the project is still the same, but renamed it to Mädenīet, which means culture in Kazakh. The game itself is focused on learning about various aspects of Kazakh culture. I found 3D models of dombyra, kiiz ui, taqiya, and asyq online through Sketchfab. They were of fbx format, so I used online converter to make them obj format, which p5 accepts. After trying to upload them to p5.js, they were too big, so I cloned everything to my VS Code, and decided that I will be running them locally instead. From Arduino side, I soldered arcade button, and added a circular Adafruit Neopixel with 24 LED. If we want to get into details, I connected Neopixel to digital pin 11, and LED side of arcade button to pin 9, and pin 6 to switch side of it. I laser printed out a box that I designed with Kazakh national ornaments in Adobe Illustrator. Made special holes from the back for Arduino cable to go through. I will be making a special holes for Neopixel cable to go from the front as well. I uploaded a background music of my favourite Soviet Kazakh ‘Vocal and Instrumental Ensemble’ – Dos Mukasan, and users will be listening through headphones and also be able to experience the game. User will press ‘Space’ to connect to Arduino port, then be required to press the arcade button (from Arduino to p5js connection). As soon as the hand is detected by the camera, the game and the music starts. With hand gestures of index finger user is able to rotate, and pinch between index and thumb allows to zoom in or zoom out. Making a fist, will transition to the next 3D model. Also, on the left side of each 3D model will be a short description of what this 3D model is and how valuable it is to the Kazakh culture. Change in different 3D models will send a signal from p5.js to Arduino by turning a neopixel into different colors (blue, orange, red, green). After Professor’s initial feedback, I decided not to pursue glove sensors and use Handpose ml5.js library to track the hand using a webcam, which made the coding much easier and so much more engaging.