Concept:

With the original foundation of the whac-a-mole system of arduino circuit being completed by a hammer whacking the mole, I added an extra element of music notes to make this a rhythm game. Users must hit the several moles (I am currently thinking of six) which will be spread in three different directions: left, right, and center. The interface will show a series of notes, each correlated to a specific mole and the user must hit the mole at a correct timing and order in order to score points. Missing the mole or hitting the incorrect mole will deduct points and if too many notes are missed, the user will lose the game.

Implementation:

-Arduino:

The arduino board will have an incomplete series of circuits that can be connected only when the hammer contacts the mole which will be made with some conductors and attached to wires. When the circuit is connected, an LED bulb will be lit and will send a signal to p5js some data that the mole was hit. It will also connect the buzzer which will then play a specific note correlated to the mole.

-P5js:

The p5js will show the interface of starting the game and the in-game node sequences. The node will be going across from one part of the screen to the other side, and when the node reaches a certain point in the screen, users must hit the correlating mole at that time in order to score points. I still haven’t figured the exact method of p5js loading this sequence of node. My current two possible ideas are either it is generated using some random function, or it would load a preloaded existing tune. During the actual implementation stage, I plan to try out both and see which is better to decide this.

Potential issues / Future work:

Like I mentioned before, I need to decide on the methodology of the loading of the sequence of nodes and part of this problem is feasibility. Since the core factor of a rhythm game is the music of it, I need to make sure that this is executed well during implementation. I also need to confirm that the serial communication between p5js and arduino can be done by completing a circuit via connecting wires. Other than that, I’m a bit worried about the physical layout of the whole project with long wires and several objects big and strong enough to withstand some whacking… But I am very excited to work on this project since I really love rhythm games and I also love some whacking.

Background :                                                                                                                                      After we learnt about the future of design and having read the rant on the future of interaction design by bret vector. I started thinking deeper about the concept of interactivity and how we as the future generation of designers and technologists can design innovative and authentic interaction experiences that differ from the “glass screen”.

Solution:                                                                                                                                     Using a different interactive gadget that allows the user to immerse in a designed universe without using their fingers or hands!

Using electrodes would allow the detection of EMG signals of the muscle and that will make it possible to use “muscle flexes” as input that can be detected, transferred and used as main input in the final product..         Concept:                                                                                                                                     My idea is to create an interactive P5 video game that is based on a retro style game such as ( Racing games, Tetris or even flappy bird). I would like to use the Backyards brain product( Arduino+Shield+ Electrodes) and combine that with p5, where the video game/ virtual environment will be created. I might also develop another game that some how incorporate muscle flexes to commit some sort of action in the game/ virtual environment.

Arduino:                                                                                                                                            Other than the Arduino circuit, shield and the electrodes already provided. I would like to incorporate a buzzer and LEDs that will allow to add a visual and a sonic signals to the game making it more immersive and adding another layer to the game by including sound and light signals that depend on the either the strength or the length of the flex. The EMG detected signals will then be transferred by the Arduino to the p5 which will cause certain actions to happen in the game

P5:                                                                                                                                                        As I mentioned above the P5.js side of the project will probably be a game based on either a retro style game or another game that requires repetitive action such as flappy bird or bounce ball.

Issues:                                                                                                                                                   I would like to make the game very responsive so I need to check that the hardware and the P5.js game are both at tune so that the game does not lag when the EMG signal has not been detected.

 

Concept

I want to create an interactive game where the user will use the joystick to move the avatar and find the lost objects. The idea for this project came from this interactive web-based experience called The Healing Forest. Initially, I was thinking of creating a Fruit Ninja game as a group project because I wanted to make the user interact with the game using the camera  but then I figured out it would lack the physical computing part so I decided to settle on the idea of using a joystick. 

• There will be a forest (or another setting) where the user will search for lost items by moving the avatar
• The flashlight will illuminate the avatar’s path wherever it will go and other parts of the background will be dark

Arduino

Input:

• Joystick will be used to control the movement of the avatar

• Buttons
  • Will be used to switch between themes
  • Will be used to jump from obstacles such as stone, etc.

Output:

• LEDs will be used to indicate a warning when obstacle is nearby

p5.js

Output:

• p5.js will provide a gaming interface by displaying avatar, setting, etc. It will receive the x and y coordinates from the joystick and will parse them to the gaming screen to move the avatar accordingly. It will also send a signal to the Arduino when an obstacle is nearby to light up the warning LED.

Further Improvements

I want to add some stages before and after locating objects, but I’m still brainstorming on those. One of the ideas is to add another stage where the user would need to sort/place the found objects based on different attributes or some output could be displayed based on the items the user collects.

Finalized Concept:

My finalized concept is to construct an Arduino Radar Sensor and make a game out of it! Essentially, I would have a bunch of random items all over the desk and it’s the user’s job to find the treasure in this pile of mess within a certain amount of time.

The only threat is, there is a radar constantly moving back and forth around a servo motor trying to detect the user. If the radar detects the user, and they are within firing range they would lose! However, if the user manages to find the correct piece of treasure before being noticed and within the time limit then they win! They would compete with each other to try and get the treasure at the fastest time possible!

Arduino:

For the Arduino, I was going to implement a Servo motor. I would make this motor move back and forth at a fixed speed and the angle at which the Servo motor rotates would be sent to p5js which would route to the visual representation of the radar.

Then I would mount the ultrasonic sensor onto the Servo motor. The distance that the user is from the sensor would be sent to p5js and translated in the range of the map and be drawn onto the radar. If the user is detected within some range then it would trigger the losing mechanism.

For the losing mechanism, I though I could incorporate a solenoid and it would essentially knock some mini model of a human, indicating they got shot and basically lost.

Additionally, I would add a pressure sensor on the table for the treasure. As the treasure rests on the table, it will apply pressure on the sensor, so when it’s picked up, the sensor has less weight so it implies the user picked it up and won! This would signal p5js to stop the radar and stop the timer and indicate that the user has won.

I was also thinking of adding a potentiometer to the circuit to try and challenge the user. This potentiometer would change the speed of the servo motor. So that way it maps the area even faster making it more challenging not to be noticed.

P5js:

For p5js, I wanted to simply create a visual for the radar, sort of like the image I posted last time:

So, as the Servo motor rotates, the line rotates around the circle as well. The ultrasonic sensor would produce some point on this radar to detect a person is there. If they are outside the range then it will not map.

Additionally, I wanted to also draw a timer somewhere so that the user can detect how much time they have left.

I also plan to add some music and some cool radar sound effects through p5js to keep the experience a little more fun and realistic.

Afterthoughts:

I may utilize the createCapture() function on p5js (camera) as that may be useful as a backup or to even double down on the scanning. Perhaps, I could use this to detect the user and use the ultra sonic sensor to detect how far they are. Maybe I could use the camera to communicate with Arduino to move the laser pointing or the nerf gun or whatever to point exactly at their body or something so it doesn’t get in their eye.

 

Concept

In light of the complexity of my initial plan in making a canvas made of LEDs to let the user draw, I decided to simplify my Final project. The former idea required a lot of LEDs which can not all be supported simultaneously by the Arduino Uno. Thus, I am restricting to a small number of LEDs to bring my project to fruition.

I am planning on two things:

1. Visual Memory: I will use a 4×4 LED grid to blink LEDs in some pattern. The user is then required to repeat the pattern onto the p5Js console in order to win. This game will increase in difficulty as the user clears the levels.
2. Text Marquee: On the same 4×4 LED grid, I will create a test marquee which would show text that the user enters onto the p5Js console.

Implementation

Arduino

All the LEDs will be controlled by the Arduino, however, the behaviour of the Arduino will change between the two modes:

1. For the memory game, the Arduino will generate random co-ordinates which correspond to the LED, and send them to p5Js. It will then wait for further command that instructs it to either repeat the pattern again, or create a new pattern. The difficulty level of the game can be changed with a button or a sensor hooked up to the Arduino.
2. As for the text marquee, the Arduino will wait for the text the user types and converts it to an array of co-ordinates corresponding to the LED which should be lit up to display that text/letter.

P5Js

The p5Js will incorporate all the user interactivity:

1. It will provide with a gaming interface for the memory game. It receives the co-ordinates of the LED which it will parse to its gaming screen to register if the user is correct or wrong. It will also send a signal to the Arduino to change the pattern or repeat the pattern
2. For the text marquee, the p5Js is used as an input device for sending text to the Arduino to later be printed on the LEDs.