Gesture Based Music

Published on 18 May 2022. Written by Jagmohan

Can you produce music without using any instrument? Yes, it is possible now. In this project, you will produce music just by moving your hands. Based on particular gestures, you can produce music. This is the future of the music industry.

Read more..

For implementing this project, you will use Raspberry Pi as the brain of the system. For detecting various gestures, you will use the accelerometer sensor. You will also use the gyroscope sensor to get the orientation of your hand movements. These sensors will be attached to a hand glove.

Wear the glove and make some hand gestures to produce music.

Project description:

Raspberry Pi 3: It is a third-generation, single-board computer. It contains a 64-bit quad-core processor. The clock speed is 1.5 GHz. An external micro SD card provides memory to Raspberry Pi. You can give instructions using the Raspbian OS.

Raspbian OS: It is similar to Windows or Ubuntu OS. You can code the Raspberry Pi using Python in the Raspbian OS. It is user-friendly and allows multi-tasking.

Accelerometer sensor: It is a device used to measure the acceleration. You will use it to detect the hand gestures.

Gyroscope sensor: It is a device that measures rotational motion. You will use it to understand the orientation of the hand.

Sonic Pi: It is a music creation tool based on coding. You can code the system to play music based on hand gestures.

Project implementation:

1. Place accelerometer sensors on various parts of a hand glove. For example, fingers, palm, wrist, arm.
2. Place the gyroscope sensors also. Make sure you place them near the accelerometer sensors.
3. Interface the sensors with the Raspberry Pi using appropriate wires.
4. Open the Raspbian OS on your PC/laptop.
5. Use Sonic Pi for coding. The sensors will give input to the Raspberry Pi.
6. Read the input to detect a particular hand gesture. Once a gesture is confirmed, associate a particular sound with it.
7. Let us say you want to play drum sound. Detect the hand gestures that are used in drums. Now associate a particular sound with a particular gesture.
8. Try to add as many sounds as possible.
9. Finally, try to compose music using only hand gestures.

Programming Language: Sonic Pi

Kit required to develop Gesture Based Music:

• Raspberry Pi
• accelerometer sensor
• Gyroscope sensor

Technologies you will learn by working on Gesture Based Music:

• Smart Systems
• Latest Tech
• Innovation

Any Questions?