Brief

Music is often associated with hearing and sound, but listening is not the only way to experience music. Deaf people enjoy music and can benefit from music just like everyone else. Vibe is a platform that aims to help Deaf people learn piano and create music.

Duration: 2 weeks (Feburary 2018)

Project Advisor: Christian Ervin, Jesus Galvez 

Tools: Sketch, Photoshop, Arduino 

Team: Independent

 
 
 

The Problem

  1. Few products and services offer music lessons to Deaf people.

  2. Lessons for Deaf sometimes require additional setup, consisting of an extra surface like Music Floor for them to better touch and feel the music.

  3. These modified instruments are difficult to carry. Because of the poor mobility of these instruments, Deaf people face issues with re-listening to their compositions and sharing their passion with others outside of the room.

 
 
 

Secondary Research

“I adapted to follow music by feeling the beats through vibration” - Source: Lee Walker @ It’s that deaf guy, writing in The Guardian

Ludwig van Beethoven, a famous deaf German composer and pianist, composed some of his most famous works by laying on the floor next to the piano while composing.


Deaf singer Mandy Harvey used to feel the vibrations of the music by standing barefoot on the floor. Deaf people feel music through different ways like touching a surface attached to an instrument or by touching loudspeakers.

 

Existing Solutions

 
 
 
 
 

 Why Piano? 

Due to the timeline of the project I had to focus on one musical instrument. With time, this project can aim to target other instruments.

The piano is comparatively easy and comfortable instrument for Deaf people to learn and play. 

  1. It is professionally tuned and need not be tuned every time someone plays it.

  2. Playing the piano is almost like typing, the player has to hit the key by looking at the corresponding music notes.

 
 

How might we make music more accessible to Deaf piano enthusiasts?

 
 

About Vibe

Vibe app and Vibe patch connects with the piano and help players feel the music as they play. Vibe aims to help Deaf musicians learn music on any piano  without having to modify it. They can also record and listen to their music whenever and where ever they want.

 
 
 

How it Works 

 
 
 
 
 

Vibe patch

Vibe patch connects with the app and converts music from the app to vibrations. Neck, heart and soles of the feet are some of the most sensitive parts of the human body to feel the music but Vibe patch can be placed anywhere on the body based on one's personal choice.

 
 
 

Ideation

 
 

Key Screens

 

Connect your Piano with the Vibe app

 
 
 

Learn how to play Piano in real time and feel the music as you play it.

 
 
 

Record your unique creation.

 
 
 

Save your creation on the app.

 
 
 

Play music from your stored files whenever and wherever you like.

 
 
 

As you play, adjust the sound for your audience and vibrations for yourself as you listen.

 
 
 

Prototyping the Vibrating Patch

I worked on creating a musical keyboard with 8 primary keys and then mapped frequencies of each key to the vibrating patch. The vibrating patch consists of vibration motors that connect to the keyboard and functions based on the feedback received from the keyboard.

 
 
 
 
 
 
 

Possible Impact

  1. Deaf people can play any piano without extra setup.

  2. The vibrations created from the music notes are more precise and accurate.

  3. Music can be created, stored and accessed anywhere.

  4. More music enthusiasts will have access to music lessons.

 
 
 

What I Learned 

Vibe was a challenging project for me as it was my first physical computing project. During the project, I learned about technology and it's limitations which later helped me design products that are grounded in reality. As next steps, I would like to test this product with the Deaf community and iterate based on the received feedback.