© 2020 Zheming Zhou. All rights reserved

 

R/M is a wearable AI system that coordinates rhythm by body movement.

This project starts from designing a musical educational tool, and ends up to become a bigger idea which spreads into a much larger field (sport, fitness, physical/music therapy, health, etc). Music is beneficial to a varies of aspects to human beings which we don't even notice. It creates more neuron connections, improve our mood, and train our brains unknowingly.

What is rhythm?

Rhythm is the most important and fundamental concept of music. However, rhythm is everywhere. Such as the orbit revolution of the earth, the lunar week, the time that a lion in the middle Africa feels ready to hunt, human’s biological circulation, fabric patterns, the heart beat, dancing, etc.

Why rhythm?

Rhythm has a magical link inside of human brains between body parts, brain functionality and the biological circulation. It benefits the coordination of body movements (sport, physical disorder, etc), manage a balance between the brain and the body, create more neuron connections (Parkinson, ADHD,etc), and deeper the music understanding. Now days people are spending more time and money into their physical health. In the future, mental health will be as important as physical health. I believe that rhythm is a smart connection which can link both of them together.

Fields

Music education, sport, fitness, therapy, health, etc.

Existing products / solutions

Metronome, fitness tracker, ​swimming (biking, running, etc) tempo trainer, sleep cycle monitor

Marathon pacer, personal coach, music tutor, etc. 

 

Problems

The human brain is not trustable for rhythm/tempo/time perception. Our blood pressure, mood, brain activities and a lot more other factors can easily change the perception of rhythm.

Human tutoring cost time, money. It is emotional, and not accurate as machine.

Machines or products are accurate but lack of a perception, analysis, and feedback system comparing to human being.

Fitness trackers are lack of simultaneously feedbacks during body movements.

Solution

To build a wearable AI system that combines the accuracy of machine and the methodology, detection/feedback system of human being. It detects and send multi sensory feedbacks to users simultaneously during body movements. 

SCENARIO

How does it work? What is the user cycle, scenarios and applications?

Activities & Movements

Sensors detect rhythm from users ( movement data)

Send info to processor for analyzing

Simultaneously multi sensory feedbacks

Set up

Pick a rhythm/tempo

by movement or tapping

Or set up more complex

goals with an App

Practice rhythm/tempo

with movements

The tracker senses the 

rushing/dragging

The headband provides

feedbacks to guide the user

The user is back to

the right track. Then the feedback disappears

Keep practice with

body movements

"Faster your stroke, Alex. Keep up with my rhythm. Keep up! And you will create your new personal record within the next 200 meters."

"Jaden, you are dragging right now. Follow the light and the vibration. I will pull you back to 120 BMP, and after you are on your own "

"Band, how is my condition? How far to the destination?" (VOICE CONTROL)

"Caroline, you are right now on the correct pace. Your currently heart beat is 160 BPM. You are going to speed up according to my guidance after 2 more kilometers. Only 3 kilometers more to the destination"

Light therapy against the jet leg...

Cheerful music playing...

"Anna , you have 3 more hours to pass the jet leg. You have been staying still for 2 hours, and I recommend you to stand up and move around a bit more in order to switch back to your biological clock"

 

DESIGN

Headband + Tracker + Analyzing System

Weather Resistance

Designed with weather resistant and waterproof considerations. It is an indoor and outdoor device. Users can play music with it, doing sports, and even swim with it as a pacer.

Wearable Feedback System

Instead of staring at the phones and checking the informations inside of screens, this system create a more natural way (through the headband, which is the closest place to "human sensors") to receive feedbacks (by users or other team mates in a team section) simultaneous during body movements.

Smart System

Bring body movements into rhythm learning! The system detect body movement by the motion sensors and marking comparison and calculations with the preset rhythm and goals. Therefore, the system will know if the users are in the right track and be able to guide them back.

The main design style is minimalism and sporty. The strap is designed to be removable, stretchy, flexible, adjustable, good for washing, sweat resistance.

Control

One round rubbery rounded physical button ​for on/off and bluetooth connection. A touch panel is designed beneath the rotatable stick. Users could swipe and touch it with different gestures to switch the mode, adjusting volume, brightness, etc. 

Multi Sensory

Led spot light is designed under the stick, which can be hidden on top depending on users' need. Multi sensory is designed into the product after massive of user testing and research. The goal is to enhance the users' perception and trying to make more connections inside of human brain.

Long Press​

ON/OFF 

Taps

Record Rhythm

Swipe

Switch Mode / Info

Tap + Swipe

Modify Volume / Tempo

Charging

Another detail shot from the side, shows the structure of the connection, nylon pad, and the inner and outer material, and together with the charging spot. The whole design is considered to be water proof or sweat resistance. The whole product was designed as sealed as possible. 

Coloration

The color set is designed according to the natural skin tones of human race, white, yellow, brown, black. As it s a wearable product which is so close to human skin, the best way to generate a nice combination is to let it fit inside of its scenario environment.

Tracker

The tracker is able to track users' rhythm from their body movement, biological clock, heart beat. Information are sent to the system and generate feedbacks and guidance to users through the headband. Users are able to know their foot steps, workout situation, music tempo, biological clock, heart beat, sport rhythm, and calories by the information gathered from the tracker.

The tracker is wearable on different parts of the body. Due to the compatibility and the ride range of application, the tracker is able to fit on arms, wrists, ankles, etc. As a result, musicians who has a foot tapping habit can fit it on their ankles; swimmers can put it on their upper arms to reduce the disturbance, etc. The design of the elastic band with a buckle has a much larger range of tolerance for different parts of the body. At the same time, it is more durable and compact, which is also exchangeable.

A glence of UI (for music learner)

Featured with team work connection, self practice mode, tutor mode, and rhythm necklace

Users can practice individually or join in a group. Rhythm is detected and transformed into graphical system to enhance the user experience and help people learn rhythm in a different way. Any existing rhythm can be transferred into this rhythm nechlace system. Users can customize and change their own rhythm by simply adding, dragging, selecting dots on the ring. In a team section, users can combine different necklaces and have fun with the interaction of the system.

Applications