Synesthesia Suit

WATCH VIDEO

SCROLL

A synesthetic suit capable of augmenting the visio-auditory sensory experiences with the sense of touch.
The suit is internally equipped with 26 actuators that vibrate along with the music and make the human body a conduit for soundwaves.

sundanceVR CREATIVE AWARD 2016 GRAND PRIXGOOD DESIGN AWARD 2016WIRED Audi INNOVATION AWARD 2016SXSWPlayStation EXPERIENCETOKYO GAME SHOW 2016FAMITSU FES 2016Media Ambition TokyoSOUND & CITYTOKYO DESIGN WEEK 2016DUBAI DESIGN WEEKSIGGRAPHUIST2016ASIA HapticsVR Japan VR SummitVR Japan VR SummitCODE CREATIVITY OF DIGITAL EXPERIENCES

About
Synesthesia

Synesthesia is a perceptual condition where the stimulation of one sense triggers a sensation in a difference sense. It can involve any one of the five human senses.

“Hear the colors, See the sounds”

The Synesthesia Suit was originally conceptualized and developed for the award-winning VR video game Rez Infinite,where your actions create sounds, which develop into music—all synchronized to a wondrous display of shape and color. When suited up, the player feels the music as it vibrates throughout the entire body.

That experience has been adopted by Crystal Vibes and holds the potential for other content, art forms and social communication in the future.

Rez Infinite

Produced and Published by Enhance
Developed by Monstars Inc. and Resonair

Crystal Vibes

Benjamin Outram
Music Harwell Dekatron by Ott

Haptic
Design

Not all body parts feel haptics in the same way.
In order to achieve the best multi-sensory experience matched with the content, various types of actuators were tested in different locations along the body, ultimately landing at 26 spots across the shoulders, arms, hips, abdomen, back, inner thighs, calves and instep areas.

Unlike basic vibration feedback on a standard game controller, each actuator can produce a wide range of tactile sensations, from a gentle touch to a hard impact.

In the case of Rez Infinite, from feeling percussive beats pulsing in the hips and legs, to a guitar-strum wave of tingles running over the entire body, each and every sensation was created to match the in-game action and sounds through an elaborate trial-and-error process.

Enhance
VR Experience

This project is also serves an experiment to enhance the VR experience spatially, outside of the person wearing the VR headset.

This was demonstrated at Media Ambition Tokyo 2016 (Roppongi Hills, Tokyo), where the entire space was designed to extend the Synesthesia Suit experience to the audience, with lights, colors, sounds and even vibrating chairs synched to the music.

Versions

Media

Credits

enhancerhizomatiksKEIO MEDIA DESIGN

Artist :

Enhance + Rhizomatiks + Keio Media Design

Creative Director :

Tetsuya Mizuguchi (Enhance), Seiichi Saito (Rhizomatiks)

Producer / Planner :

Ayahiko Sato (Rhizomatiks)

Technical Director / Developer :

Tomoaki Yanasawa (Rhizomatiks)

LED Suit Designer / Developer :

Tomoaki Yanasawa (Rhizomatiks),
Toshihiko Sakurai (SAQULAI, INC.)

LED Suit Device Developer / Programmer :

Hideaki Tai (Rhizomatiks)

LED Suit System & Lighting Pattern Developer :

Tatsuto Ishii (buffer Renaiss)

LED Suit Device Development Support :

Toshitaka Mochizuki (Rhizomatiks)

Haptic Suit Developer :

Keio Media Design, JST ACCEL Embodied Media Project

Haptic Suit Designer :

Toshihiko Sakurai (SAQULAI, INC.)

Audio System Developer :

Shintaro Kamijo (Rhizomatiks)

Suit Development Support:

Takahito Hosono (Rhizomatiks)

Chair LED Device Developer / Programmer:

Tatsuya Motoki (Rhizomatiks)

Space Design / Construction :

Propeller & Co.,Inc.

Video :

Muryo Homma (Rhizomatiks), Keiya Ando

Photo :

Atsuhiro Shirahata (un), Yusuke Nomiyama,
Akira Takeuchi (amana)

Website :

Yuto Nakamura (MARUKAJIRI Inc.), Shunsuke Hirota