Technical details
HapTONE is a novel haptic interface that modulates the touch sensations of a keyboard. It presents the player with different vibrotactile sensations, not only after pressing the keyboard but also during the pressing operation. Thus HapTONE can present not only the sensation of percussion instruments such as drums and xylophone, but also continuous vibration associated with stringed instruments such as the violin. This is done by using optical distance sensors and vibrators placed in a keyboard. Stroke distance data is also used for visual expression. Interactive projection mapping with haptic feedback is achieved using keystroke data, presenting synchronized vibration and animation in accordance with real time stroke distance, which enriches the learning experience and pleasure of playing the piano. HapTONE can also be used as a controller for non-musical applications such as games.HapTONE presents high quality entertainment system using auditory, tactile and visual senses.
Movies
Exhibition content
We will present three applications using HapTONE: 1) reproduction of percussion instruments such as xylophone, glockenspiel or drums, 2) playing of pseudo-stringed instruments like violin or guitar by presenting vibration during stroke operation, and 3) synchronized vibration with animation helps to teach the melodies of ‘frog song’.You can experience these applications through only one interface, HapTONE.
