Would you like to have a LIVE performance using technology?

"Avatar Jockey" is an application that enables multiple people to share MR space and have an interactive music experience.

The player wears HoloLens2 and place the avatar that is the source of the sound in the space to create a 3D sound music space.

Demonstration of "Avatar Jockey" will be done three times a day using zoom, combining Hololens2 and iPhone in the exhibition.
Please join in to our exhibition from zoom!

Proposing a new music experience using Mixed Reality

What is the new music experience?

We propose “Avatar Jockey” which aims to expand the music experience using Mixed Reality.


What is Avatar Jockey?

“Avatar Jockey” is an application of HoloLens2 that allows you to freely arrange your avatar as a musical instrument in the space and build a musical space for 3D sound in real time.

“Avatar Jockey” is also defined as 3D Audio Visual Sampler from its feature.

Avatar Jockey introduction video


The features of “Avatar Jockey” are as follows.
1. The avatar is the sound source.
2. Intuitive UI.
3. Sharing the music experience with multiple people.


1. The avatar is the sound source.

AirTap the space and the Avatar will appear.

AirTap the appearing Avatar, starts to dance and sound starts to play from the Avatar.(The example in the photo is an avatar that sounds a rhythm.)

Avatar is a sound source.


2.Intuitive UI.

Select the Avatar type by the position of the hand where you want to AirTap.

Vertical: Type of instrument
From the bottom, Drum, Bass, Code, Melody, Voice
Horizontal: 3 types of instrumental phrases

Display phrase and instrument that are selected in center of the playerʼs view.


3.Sharing the music experience with multiple people

Players can see each other’s avatars by sharing the MR space.
Also the sound is shared, the session using Avatar is possible.

Avatar Jockey is a joint research project between Tokyo Computer Services and the Institute of Advanced Media Arts and Sciences (IAMAS).

This application is the result of the "development of a representation system using MR and research on its potential for development".

Please contact us if you are interested in our MR-based representation system.

Video distribution

Explain about "Avatar Jockey" with demo.

  • Explain about "Avatar Jockey" with demo from zoom.

    Demo time
    11/18(Wed) 11:00-11:20, 14:00-14:20, 17:00-17:20
    11/19(Thu) 11:00-11:20, 14:00-14:20, 16:00-16:20
    11/20(Fri) 11:00-11:20, 14:00-14:20, 16:00-16:20

  • The video explaining about how to use "Avatar Jockey".