Lumisonic Destop Version

The software can be used ‘out of the box’ with a mouse (or another special needs input device) or with a Nintendo Wiiremote, which provides additional vibration-based feedback. Users can load and play back sounds from the remote, whilst using the accelerometer to make real-time adjustments to the pitch, pan-position and volume. Beyond this, the musical output of the software can be set to a number of transposable scale systems. This allows for a wide range of musical interaction (i.e. You can use it as an musical instrument!).

What you can do with it…

There are four basic things you can do with this software:

  1. You can use it to get Visual Feedback of a sound that is happening in real-time. This can also be used for speech therapy, and understanding harmonics
  2. You can play sounds that are already recorded and manipulate them to create whole new sounds
  3. You can do use it to manipulate sounds that are happening in real time. E.g. If you have a microphone recording a musical instrument, a child can alter the sound by using the software (possibly using the wii remote!)
  4. You can use it to record sounds and then play them back

How does it work?

Musical interaction is conducted through the alteration of the visualisation itself. Through learning to control a number of specific gestures, the users can alter the appearance of the visualisation instantaneously. The visualisation is then converted back into audible sound, perceptually occurring at the same time as the original sonic material. The sound and music is effectively 'translated' into useful visual information that can be sensibly interpreted and changed in real-time by users who are unable to hear and react to the sound.


Lumisonic for MAC (14MB)
Lumisonic Full Installation PC (30MB)

Lumisonic iPhone Version

Download Lumisonic for the iPhone for Free

Available on the iPhone App Store

In this project

Further Reading

BBC Tecnology: Helping the Deaf to 'See Sound'


Goldsmiths' Creative Computing Department


Sound and Music|3rd Floor, South Wing, Somerset House, London WC2R 1LA|Tel +44 (0)20 7759 1800||Registered Charity: 1124609|VAT Reg No: 937 5533 96 

Designed by Fitzroy & Finn|Built by Platform3|Copyright © Sound and Music 2016