Tongue `N' Groove: An Ultrasound Based Music Controller

Florian Vogt, Graeme Mccaig, Mir A. Ali & Sidney S. Fels
Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.
This data repository is not currently reporting usage information. For information on how your repository can submit usage information, please see our documentation.