VISIOPHONE

THE INTERPRETER

The Interpreter is an interactive installation that invites visitors to explore visualizations and sonifications of motion data from a pre-recorded dance sequence.

This installation is based on “Breakdown”, an audiovisual dance performance that was presented at “Ears, Eyes and Feet” concert in the B. Iden Payne Theater, UT Austin, May 2014. During the rehearsals, sequences of movements from the dancer were captured with an Xbox Kinect camera and saved to a database. Each movement sequence is represented as points in space and time that are related to the silhouette and skeleton of the dancer. The interactive system is constantly reading the motion data to generate real time graphic movement visualizations, paths from displacements in the space, morphing of the silhouette’s shape over the time and geometric patterns by points and lines connected to virtual body joints.

theinterpreter_01

There are 4 different  visualization modes modes:
0. Dancer silhouette;
1. Circle on the center of the body;
2. Horizontal Lines connecting body ends;
3. Body Polygon.

Through a touch interface the audience chooses the mode according the number of fingers of the screen, and also my moving the fingers vertical and horizontal it is possible to change perspective and viewpoints around the 3d structure.

theinterpreter_04

interpreter-touch

The background sound is generated by a granular synthesizer that is controlled by the dancer movements.  The granulator re-processes the bass and emits discrete grains. The quantity of motion of the performer’s hands is correlated with grain density. The area of the bounding box around the performer is correlated with the center frequency of a low pass filter. Also depending on the mode a different soundtrack is played over the background (taken from the Breakdown performance).

Made with Processing. Touch Interface with TouchOSC.

“The Interpreter” was exhibited at INTER-FACE : International Conference on Live Interfaces 2014 (Lisboa). Read the extended abstract here.

By: Rodrigo Carvalho (Visuals, Interactive System) | Yago de Quay  (Music, Interactive System) | Shen Jun (Dance)

interpretr-preview_b

theinterpreter_screen_07

theinterpreter_screen_13

theinterpreter_screen_25

theinterpreter_screen_26

Recent works

visiophone_interworlds_thumbs

INTERWORLDS

openfield-alice-thumb

ALICE

visiophone_taos_thumb

COSMIC SYSTEM

visiophone_breath

BREATH-A-GRAM

borischimp504_nhd04

NON HUMAN DEVICE #04

friction_thumb

FRICTION

visiophone_phd_thumb

S+V+M PHD THESIS

visiophone-thumb

AVSHOW | VISIOPHONE+HUGO BRANGO

borischimp504_valetudo_a

SCANNING THE SURFACE OF VALETUDO

lightflow_thumb

LIGHTFLOW

closeEncounters_thumb_borischimp504

CLOSE ENCOUNTERS

futureSoundOfThumb_visiophone

FUTURE SOUND OF […]