VISIOPHONE

THE INTERPRETER

The Interpreter is an interactive installation that invites visitors to explore visualizations and sonifications of motion data from a pre-recorded dance sequence.

This installation is based on “Breakdown”, an audiovisual dance performance that was presented at “Ears, Eyes and Feet” concert in the B. Iden Payne Theater, UT Austin, May 2014. During the rehearsals, sequences of movements from the dancer were captured with an Xbox Kinect camera and saved to a database. Each movement sequence is represented as points in space and time that are related to the silhouette and skeleton of the dancer. The interactive system is constantly reading the motion data to generate real time graphic movement visualizations, paths from displacements in the space, morphing of the silhouette’s shape over the time and geometric patterns by points and lines connected to virtual body joints.

theinterpreter_01

There are 4 different  visualization modes modes:
0. Dancer silhouette;
1. Circle on the center of the body;
2. Horizontal Lines connecting body ends;
3. Body Polygon.

Through a touch interface the audience chooses the mode according the number of fingers of the screen, and also my moving the fingers vertical and horizontal it is possible to change perspective and viewpoints around the 3d structure.

theinterpreter_04

interpreter-touch

The background sound is generated by a granular synthesizer that is controlled by the dancer movements.  The granulator re-processes the bass and emits discrete grains. The quantity of motion of the performer’s hands is correlated with grain density. The area of the bounding box around the performer is correlated with the center frequency of a low pass filter. Also depending on the mode a different soundtrack is played over the background (taken from the Breakdown performance).

Made with Processing. Touch Interface with TouchOSC.

“The Interpreter” was exhibited at INTER-FACE : International Conference on Live Interfaces 2014 (Lisboa). Read the extended abstract here.

By: Rodrigo Carvalho (Visuals, Interactive System) | Yago de Quay  (Music, Interactive System) | Shen Jun (Dance)

interpretr-preview_b

theinterpreter_screen_07

theinterpreter_screen_13

theinterpreter_screen_25

theinterpreter_screen_26

Recent works

OpenField-Epicentro-2017_thumb

EPICENTRO

Openfield_kaleidotree_thumb

KALEIDOTREE

Openfield_palacioThumb

JARDINS DO PALÁCIO CRISTAL

Openfield_laserThumb_b

LASERS DE SÃO JOÃO

Openfield_musaThumb

PLANET MUSA

thumbInfiniteDelta

Δ∞ [Infinite Delta]

thumb

Non Human Device #03

reductionreflectionVisionphone

REDUCTION/ REFLECTION

THUMB-WEB

X-FILES’ ALIEN SPACESHIP

ddThumb

DAMAGED DUCHESS FASHION VIDEO 15/16

intovoidThumb

INTO THE VOID

Screen Shot 2015-09-28 at 12.45.07

VAVA METROPLEX