Portal is an audiovisual installation using motion controls to interact with an imaginary entity.
The hand movements triggers sounds and visual accordingly, becoming more intense when hands are getting closer to it.

I wanted to create the illusion of opening a portal to an arcane world only by the means of both hands.

Leap motion finger tracking are mapped to oF parameters (camera position, opacity and noise function) using ofxLeapMotion:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54

   
   if( leap.isFrameNew() && simpleHands.size() ){
       
       leap.setMappingX(-230, 230, -ofGetWidth()/2, ofGetWidth()/2);
	leap.setMappingY(90, 490, -ofGetHeight()/2, ofGetHeight()/2);
       leap.setMappingZ(-150, 150, -200, 200);
       
       for(int i = 0; i < simpleHands.size(); i++){
           
           for(int j = 0; j < simpleHands[i].fingers.size(); j++){
               int id = simpleHands[i].fingers[j].id;
               
               ofPoint pt = simpleHands[i].fingers[j].pos;
               
               icoSphere.setRadius( width * 0.5);
               
               cam.setDistance(abs(pt.y)*10);
               if(cam.getDistance() > 5000) {
                   cam.setDistance(5000);
               }
               
               noise = pt.z;
               if(noise > 0) {
                   noise = 0;
               }
               noiseParticle = ofMap(abs(noise), 0, 255, 0., 2.);
               
               colorY = ofMap(abs(pt.y), 0, 490, 0, 255);
               if (colorY > 255) {
                   colorY = 255;
               } else if (colorY < 0) {
                   colorY = 0;
               }
               colorZ = ofMap(pt.z, 0, 150, 0, 255);
               if (colorZ < -255) {
                   colorZ = -255;
               } else if (colorZ > 0) {
                   colorZ = 0;
               }
               radiusY = ofMap(abs(pt.y), 0, 490, 0, 1.5);
                               
               // camera rotation
               float mx = pt.z/(float)ofGetWidth();
               float my = pt.x/(float)ofGetHeight();
               ofVec3f des(mx*360.0,my*360.0,0);
               cameraRotation += (des-cameraRotation)*0.5;
               
               fingersFound.push_back(id);
           }
       }
   }
   
leap.updateGestures();
leap.markFrameAsOld();

The main pad sound in the background is looped and modulated with feedback grain delay + overdrive effect parameters mapped to the leap MoDULAtion max app by Masayuki Akamatsu.

I recently worked for “La Cité du Vitrail” in french city called Troyes on an interactive installation. The original installation wasn’t working anymore and as the original developer was currently living abroad I was asked to debug it or eventually develop a whole new software.

The setup is quite simple, a webcam tracks the position on a red pointer in real time, a stained-glass window is then projected in the chapel whenever the pointer is put upon the corresponding one on the surface of the table.

The original program was made with Processing, one application was dedicated to the detection of the pointer and another one was dealing with the display of the correct stained-glass window. Those two applications communicates via server sockets, leading to some signal loss at random interval. On top of that, the camera detection was pretty sensitive to the ambient luminosity of the space, that’s why the program wasn’t working always as expected.

I first attempted to make just one Processing application but it wasn’t stable enough after the debugging part. Even though I had only 4 days to make it for the inauguration of the new collection, I decided to build an entirely new software in C++ with openFrameworks. I used the OpenCV library for detecting blobs from the camera image and assigned coordinates for each of the 61 triangles represented on the table. When the pointer is above the right coordinates, it triggers an animation with the ofxTween library, displaying the stained-glass window.

The installation is now stable and it only needs one application for all of the processes.

During my last stay in Bretagne I went to LiFE, an ancient dutch submarine basement reconverted in a contemporary art space. The architecture offers interesting perspectives with repetitive patterns. Walls reflecting in the water of the garden on the rooftop are like an infinite corridor to the sky.

I was lucky enough to spend some time in the installation of Jeppe Hein, “DISTANCE”. Like graphically and sculpturally composed roller-coasters with a series of white balls circluating on them, the installation plays with perception of space and time. The structure must have been through a long process of trial and error, the physics behind each xof part of the circuit enabling the balls to follow their path without any malfunction.

Bends, turns, curves, uphill/downhill slope, loops. A ball going through obstacles, following its trajectory, from start to end. Enjoy the walk.