Portfolio project
Symétriades: visualising contemporary music

Thibaut Devulder

View of our live projection mapped onto the performance stage

Symétriades/Extension is a visual experience that we created for an eponymous contemporary music piece for solo double bass and musical artificial intelligence.

Commissioned by Le Fresnoy - Studio National des Arts Contemporains in France, this art performance was presented at a contemporary music festival in October 2018.

In this project, art director Alain Fleischer and music composer Yann Robin wanted to express the idea of an abstract immolation of the soloist through the performance of this powerful musical piece, “plunging the audience into an immersive experience of engulfment” and “a fusion between the worlds of the seen and the heard.”

We developed with the artists a scenography and live video projections generated in real-time by the sounds and movements of the musician on stage, merging the expressionist visual universe of Alain Fleischer with poetic elements from Stanislaw Lem’s book Solaris.

 

Extract from Yann Robin’s musical score, codifying the complex movements of the soloist on the double bass (image © Yann Robin)

Symétriades as a musical piece

Composed in 2013 by Yann Robin, Symétriades is the second opus of three abstract compositions, all titled after the incomprehensible architectural formations described in Lem’s fictitious discipline of solaristics.

Inspired by and written for Nicolas Crosse’s double-bass powerful playing technique, the composition of the musical piece also includes an artificial intelligence that reprocesses in real-time the soloist’s live performance. This electronic system, developed at the Institute for Research and Coordination in Acoustics/Music (IRCAM), distorts, filters and reconfigures the music into a network of 8 loudspeakers and 4 sub-woofers that spatialise the sounds around the audience.

 

The visual experience

The artists wanted to visually express the contained ferocity of the music, using the metaphor of the bass as an instrument of self destruction.

Echoing some of the themes from Lem’s enigmatic book, we constructed the visual narrative of the performance as a succession of digital incarnations of the bass player.

Overlaid onto his physical presence on stage as video projections, each of these “doppelgänger” gets corrupted and eventually destroyed under the assaults of the sounds and movements of the musician on stage. Progressively turning into an abstracted version of his image, it finally recomposes itself into a purely abstract visual representation of the music.

To achieve this, our approach mixed real-time filming, 3D motion analysis of the musician on stage and sound analysis. We coded a custom computer program that could dynamically create and composite layers of animations over the image of the musician being projected onto the stage and coordinate them with the electronic sound processing.

The dynamic nature of our system allowed the video projections to adjust to the improvisations of the musician during the performance — something that the musical score specifically encourages during certain parts of the piece!

 

Double-bass solist Nicolas Crosse during rehearsals, seen through the shifting moiré of the translucent projection screens of our scenography.

The scenography

In parallel to the visual effects, we also designed a stage scenography for the performance.

From an early stage, we wanted to keep the powerful delivery of the soloist at the centre of the visual experience. Its perception by the audience should therefore be altered not only by the means of digital video projections, but also through the physical, direct medium of the scenography.

Playing with the perception of depth, we shrouded the stage with multiple layers of finely meshed black fabrics. These translucent surfaces create the screen for the video projections superimposed onto the stage and blur the projection into an elusive volumetric presence.

Positioned between the audience and the stage, they further distort the direct sight of the bass player through shifting patterns of moiré, adding to the expressionist makeup and costume of the performer, and echoing the liquid nature of the book’s protoplasmic being. Modulating the contrast between stage lighting and video projections, we could also shift the audience’s focus between the performer on stage and his abstract projected doubles.

 

The creative process

As we developed and refined the effects over the course of the production phase, we produced a series of video prototypes that precisely simulated the effects, based on high-definition videos and 3D captures taken during the first rehearsal. This allowed the involved artists to visualise the performance in real conditions at each design iteration, keeping the artistic discussion open and adjustments to the system simple.

We also took care of sorting out the technical solutions for the performance, selecting adequate equipment and producing detailed 3D models of the scenography and technical workflows, so that its feasibility could be checked with the technical team as the project developed.

This is what I call an immersive experience! It was incredible to witness my own avatars being destroyed in real time, as I performed the piece.

2hD’s work, under the artistic benevolence of Alain Fleischer, gave an exponential dimension to Yann Robin’s composition, merging the visual and musical architectures into one.
Nicolas Crosse, soloist in the performance

Credits for the project

Art direction: Alain Fleischer
Music composer: Yann Robin
Double bass soloist: Nicolas Crosse
Electronic sound treatment: Robin Meier
Scenography & live video projection system: 2hD
Production manager: Bertrand Scalabre
Stage manager: Alexis Noël
Sound setup: Geoffrey Durcak
Production: Le Fresnoy - Studio National des Arts Contemporains, in co-production with L’Ensemble Multilaterale


Are you an artist working with interactive installations or performances?

First rehearsals for the Symétriades art performance

Thibaut Devulder
Prototype of live visual effects, projected over double-bass player Nicolas Crosse, through the black open weave screens

Prototype of live visual effects, projected over double-bass player Nicolas Crosse, through the black open weave screens

I was at the National Studio for Contemporary Arts this week, for two days of rehearsals for the Symétriades art performance.

It was the first opportunity to test in real conditions the scenography and visual effects for the video projections that I had been developing for the performance in the past few months, collaborating with lead artist Alain Fleischer, music composer Yann Robin and double-bass player Nicolas Crosse.

Based on the idea of the soloist immolating himself through the performance of Yann Robin's piece for solo double-bass and electronics, our scenography is playing on the layering of open weave fabrics that are shrouding the musician in shifting patterns of moiré and acting as translucent screen surfaces for real-time video projections. 

We will be developing further the motion capture techniques and visuals over the summer, until the first public performances of Symétriades on 5th and 7th of October 2018, at Le Fresnoy.

Visualising interactive art installations with Processing and SketchUp

Thibaut Devulder

While developing the scenography for the Symétriades performance, I experimented with mixing the 3D model of our proposed stage setup with a sketch program, to communicate our proposed concept.

This simple example maps an early animation prototype of our Processing program onto layers exported from our SketchUp model of the scenography. The multiple projections are mapped over surfaces using the KeyStone Processing library, while lighting is controlled by dynamically adjusting layer opacities in the program. The mapped animation responds to a real-time spectral sound analysis of a rehearsal recording, as well as mouse movements on the modelled stage screens.

The integration of Processing sketches and SketchUp 3D models has a great potential for communicating ideas of the art installations in an interactive way. To be explored further…

Weaving space: an exhibition of student design work

Tom Hughes

The Master level architecture studio project that 2hD's Tom and Alina ran at Nottingham Trent University this year has concluded with an exhibition in the University's Arkwright building.

The exibition was designed by Alina and featured a dress by fashion designer Kula Tsurdiu (the project client) alongside selected work from the architecture students.

exhibitionpanorama