Video projection design driven by the performers’ brain waves, captured live in performance using wireless EEG
Created by Transforma Theater.
The high tech show was vividly supported by the artistry of … John J.A. Jannone’s video design.
Ana-Maria Bandean, Scena.ro
Nominee: New York Innovative Theater Award for Outstanding Innovative Design
I enjoyed the notion that the performers would be linked to the design; that their brains would be doing all manner of complex work that the they themselves were not consciously aware of, but were nonetheless radiating from them, and -- via the technology -- suffusing the space, re-appearing as echoes and ripples in the imagery.
Rather than designing for each scene, I created a total visual approach to the piece: I created a piece of software that could manipulate a “particle system” of 10,000 circular particles in a virtual 3D space, and record various manipulations as “cues.” The particles could be arranged into shapes, laid out in grids to become the "halftone” images of the role models, connected by lines, altered in color and transparency, and, importantly, displaced and altered by live brain waves. So these same 10,000 particles continuously re-arranged themselves into the various images and patterns seen on stage.
Knowing that live brainwaves would be transmitted throughout the space, and that I could pick up on these energies and use them in the design, steered the whole design process. The liveness of this data kept me from creating locked-down looks and cues, keeping the process open so that these brain-energies could influence, or determine, the image-world at any moment. So, even if the literal presence of the brain activity was not utilized in a literal or linear way, its existence as a part of the piece was what brought about the whole design modality.
every image in the show was rendered by the computer in the moment it was being seen; this “liveness” created an opportunity for any look to be modulated by the performers’ brain waves in real time. The EEG headsets transmitted the brainwaves on the theater’s WiFi, which was picked up by my software, and could be inserted into any cue, altering position, size, color, and arrangement of the particles based on brain activity. Sometimes these waves were rendered as literal “graphs,” showing the various brain regions and their energy spread across the backdrop like a chart; other times the effects were less literal, with performers’ brains producing the undulations and shifts of the imagery.
Photographs by Kathryn Butler
The Female Role Model Project
3 Legged Dog, NYC; November/December 2018
Edinburgh Fringe Festival, July/August 2019
Created by Tjaša Ferme
Developed with and Directed by Ana Margineanu
Devisers/Performers: Meggan Dodd, Tjaša Ferme, Gina Pemberton, Yiqing Zhao
Sound design and Composition: Justin Mathews
Video Design: John J.A. Jannone
Video Design Assistant: Alexandria Grajales
Lighting Design: Ayumu Poe Saegusa (CMsl)
Movement: Joya Powell
Cognitive Neuroscientist: Natalie Kacinik
Live Neuroscientific Interpretation by Phoebe Chen
On-stage Techies: Stephen Bryson and Maryam Choudhary
Stage Manager: Mariah Plante
Technical Director: Becca Key
Managing Director: Jacob Sebag
Director of Science: Natalie Kacinik
Artistic Director: Tjaša Ferme
Company Manager: Jeremy Goren
Tech Sponsors: Brainbit and Emotiv