Digital, Media, Projection Design, and Technology for Theatre

Digital, Media, Projection Design, and Technology for Theatre

Digital Media, Projection Design, and Technology for Theatre covers the foundational skills, best practices, and real-world considerations of integrating digital media and projections into theatre. The authors, professional designers and university professors of digital media in live performance, provide readers with a narrative overview of the professional field, including current industry standards and expectations for digital media/projection design, its related technologies and techniques. The book offers a practical taxonomy of what digital media is and how we create meaning through its use on the theatrical stage.

The book outlines the digital media/projection designer’s workflow into nine unique phases. From the very first steps of landing the job, to reading and analyzing the script and creating content, all the way through to opening night and archiving a design. Detailed analysis, tips, case studies, and best practices for crafting a practical schedule and budget, to rehearsing with digital media, working with actors and directors, to creating a unified design for the stage with lighting, set, sound, costumes, and props is discussed.

The fundamentals of content creation, detailing the basic building blocks of creating and executing digital content within a design is offered in context of the most commonly used content creation methods, including: photography and still images, video, animation, real-time effects, generative art, data, and interactive digital media. Standard professional industry equipment, including media servers, projectors, projection surfaces, emissive displays, cameras, sensors, etc. is detailed. The book also offers a breakdown of all key related technical tasks, such as converging, warping, and blending projectors, to calculating surface brightness/luminance, screen size and throw distance, to using masks, warping content and projection mapping, making this a complete guide to digital media and projection design today.

The Curious Incident of the Dog at Night

The Curious Incident of the Dog at Night

Produced in 2019

Our production was featured at LDI and the Ohio State Alumni Association

The show was reviewed by the Columbus Dispatch.

IMG_3459.JPG
IMG_2726.JPG
IMG_2794.JPG
IMG_2894.JPG
IMG_2920.JPG
IMG_2946.JPG
IMG_4390.JPG
 Photo by Jo McCulty

Photo by Jo McCulty

 Photo by Jo McCulty

Photo by Jo McCulty

 Photo by Jo McCulty

Photo by Jo McCulty

Carminia Burana

Carminia Burana

Produced in Feb, 2018

Single Channel Realtime Video Instrument and content for live performance of Carmina Burana.

System and media designed in collaboration with visual composer and scorer Anna Gowboy of OSU’s Department of Music.

CARMINIA_BURANA_0038.jpg
CARMINIA_BURANA_0162.jpg
CARMINIA_BURANA_0180.jpg
CARMINIA_BURANA_0093.jpg
Execution of Justice

Execution of Justice

Produced 2018

OSU Theatre

2 channel media and 3 camera live video system.

Directed by Tom Dugdale

2018-04-02 20.03.01.jpg

automation and media cue

Forbidden Zones

Forbidden Zones

This was a new work, conceived by the director Leslie Ferris and devised by her and a cast made up of OSU Department of Theatre undergraduate and MFA performance students.

I joined the production approximately a year before opening and held regular meetings with the director consulting on the progress of the content and details of the emerging performance. The show and its design were inspired by Epic Theatre and incorporated both documentary imagery and simple text subtitles describing location, character names, passage of time, to punctuate the deaths of certain characters, etc. Moments of using high resolution stock footage and self-produced animations were used to punctuate battle scenes, and the burning of some of the old photographs used in the media.

Pictured here media is supporting the gestural recreation of a historical mural memorializing WWI.

This was a three channel blended projection system programmed in Watchout.

 

In The War Office

In The War Office

Historical images, super-titles, and custom produced content are used to support the dramatic action, emotional shifts, and environments of the play.

1W2A3041.jpg
After A Battle

After A Battle

Cassie Lentz's powerful scenic design is mirrored in the media. 

1W2A3178.JPG
1W2A3362.jpg
Terra Tractus: The Earth Moves

Terra Tractus: The Earth Moves

Produced in the summer of 2014 by Projects2k.org, Terra Tractus: The Earth Moves was a "dazzling performance experience that brought together lighting, projections, lasers, music, dance and rock climbing to immerse and amaze audience members with the beauty of our natural world." 

I was brought in to help complete the media creation and cuing of an hour long original video. I animated, edited, and finished content that had been in process and created original content that was incorporated into the show. I also consulted on the media system's final programming and cuing system. 

This was a three-channel blended projection system with realtime video mixing and was programmed in Touch Designer.

 "As a design we strove to create something that sat at an intersection of stop motion models and digital geometric forms. . . . The blend of real and digital feels at home with this show, and gives the projection a slightly modern flavor. During our

"As a design we strove to create something that sat at an intersection of stop motion models and digital geometric forms. . . . The blend of real and digital feels at home with this show, and gives the projection a slightly modern flavor. During our short preproduction period we recruited Alex Oliszewski to help us with the monumental task of completing all of the animation and editing work for the show.

"The three of us have previously worked on Wonder Dome which had left us with an established rhythm for collaboration. . . . We also spent a good piece of our time continuing to make content while we were away from the site. Because of the fluid nature of the show it quickly became apparent that a traditional cuing system might not be the right fit for this production. The media needed to feel more like an instrument than like a fixed volume. This caught all of us slightly off guard and required that we make some changes to our plans for creating media and controlling playback."

- Matthew Ragan

Excerpt from: http://www.citytheatrical.com/terra-tractus-temp

Continental Drift

Continental Drift

An animation sequence showing the constant reformation of the Earth's plates and continents.

The show was scored live by Istvan Peter B'Racz

1W2A9961.JPG
1W2A9974.JPG
Good Kids

Good Kids

Playscripts Blurb: 

"Something happened to Chloe after that party last Saturday night. Something she says she can't remember. Something everybody is talking about. Set at a Midwestern high school, in a world of Facebook and Twitter, smartphones and YouTube, Good Kids explores a casual sexual encounter gone wrong and its very public aftermath. Who's telling the truth? Whose version of the story do you believe? And what does that say about you?"

I was responsible for system design, technical aspects of projection, and programming. I devised a three-channel blended projection system with three live video feeds programmed with Watchout. 

Photos by Matt Hazard

Driving Home

Driving Home

I recognized the production would lend itself to a cinematic story telling style. 

This idea was embraced by the director, set designer, and larger design team and I worked closely with themto find ways live camera work could be incorporated into the design and staging of the play. Set designer Brad Steinmetzconceived a wonderful set that provided a short and wide cinematic type image while incorporating an ever present horizon to evoke the play's setting in a small Ohio town. 

The performers embraced the challenge of changing between moments of acting directly for the audience and moments of acting for the camera.

One camera, mounted inside of the truck, provided extreme and medium closeups of performers sitting in the cab and occasional hints of an audience member in the far distance.

A pan-tilt zoom security-type camera installed in the lighting grid allowed for the framing of extreme closeups and wide shots of the stage from a very high angle. 

Hacker

Hacker

The play includes a character named Deidre who hacks into the social media accounts of the rapists and exposes the coverup perpetrated by the adults in the play to national media.

Deidre releases two videos in the style of Anonymous during the course of the play. 

Because it helped create the visual aesthetics of social media and web video, I incorporated a third live video feed from the character's laptop.

 

Live Video Mixing

Live Video Mixing

In a moment focused on social media and the appropriate consequences for its abuse, approximately 7 minutes of original hand-animated content is mixed with a live video feed of the hacker character, Deidre.

IMG_0866.JPG
IMG_0971.JPG
IMG_1075.JPG
City of Angels

City of Angels

This production of City of Angels was a collaboration between OSU's Department of Music and Department of Theatre.

For this production, I produced a cinematic opening video and a series of rear projections providing environmental support for the various locations visited during the story. I also designed and programmed the Watchout media server used to cue and playback media content.

This was a single-channel video system programmed with Watchout.

Photo by Mathew Hazard,
2014

City of Angles: Opening

Working closely with the director I produced this cinematic opening for OSU's production of City of Angles. The video was projected on a movie screen beginning when the house opened for seating and continued during the live overture. Once the overture was completed, the screen was flown out, revealing the set. At the end of the musical, a traditional list of cinematic credits was projected on the same screen used at the beginning of the show.

The Invisible Library: A Forest of Information

This interactive installation used a legally approved log of realtime library network activity produced by the otherwise invisible users searching and retrieving information on its networks.

Visitors to the Thompson Library had this activity revealed to them though an interactive projection displayed near one of the Library's main walk ways. It incorporated a passive display mode showing a graphic forest of trees slowly growing and evolving over time. In its active mode users are able to reveal an ever updating visualization describing the number of scholarly articles and their disciplines and sub-disciplines headings as served by the library..  

This was a fun and unique interdisciplinary and cross-university collaboration.

I designed the human computer interface and underlying data visualization software along with a set of automated and remote maintenance features in order to minimize system downtime.

I collaborated with Thompson Library Exhibit Coordinator Erin Fletcher, Assistant Professor of Computer Science and Engineering Arnab Nandi and Associate Professor/Head of Research Services, Meris Mandernach to develop this exhibit.  
 

video by Arnab Nandi

Cirque Du Soleil: KA

I provided consultation and training to the Las Vegas based Cirque Du Soliel show Ka's Lead Projectionist Davin Gaddy and his lighting and projection staff. Our goal was to ensure that their Isadora media server would perform at the highest possible quality when replacing the show's final battle scene with a prerecorded projection.

While in Las Vegas, I led a one-day workshop on the use of Isadora media server software that was attended by senior lighting and projection staff from multiple Vegas-based Cirque shows. 

Creator and director Robert LePage
Interactive projections by Holger Förterer
 

There Is No Silence

There Is No Silence

I collaborated for over two years with Director Jeanine Thompson, OSU Associate Professor and Movement Theatre Specialist, and Vita Berezina-Blackburn, OSU Animation and Motion Capture Specialist, in the creation of the new work There Is No Silence.  This project is an example of my work that crosses between theatre and experiential media design.

 I designed a two-channel front and rear blended projection system programmed with Isadora that enabled mixing prerecorded content with the live video feed from a real-time motion capture system driven by performers on stage.

In this image, Sarah Ware is portraying Marcel Marceau's signature character Bip on a visit to New York City. Her movements at stage level were mimicked in real-time by the animated avatar on the upper screen. 

"I Want To Wear White Face"

Working closely with this performer/deviser, the media team helped make invisible emotions and memories visible and audible. 

The media in this scene is prerecorded but cued live to allow for idiosyncrasies in the performance and possible last-minute changes in choreography.

I used the Isadora media server programming language to create a scene-specific cuing interface that supported the performer's devising process and the technical rehearsal and cuing timeline and process.

NB: In this archival video, not all the animations are clearly visible due the scene's extreme contrast and the camera's exposure settings.

 

Animation by Steven Conroy
Performer/Deviser: Sifiso Mazibuko

There Is No Silence: The Rehearsal Hall

There Is No Silence: The Rehearsal Hall

This was the technical rehearsal setup we used while learning how to stage and cue the show. Eventually equipment was moved into traditional positions in the Tech Booth.

From left to right:

1. "Blade House Monitor" showing the Blade motion capture server located backstage (pictured inset)

2. Projector control laptop: Projector On/Off, calibration, etc.

3. Waltz display 2: Motionbuilder live video output

4. Tango display 1: Motionbuilder interface

5. Tango display 2: Motionbuilder live video output

6. MacBook Pro (MBP) / Display 1: video-in monitoring from Waltz and Tango

7. MBP Thunderbolt display 3 programming interface

8. MBP display 2: Isadora stage 1

9. Apple TV: Isadora stage 2

not shown: Waltz display #2 with Motionbuilder Interface

There Is No Silence: A Duet with Marcel Marceau

In this scene, the performer Patrick Wiabel describes his process of devising a short duet with Marcel Marceau. 

I designed a media system to assist in the movement training aspects of our devising and rehearsal process.  This scene was inspired from the performer and director’s work with that system.

This motion capture data is part of the Jerome Lawrence and Robert E. Lee Theatre Research Institute's Marcel Marceau American Collection.

NB: This video has been manipulated to increase the exposure of the upper screen to enhance the visibility of the projections in the recording and does not exactly represent performance conditions.

 

Marceau Marcel Training Setup

Beyond executing the Marcel project as a theatrical design, I was inspired by a teaching-based research question: How might the motion capture information be presented to the performers in rehearsal?

I designed this 360-degree immersive visualization set of the “At the Bar” motion capture data to enhance the performer's ability to see and rehearse with a mirror image of Marceau’s animated form from four directions.  

In response to student feedback, I enhanced the system to project a larger-than-life image of their animated form. Another popular feature allowed students to request adjustments in the playback speed, which helped clarify their perception of the movements as they studied them through embodiment.

System Diagram

System Diagram

This is a quick sketch of the system I designed and programmed to cue There Is No Silence.

Some of the scenes required quick switching between two different real-time motion-capture-driven animation environments. The Motionbuilder software used to drive our real-time animation did not have the ability to transition between different environments seamlessly. I developed a solution that allowed for real-time switching between two Motionbuilder systems running in real-time.

The Visit

The Visit

For OSU’s production of Friedrich Dürrenmatt’s 1956 tragicomic play, I was responsible for the overall media design, including system design, content design, content production, and programming.  I devised a three-channel blended projection system with a live camera programmed in Wings Platinum to project images of arriving and departing trains as well as the live television broadcasts that were substituted for the radio broadcasts called for in the original script.

In this sequence, the reflection of a train is projected on the performers and the stage.

Directed by Lesley Ferris, OSU Arts & Humanities Distinguished Professor

 

Photo by Mathew Hazard

The Visit

The Visit

Our update to this play included altering some of the text and substituting a live television broadcast for the live radio broadcast.  

 

Produced by Ohio State University's Department of Theatre

Directed by Lesley Ferris, OSU Arts & Humanities Distinguished Professor

Written by Friedrich Dürrenmatt

Photo by Mathew Hazard

Architectural Protection: OSU's South Chiller Plant

Architectural Protection: OSU's South Chiller Plant

I collaborated with faculty and staff from the Knowlton School of Architecture, College of Engineering, and Department Theatre, and the Advanced Computing Center for the Arts and Design (ACCAD) on a projection project.  In this class we mentored a dozen advanced undergraduate and graduate Architecture and Theatre students working in partnership with the OSU Facilities Operations and Development team to create a state-of-the art lighting display that was projected on the north façade of the 60’ tall South Campus Central Chiller Plant.

I taught an interdisciplinary team of students techniques for video mapping and methods of content creation.  To simulate the installation ahead of the actual event, I introduced preplanning and visualization techniques using small projectors to cast images on scaled 3D-printed models of the Chiller Plant. The students worked together to create images and program a video imagining the operation of the plant. The video was projected onto the side of OSU's South Chiller Plant on several evenings in the fall of 2013.

I was responsible for technical aspects of projection, system design, server programming, and training. This was a two-channel blended system programmed with Watchout.

This is a link to an article on the installation published in The Lantern, OSU's student newspaper:
http://thelantern.com/2013/11/ohio-state-student-project-illuminate-campus-building/ 

 

IMG_8242.JPG
IMG_8247.JPG
Wonder Dome

Wonder Dome

As the lead media designer for the research team that collaborated in the creation of the interactive system for The Wonder Dome, I was responsible for content and digital puppet design for the Dome's premier children's play, "Leo-the-Geodesic Dome."

Wonder Dome is an advanced system design for theatrical performance. The Isadora-based system I designed allows for the simultaneous cuing and automated updating of design elements with qualities shared between video, sound, and lighting design including hard and soft cue triggers, dynamic placement, animated locations of avatars and assets, and automated color matching between LED intelligent lights and video assets.

The Wonder Dome incorporates Isadora, Touch Designer, MAX, Ableton Live, along with customized telepresence, audio, facial tracking, and OSC message routing capabilities into a modular and interworking performance system.

Wonder Dome was featured at the Mesa Arts Center's Spark Festival and ASU's Emerge festival in 2014.

The Wonder Dome is a cross-university project between: 
Arizona State University and The Ohio State University

ASU || The School of Film, Dance and Theatre
ASU || School of Arts, Media and Engineering
ASU || The Center for Science and Imagination
ASU || The Pave Program in Arts Entrepreneurship
OSU || Advanced Computing Center for the Arts and Design
OSU || Department of Theatre

Sponsored by:
BARCO || NVIDIA || PACIFIC DOMES INTERNATIONAL || VORTEX IMMERSION MEDIA

Wonder Dome: Digital Avatar

Wonder Dome: Digital Avatar

Pictured here is the facial tracking system (left image) that I developed to allow real-time animation of the digital avatar Leo (right image). The performer was provided with monitors showing the digital avatar as well as an overview of the audience in the main dome.

Wonder Dome represents a highly advanced system and performance space capable of adhering to standard professional theatrical rehearsal and production timelines. To aid rapid cuing, we designed a real-time warping method that allows direct previewing of unrendered video on the walls of the dome.

This is an excellent example of the theatrical designs that I create in collaboration with colleagues in OSU's Departments of Theatre and ACCAD. 

The Beach

The Beach

 

One of the specialized features of The Wonder Dome system is the ability to control the color output of the LED lights to match or enhance live or prerecorded video projections.  

In this example, the LED lighting matches the warm yellow of the sun. Moments later, as the projected image immerses the audience beneath the ocean, the lighting turns blue and flickers in synchronization with the waves that cover the surface of the dome.

Wonder Dome System Schematic

Wonder Dome System Schematic

This schematic is typical of my process when designing both equipment connectivity and the location of and interfaces for operators. Ultimately, I enjoy designing both the audience facing content as well as display systems that specialize in interactivity and use in a traditional theatrical rehearsal and production process.

The facial tracking system was located in a tent next to the main Dome. An array of cameras and microphones enabled the performer to see and hear the audience, which allowed her to react dynamically as she gauged their response to the avatar.

Next To Normal

Next To Normal

I was hired by Mixed Blood Theatre for their 2012 production of 2010 Pulitzer Prize winning musical drama, Next to Normal.

Working with Artistic Director Jack Reuler, I integrated 25 minutes of original video content with a live video playback system to bring to life the ghost of the family's dead son.

Now in its 40th season, Mixed Blood Theatre is dedicated to creating socially and culturally relevant works that support their mission to “champion equity and animate social change.”

Produced and performed at Mixed Blood Theatre in Minneapolis Minnesota.

I was responsible for the design of media content, system design, production, programing, projection. I devised a two-channel blended projection system withlive video feed programmed with Watchout.

Photo by Rich Ryan 

Next to Normal

Next to Normal

A moment in the scene where Diana Goodman undergoes electroshock therapy.

 

Photo by Rich Ryan