Transreality Storyboarding

This lecture shows how creatives, producing different media within multiple mediums, an approach known as transmedia storytelling, could advance their storyboarding process to include modern immersive reality (XR) affordances. Participants will learn how to create experiences or tell stories across different immersive realities as well as media using a transreality-based storyboarding framework.

Creating experiences across the mixed reality spectrum requires a way for mapping stories and narratives that can include all affordances of AR, VR as well as various sensory or sensor-based interfaces. Historically people did this in multimedia experiences and formulated 'Transmedia' storytelling approaches. Immersive experiences do not just span different media but different realities so they require 'Transreality' storyboarding.

Transreality approaches ensure core standards in effective interface design and storyboarding are adopted in the production of XR creative works. This session introduces the Transreality Storyboarding Framework (TSF) that can be used by students to create a more coherent encompassing design and production workflow for AR and other XR experiences. The TSF can help in the management of student works helping implement strategies for working across mediums and realities in the process of expressing a story or creating an experience.

An approach addressing Transreality design and production is formalized into the Transreality Storyboarding Framework (TSF). The first component maps eight realities that students must learn to tell stories across, the Eight Realities Design Methodology (ERDM). The second component, (PAIRS), focuses on the design of user interfaces and experiences (UI/UX) connecting people into creative works, exploring the inclusion of Passive, Active, Interactive, Responsive, and Shared interactions. The third component is Contextology, a methodology for exploring how different kinds of senses engage with the narrative within those creative realities.

This video explores how the Transreality Storyboarding Framework emerged from formalizing Design and Production lessons learned from five projects that created experiences across the Mixed Reality spectrum and beyond. We refer to the projects:

• Couture in orbit
• Idrees Rasouli's workshop at the Dubai Design Week
• WEKIT project
• 2019 Leonardo Da Vinci 500th Anniversary Perpetual Motion Machines Exhibition
• Hobs 3d academy architecture engineering and construction