Breaking the Forth Wall through Extended Reality

Citation

Kao JS & Kao K (2023) Breaking the Forth Wall through Extended Reality. In: SMPTE 2023 Media Technology Summit, Hollywood, California, 16.10.2023-19.10.2023.

Abstract
Filmmakers pursue a goal of a more absorbing and powerful sensory viewing experience through implementing advanced technologies. With the thriving of extended reality (XR), an XR revolution in the entertainment industry has been initiated by practitioners. This article reviews cinematic realism from aspects of photorealism, the phenomenal S3D cinema, and its unfulfillments for the immersive experience, and elaborates the XR trend by specifying the potential of implementing augmented reality (AR) as a medium for a new level of cinematic realism. AR's feature of presenting virtual imaging in the physical world provides a solid foundation for an extended dimension over the viewing screen. This article introduces the concept of augmented dimension (AD) that implements augmented reality as the out-of-screen visual effects to explore the perceptual realism in cinematic experiences. Compared with stereoscopic 3D films, the three-dimensional perception in AD can be considered as perceptual realism rather than photorealism. This article also illustrates the proposed pipeline to produce AD films and concludes the potential of AD for the future immersive cinema.

Keywords
Augmented reality; cinematic realism; immersion cinema; augmented dimension

Notes
The authors are solely responsible for the content of this technical presentation. The technical presentation does not necessarily reflect the official position of the Society of Motion Picture and Television Engineers (SMPTE), and its printing and distribution does not constitute an endorsement of views which may be expressed. This technical presentation is subject to a formal peer-review process by the SMPTE Board of Editors, upon completion of the conference. Citation of this work should state that it is a SMPTE meeting paper. EXAMPLE: Author's Last Name, Initials. 2022. Title of Presentation, Meeting name and location.: SMPTE. For information about securing permission to reprint or reproduce a technical presentation, please contact SMPTE at jwelch@smpte.org or 914-761-1100 (