ARCHE (Dance)

2023 | Visualization Research Centre, HKBU

VISIT THE PLACES YOU HAVE DREAMED ABOUT
BEFORE YOU FLY. FLY THERE.
THE MOST IMMERSIVE 3D EXPERIENCE EVER.
VISIT UNSECO WORLD HERITAGE SITES ACROSS ASIA
DISCOVER THE BEAUTY OF ARCHE DANCE

Project Overview
ARCHE is an interdisciplinary media art project combining Chinese martial arts, contemporary dance, music, video, motion capture, interactive stereoscopic graphics, and immersive visualization, merging traditional and contemporary elements into a cohesive artistic experience. The performance takes place in a 360-degree 3D immersive environment with an audience of fifteen, including three designated interactors. These interactors can transfer their agency to other audience members, fostering spontaneous social engagement and exploration of the space.

Technical Narrative
The performance unfolds in three acts. In the third act, a camera system synchronizes with the interactive components, allowing three participants to manipulate 3D special effects that emerge from the life-sized virtual performers. Their movements generate a dynamic stereoscopic visual experience, actively engaging all viewers. This fusion of visual aesthetics and physical interaction transforms the audience into active participants in the artwork. The interactors' physical movements modulate real-time visual patterns generated by motion-captured figures, synchronized with pre-recorded performances. This creates a continuous spatial dialogue where audience actions and performer movements evolve together, shaping the immersive environment.

第一部分:項目概述

ARCHE 是一個跨學科的媒體藝術項目,融合了中國武術、當代舞蹈、音樂、影像、動作捕捉、互動立體圖形和沉浸式視覺,將傳統與當代元素整合為一體化的藝術體驗。演出在一個 360 度的 3D 沉浸式環境中進行,觀眾人數為十五人,其中三位被指定為互動者。這些互動者可以將他們的控制權轉移給其他觀眾,促進自發的社交互動與空間探索。

第二部分:互動與技術敘事

表演分為三幕進行。在第三幕中,相機系統與互動元件同步,允許三位參與者操控從真人大小的虛擬表演者身上生成的 3D 特效。他們的動作創造出動態立體的視覺體驗,積極地吸引所有觀眾的參與。視覺美學與身體互動的融合,使觀眾成為作品的主動參與者。互動者的肢體動作會即時調整由動作捕捉到的人物生成的視覺圖案,並與預先錄製的表演同步,形成一個連續的空間對話,使觀眾的行動與表演者的動作共同演變,塑造出沉浸式的環境。

Principal Investigators: Katharina SCHMITT, Christoph WIRTH

Partner: 

Date: 2023 - ongoing

Team: Jeffrey SHAW (Interactive Design), Paul BETHGE (software developer), Vack CHEUNG (software developer), Leoson CHEONG (software developer), Ching LEE (Video post-production), Eugene BIRMAN (Music)

Hardware: nViz with 29.6 surround sound system

Software: Unity 3D, EEG

Innovation and Technology Fund, HKSAR