2024 | Visualization Research Centre, HKBU
Project Overview
9 Shards was part of the Sound Visions project led by Dr. Roberto Alonso TRILLO, which aimed to reshape cinematic experiences by prioritizing sound as the primary storytelling medium. Through advanced sound spatialization techniques and a specialized sound system at the VRC Lab, the project created unique 3D auditory experiences.
Designed for a 360-degree viewing stage, this immersive environment enabled an audiovisual journey that dynamically navigated through the space. This cohesive aesthetic narrative transported audiences into a series of localized sensory experiences.
Technical Narrative
In development, the project emphasized real-time audience engagement through interactive elements that contributed to non-linear audiovisual narratives. Innovative sound-to-image and image-to-sound techniques effectively blurred the boundaries between sonic and visual elements.
This multi-layered approach balanced complex 3D visuals with parallel circular 2D visual narratives and real-time generative content, exploring the synergy between visual and sonic spatializations. Ultimately, this experience redefined immersion by challenging traditional divides, offering a fresh perspective on cinema as a performative medium.
第一部分:項目概述
《9 Shards》是由羅伯托·阿隆索·特里洛博士(Dr. Roberto Alonso Trillo)主導的《聲音願景》(Sound Visions)項目的一部分,該項目旨在以聲音為主要敘事媒介,重新塑造電影體驗。透過先進的聲音空間化技術和 VRC 實驗室的專業音響系統,該項目創造了獨特的 3D 聽覺體驗。
此項目設計於360度觀賞舞台上,提供了一個沉浸式環境,讓觀眾通過空間中的動態聲畫體驗展開聲視結合的旅程。這一連貫的美學敘事引領觀眾進入一系列的局部感官體驗。
第二部分:技術敘述
在開發過程中,該項目強調通過互動元素進行的實時觀眾參與,為非線性聲畫敘事提供了支持。創新的聲音與影像互動技術有效地模糊了聲音和視覺元素之間的界限。
這種多層次的手法在注重3D視覺的同時,也融入了平行的圓形2D視覺敘事和實時生成的沉浸式內容,探索了視覺和聲音空間化的互動效果。最終,該體驗通過挑戰傳統的隔閡,重新定義了沉浸式體驗,為電影作為表演媒介提供了全新視角。
Leads: Roberto Alonso TRILLO
Collaborator: ---
Partner: ---
Date: 2024
Team: Roberto Alonso TRILLO (Director / Performer), Davor Vincze (Composer), Andrew Quinn (Visual Artist), Peter AC NELSON (Visual Artist)
Hardware: nViz LED array, nViz HOA Sound System + Butt-kickers, MetaBow with embedded sensors
Software: TouchDesigner, Max, MetaBow Toolkit
2024.05.04
20 minutes performed 4 times
Innovation and Technology Fund, HKSAR