Digital Culture & AudioVisual Challenges

Extended Abstract

The perception of higher-dimensional space remains a fundamental challenge for human cognition, as sensory experience is inherently constrained to the interpretation of three-dimensional environments constructed from two-dimensional sensory inputs. Human perception of depth and spatial structure emerges through complex cognitive processes that integrate incomplete visual, auditory, and tactile information. While these perceptual mechanisms successfully support the construction of coherent three-dimensional mental models, they do not preclude the conceptual or cognitive exploration of higher-dimensional spaces, commonly referred to as hyperspaces. Throughout the history of science and art, abstraction techniques such as projection, slicing, and inference have been employed to extend human understanding beyond immediate sensory experience.

Within this interdisciplinary context, this paper presents the Hyperspace Game, an interactive serious game designed to explore and potentially enhance human perception of the fourth spatial dimension. The game focuses on the four-dimensional hypersphere as a central geometric construct and employs cross-sectional visualization as its primary perceptual strategy. By simulating the intersection of a four-dimensional object with three-dimensional space, the application allows users to observe dynamic geometric transformations that cannot be directly perceived in the physical world. These transformations are rendered in real time and are augmented through a colour-coded system that maps spatial coordinates to chromatic values, enabling users to infer higher-dimensional structure through visual cues.

The colour-coding method implemented in the Hyperspace Game builds upon earlier work by Traperas and Kanellopoulos, extending Hinton’s approach to dimensional visualization. In this framework, the three spatial axes of three-dimensional space are encoded using the RGB colour model, while a fourth axis, represented by white, corresponds to the fourth spatial dimension. The intensity of each colour component is proportional to the absolute value of its associated coordinate, allowing colour variation to function as a perceptual indicator of spatial position and movement across dimensions. Through this method, the hypersphere’s evolving cross-sections become legible not only through changes in shape but also through chromatic transformation.

Designed within the framework of serious games, the Hyperspace Game combines educational objectives with interactive exploration and research-oriented data collection. The application is structured into four distinct stages that support the gradual development of perceptual and conceptual understanding. The first stage introduces the theoretical foundations of hyperspaces and cross-sectional geometry through a guided tutorial video, preparing users for interaction with abstract spatial concepts. The second stage focuses on two-dimensional cross-sections of a three-dimensional sphere, providing a perceptual baseline grounded in familiar geometry. This stage includes both an exploration mode, which allows unrestricted interaction, and a quest mode, in which users complete goal-based tasks designed to train attention to symmetry, colour balance, and spatial transformation.

The third stage extends this training to the core challenge of the game: the exploration of three-dimensional cross-sections of a four-dimensional hypersphere. In this stage, users interact with a dynamically evolving three-dimensional geometry whose form and colour composition change as the hypersphere intersects three-dimensional space. The increased perceptual and conceptual complexity of this stage requires players to interpret spatial transformations emerging from a higher-dimensional structure. As in earlier stages, both exploration and quest modes are provided, with predefined tasks guiding users toward recognizing key geometric features, such as moments of maximum cross-sectional extent and balanced colour distribution corresponding to four-dimensional coordinates. Throughout all stages, the absence of time constraints encourages reflective engagement and minimizes performance pressure, prioritizing perceptual understanding over speed or competition.

A distinctive feature of the Hyperspace Game is the integration of colour sonification, which introduces an auditory dimension to the perception of higher-dimensional space. In this implementation, colour values derived from RGBW coordinates are mapped to sound using pure sine waves for the primary colours and white noise to represent the fourth dimension. Rather than conveying precise spatial information, sonification functions symbolically and experientially, reinforcing the impression of dimensional transition as cross-sections unfold. This multisensory approach supports a multimodal understanding of abstract geometry and aligns the project with artistic research practices that explore synesthetic perception and audiovisual interaction.

The final stage of the game consists of a mixed-format questionnaire that serves both as the conclusion of the user experience and as a research instrument. The questionnaire assesses participants’ prior familiarity with higher dimensions, their interpretation of hypersphere cross-sections, and their conceptual understanding of projections, slicing, and multidimensional analogies. Additional qualitative questions invite user feedback, supporting iterative design refinement and future development. Through this structure, the Hyperspace Game functions simultaneously as an educational platform and an experimental framework for investigating human hyperspatial perception.

Positioned at the intersection of art, science, and emerging technologies, the Hyperspace Game exemplifies the role of the TechnArtist as an interdisciplinary practitioner who communicates complex scientific concepts through embodied and accessible experiences. By combining visualization, gamification, and multisensory interaction, the project demonstrates how higher-dimensional geometries can be approached not only as mathematical abstractions but also as perceptual phenomena. The work suggests that interactive audiovisual environments can support intuitive engagement with otherwise inaccessible spatial concepts, opening new pathways for interdisciplinary research, education, and artistic exploration.