Complementary visualization and soniflcation of multi-dimensional data

Abstract

Interpretation of multi-dimensional complex data usually involves extracting the relationship between several variables. This is typically done with an interactive visual system. High resolution volumetric data imaging, color, animation, and multiple views are effective tools for data interpretation. Sound can provide an additional and complementary perceptual channel. This presentation focuses on the use of sound with a multi-dimensional imaging system to facilitate the interactive interpretation of complex data. Our methods and system are presented with data from a simulation which computes electron density, hole density, and potential throughout the volume of a three-dimensional semiconductor. The spatial changes and relationships of the three scalar fields are the object of study. Normally the field relations would be examined through multiple visualizations. Here, sound is used to augment the visualization by permitting a user to visually concentrate on one field, while listening to the other. Two of the three scalar fields from the simulation are selected for interpretation and visualized. The 3-dimensional vector gradient of one of them is sonified at a selected focal point within the semiconductor solid. As the current focus is interactively moved through the solid, the representative sound is altered accordingly. The Bonification is composed such that local minima and maxima of one of the fields can be found without looking at it.