Information Preservation in Seeing with Sound


« The vOICe Home Page
« The vOICe for Windows
« The vOICe Java applet/application
« The vOICe Java animation samples


Among cars
Walking towards and between two parked cars

As a further technical (not yet perceptual!) verification of information preservation in what we could call ``earsight,'' the following experiment was done using the above image frames. Using The vOICe Java application, 32 kHz 16 bit .wav sound files were written for the individual sonified frames. After that, The vOICe Java application read these sound files for spectrographic reconstruction. In the animation below, you see the original 64 × 64 pixel image frames before (left) and after (right) sonification and reconstruction. An exponentially distributed [500 Hz, 4 kHz] frequency interval for 1.05 second soundscape frames was used in the sonification. This is the default setting for the applet/application. The ``well-tempered'' exponential distribution causes the striped Moiré-like distortion patterns, but the sounds are for auditory perception more pleasing than, say, an equidistant frequency distribution. You can observe that this choice did not degrade resolution too badly.

from animation to sound and back
Original (left) and reconstruction from soundscape (right)

Some MP3 sound samples of a parked car are available from the Blindsight of a Parked Car page.

Copyright © 1996 - 2024 Peter B.L. Meijer