All | 43 Folders | Accessibility | BoingBoing | Books | Computer Related | Family | Films | General | Hacking | Hobbies | Humor | Java | Links | Omni | OpenSolaris | Puzzles and Games

« 6 free GMail account... | Main | Good Presentations »
20040914 Tuesday September 14, 2004

A Sense of Synesthesia

There is a short piece in the October 1997 edition of Scientific American about a virtual reality environment at the San Diego Supercomputer Centre that's been created to help people to get an idea what it's like to have a neurologic condition called synesthesia. To quote the hyperdictionary definition,

this is where a stimulus to one sense triggers another; for instance, if a person tastes chocolate when she sees the color red, or if a person smells lilacs when he hears a dog bark, or if a person sees colors when he feels pain.

As I've mentioned before, I've recently become fascinated where there is an interaction of audio and visual work [1] [2] [3]. This is another variation on that.

It uses a CAVE (Cave Automatic Virtual Environment - a.k.a. VR Theatre Display) which is a nine foot cube, the walls of which are rear-projected video screens.

You are wearing a pair of liquid-crystal-shuttered glasses and a tracking device on top of your head. You are also carrying a little wand as a navigation tool. You are attired with an instrument that measures your chest's movement as you breathe.

All around you there is a weblike image in pastels that have a subtle sheen. When you start breathing, the web moves in and out with your breath.

Now the environment is changed on you. Diamonds and spheres begin swirling around you. Your heartbeat presents itself in a new way, as a spurt of color rather than as a sound (see image above).

This got me googling for around for what else is out there on synthesia and any possible art generated from this disorder. This site does a great job of linking it all together.

One of the most famous popular science books related to this is The Man Who Tasted Shapes.

And finally, some pointers to software if you want to try some of this out yourself. Firstly, here's a link to a collection of some CAVE software environments and this is a link to Synesthesia the Winamp vis plugin that allows you to use Sonique vis plugins. Here's some screenshots.

[]

[]

( Sep 14 2004, 08:26:01 AM PDT ) [Listen] Permalink Comments [2]

Comments:

Another relatively reknowned sci-fi novel that touches on synesthesia is The Stars My Destination by Alfred Bester. The protagonist suffers a massive concussion from an explosion, and begins experiencing this. Bester does some interesting things with drawings of distorted and transformed text to try to get the reader to experience what the character is. Very cool stuff.

Posted by peter on September 14, 2004 at 09:15 AM PDT #

Hi Peter. Ahh, yes. I read that book (published in England as "Tiger Tiger") about 30 years ago. Wonderful indeed. Thanks for joggling my memory.

Posted by Rich Burridge on September 14, 2004 at 02:58 PM PDT #

Post a Comment:

Comments are closed for this entry.