60 likes | 204 Views
This project by Pearce Merritt demonstrates the captivating world of data sonification, turning complex vector fields into auditory experiences. By mapping data domains to audio, we allow users to hear patterns and insights hidden within the data. Utilizing techniques like streamlines as "vinyl record grooves," we create an interactive environment where a rake moves through the sound space, similar to a needle on a record. With tools like the open-source Synthesis Toolkit (STK), users can explore sound mapping and editing, overcoming threading challenges to provide a seamless auditory experience.
E N D
Sonification of Vector Fields By Pearce Merritt
Sonification • Turning data into something we can hear • Mapping from data domain to audio domain
Streamlines as “vinyl record grooves” • Use rake to create streamlines • Like grooves • Animate cursor from rake • Like needle • Sonify data in “grooves” under “needle”
Progress • Data parsing: prog1 other dimensions • Streamline Class and Rake Class • Time dependent execution (for cursor) • Sound Library • Synthesis ToolKit (STK): open-source C++ library • Reading docs, playing with examples
To Do • Sound integration • Tricky threading issues • Controls • Rake movement and freedom of exploration • Sound controls • Hopefully implement simple sound map editor