1 / 5

Summary Discussion on Computational Audition

Summary Discussion on Computational Audition. Led by DeLiang Wang. A Comparison between Vision and Audition. Auditory features: Frequency, spectrum Pitch Location Onset/offset Motion (Doppler effect) Texture? AM/FM Rhythm, duration. Visual features: Color/luminance Orientation

Download Presentation

Summary Discussion on Computational Audition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Summary Discussion on Computational Audition Led by DeLiang Wang

  2. A Comparison between Vision and Audition • Auditory features: • Frequency, spectrum • Pitch • Location • Onset/offset • Motion (Doppler effect) • Texture? • AM/FM • Rhythm, duration • Visual features: • Color/luminance • Orientation • Location • Depth • Motion • Texture • Size and shape

  3. A Feature Integration Theory for ASA? • Adapted from Treisman’86

  4. 10 Big Problems in Computational Audition? • Modeling and classification of natural sound sources • Emphasis on non-speech, non-music environmental sounds • Target detection in auditory scenes • Monaural segregation of unvoiced speech • Multicue integration for auditory scene analysis • Double-integration problem • Neural substrate of auditory scene analysis • Sound localization and location-based source segregation • With two sensors • Rapid adaptation to acoustic environment • Echo and reverberation • Sound motion analysis (Demo: ) • Sound texture analysis ( ) • Event tracking/prediction • Rhythm • Sequential pattern analysis • Role of attention

  5. Computational Audition • A field of study, like computational vision?

More Related