Theoretical and Methodological Fundaments of Music Annotation

1. Theoretical and Methodological Fundaments of Music Annotation Frederik.Styns@ugent.be Institute for Psychoacoustics and Electronic Music (IPEM) Dept. Of Musicology University Ghent, Belgium Promotor: Prof. Dr. Marc Leman

2. Presentation overview 1. Problem specification 2. Masters’ thesis research 3. Research perspectives

3. 1. Problem specification • Strong need for annotated music databases, in order to train and develop intelligent MIR systems

4. (Lesaffre, 2003)

5. 1. Problem specification • Strong need for annotated music databases, in order to train and develop intelligent MIR systems • No general methodological framework for music annotation • No general theoretical framework for music annotation

6. 2. Masters’ thesis research • Theoretical research • Methodological research

7. 2. Masters’ thesis research • Theoretical research

8. 2. Masters’ thesis research • Theoretical research • Music annotation = detailed description, via specific methods and techniques, of musical content • Musical content = those parameters & concepts which make people evaluate certain informationstreams as musical entities

9. ? (Lesaffre, et al., 2003)

10. 2. Masters’ thesis research • Theoretical research from an ecological point of view: music is not reducable to low level concepts constant interaction between different abstraction levels

12. 2. Masters’ thesis research • Methodological research

13. 2. Masters’ thesis research • Methodological research Manual low level music annotation for testing and training the MAMI-Melodytranscriber High level music annotation of polyphonic music, through melody imitation

14. 2. Masters’ thesis research • Methodological research Manual low level music annotation for testing and training the MAMI-Melodytranscriber

15. 2. Masters’ thesis research • Methodological research Manual low level music annotation for testing and training the MAMI-Melodytranscriber Annotationtool for Qbv: - Automatic segmentation - Automatic pitchannotation

16. 2. Masters’ thesis research • Methodological research Manual low level music annotation for testing and training the MAMI-Melodytranscriber Annotation method: Praat Annotated queries: vocal queries + instrumental queries

17. 2. Masters’ thesis research • Methodological research Manual low level music annotation for testing and training the MAMI-Melodytranscriber Auditive evaluation(Sonar) Statistical evaluation

20. 2. Masters’ thesis research • Methodological research Manual low level music annotation for testing and training the MAMI-Melodytranscriber Improve performance

21. Results for instrumental queries

22. 2. Masters’ thesis research • Methodological research High level annotation of polyphonic music, through melody imitation

23. 2. Masters’ thesis research • Methodological research High level annotation of polyphonic music, through melody imitation How to extract different melodylines from polyphonic music?

24. 2. Masters’ thesis research • Methodological research High level annotation of polyphonic music, through melody imitation 8 trained singers were asked to imitate main melodylines and bass lines (and other melodylines they considered important) from 10 popular songs

25. 2. Masters’ thesis research • Methodological research High level annotation of polyphonic music, through melody imitation - Good imitations of main melodylines - Good imitations of other relevant melodylines, but no consistency in choosing other relevant melodies - Bad imitations of bass lines

26. 2. Masters’ thesis research • Methodological research High level annotation of polyphonic music, through melody imitation  melody imitations serving as reference material for training MIR systems?

27. 3. Research perspectives • What is musical content? • How to handle this musical content in a MIR context? • How to annotate musical audio and what are possible underlying theories?  developing annotated music databases