PROJECT PARTNERS Database Research Group Department of Computer Science UNIVERSITY OF ROSTOCK Musicologists Institute for Musicology UNIVERSITY OF ROSTOCK Image Processing Fraunhofer Institute for Computer Graphics Rostock
PROBLEMS IN MUSICOLOGY How to preserve historical material, and associate and manage corresponding knowledge? There exist multiple collections of historical manuscripts all over the world. One of them is the 18th century music scores collection at the University of Rostock.
PROBLEMS IN MUSICOLOGY Who was the writer of a music score? ... What relation did he have to the composer? What is the paper made of? Who was the owner, user and collector of the copy? „Each music writer has a typical and unique handwriting signature, which can be defined on a set of a „few“ handwriting characteristics.
COMPUTER SCIENCE SOLUTIONS A digital archive for storing handwritten historical music scores and their corresponding metadata Browsing and retrieval interfaces for musicologists, librarians and other library users Integrating experts knowledge for semi-automatic analysis of handwritings Image processing tools for automatic analysis of handwriting in music scores
WRITER IDENTIFICATION Music Score Feature Base Handwriting Classification Feature -Extraction Result from the Classification Handwriting Clusters Feature Vectors Handwriting Clustering empirical optimization
HANDWRITING FEATURES • Clef • Slant • Note Stems • Note Flags • Note Beams • Accidentals • Rastrum • Note Head Form • Time Signatures • Bar Lines • Writing Habits • Note Beams Offset • Rests
SEMI-AUTOMATIC HANDWRITING ANALYSIS ...1.2.2 closed loop ...188.8.131.52 ...184.108.40.206 acsending or descending ...220.127.116.11.7 ...18.104.22.168.3 ...22.214.171.124.5 left or right of G-point or loop clusters of scribes similarity matrix ... 126.96.36.199.7 ... 188.8.131.52 0.6 ... 184.108.40.206 0.2 ... 220.127.116.11.3 0.8 ... 18.104.22.168.5 0.4
AUTOMATIC HANDWRITING ANALYSIS Query Image Smoothing, histogram equalization, morphological operations Consistency Check Image Preprocessing Score Images Writer Identification (unknown writer) Consistency Check Segmentation Image Analysis Feature Extraction and indexing for known writers Recognize Music Symbols of interest Object Recognition Feature Vectors Pattern Matching, Classification Writer Identification Query Result