music image processing n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Music image processing PowerPoint Presentation
Download Presentation
Music image processing

Loading in 2 Seconds...

play fullscreen
1 / 76

Music image processing - PowerPoint PPT Presentation


  • 118 Views
  • Uploaded on

Music image processing. Tim Bell Department of Computer Science and Software Engineering University of Canterbury, Christchurch, New Zealand. With…. David Bainbridge (Waikato) Richard Lobb Dave Blizzard (Portland, OR) Richard Green John McPherson Karen Lin Annabel Church Simon Glass.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Music image processing' - marcy


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
music image processing

Music image processing

Tim Bell

Department of Computer Science and Software Engineering

University of Canterbury, Christchurch, New Zealand

slide2
With…
  • David Bainbridge (Waikato)
  • Richard Lobb
  • Dave Blizzard (Portland, OR)
  • Richard Green
  • John McPherson
  • Karen Lin
  • Annabel Church
  • Simon Glass
overview
Overview
  • OMR
  • Digital music stand
  • Page turning and image size
  • Fast capture of music
  • Music classification
the vision
The vision...
  • All music available on the web
  • as score, recording and MIDI
  • search by name, composer, lyrics, phrase, similarity, genre, novelty…
  • remunerate those responsible
  • culturally sensitive access
activities with music
Activities with music
  • Composing
  • Arranging
  • Performance
  • Teaching
  • Musicology
  • Recording
  • Accompanying
  • Transcribing...
digital music problems
Digital music problems
  • Cost of hardware and software
  • Viewing music on small screen
  • Loss of inspiration and creativity
  • Loss of efficiency
  • Learning curve
  • Software compatibility
problems with paper
Problems with paper
  • Pen or pencil?
  • Indexed retrieval
slide11

Visual

display

Digital

image

Human

memory

Digital

semantic

Audio

slide12

Visual

display

Digital

image

memorised

oral tradition

original ideas

Human

memory

Digital

semantic

Audio

slide13

Visual

display

Digital

image

Human

memory

live performance

mp3, wav, cd

video?

Digital

semantic

Audio

slide14

Visual

display

Digital

image

sheet music

screen

Human

memory

Digital

semantic

Audio

slide15

Visual

display

Digital

image

sheet music

screen

Human

memory

Digital

semantic

Audio

slide16

Visual

display

Digital

image

sheet music

screen

Human

memory

Digital

semantic

Audio

slide17

Visual

display

Digital

image

sheet music

screen

Human

memory

Digital

semantic

Audio

slide18

Visual

display

Digital

image

sheet music

screen

Human

memory

Digital

semantic

Audio

slide19

Visual

display

Digital

image

D (lick #1) Dmin#5

Look at me now, will I ever learn?

D (lick #2) Dmin#5 G

I don’t know how but I suddenly lose control.

sheet music

screen

Human

memory

Digital

semantic

Audio

slide20

Visual

display

Digital

image

Live performance

Human

memory

Digital

semantic

Audio

slide21

Visual

display

read

Digital

image

Live performance

Human

memory

Digital

semantic

Audio

slide22

Visual

display

Digital

image

Live performance

Human

memory

play

(interpret)

Digital

semantic

Audio

slide23

Visual

display

Digital

image

Transcription

Human

memory

Digital

semantic

Audio

slide24

Visual

display

Digital

image

Transcription

Human

memory

listen

Digital

semantic

Audio

slide25

Visual

display

Digital

image

write

Transcription

Human

memory

Digital

semantic

Audio

slide26

Visual

display

Digital

image

BMP, GIF, JPEG

Human

memory

Digital

semantic

Audio

slide27

Visual

display

Digital

image

scanner,

camera

Human

memory

Digital

semantic

Audio

slide28

Visual

display

Digital

image

print,

display

Human

memory

Digital

semantic

Audio

slide29

Visual

display

Digital

image

Human

memory

MIDI

NIFF

MUSICXML

GUIDO

Digital

semantic

Audio

slide30

Visual

display

Digital

image

Render

(Sibelius, Lime,

Guido, Tex etc.)

Human

memory

Digital

semantic

Audio

slide31

Visual

display

Digital

image

OMR

Human

memory

Digital

semantic

Audio

slide32

Visual

display

Digital

image

Human

memory

Synthesis

(audio rendering)

Digital

semantic

Audio

slide33

Visual

display

Digital

image

Human

memory

Audio analysis

(monophonic,

polyphonic)

Digital

semantic

Audio

slide34

Visual

display

Data entry

Digital

image

Human

memory

Digital

semantic

Audio

slide35

Visual

display

Digital

image

Weak links

Human

memory

Digital

semantic

Audio

slide36

Visual

display

Digital

image

Labour intensive

links

Human

memory

Digital

semantic

Audio

slide37

Visual

display

Digital

image

Human

memory

Digital

semantic

Audio

slide38

Visual

display

Digital

image

QBH

Human

memory

Digital

semantic

Audio

slide40

Visual

display

Digital

image

Compose

Arrange/orchestrate

Rehearse

React

Human

memory

Digital

semantic

Audio

slide41

Visual

display

Digital

image

Library (personal, shared)

Music stand (rehearse, perform)

Human

memory

Digital

semantic

Audio

slide42

Visual

display

Digital

image

Intermediate form

Archive

Human

memory

Digital

semantic

Audio

slide43

Visual

display

Suitable for:

transposition

part splitting

reduction

searching

theme detection

accompaniment

performance following

Digital

image

Human

memory

Digital

semantic

Audio

slide44

Visual

display

Digital

image

listening

recording studio

analysis

thumbnail

backing

Human

memory

Digital

semantic

Audio

wabot 2
Wabot-2
  • 1980-1984
  • Read simple score
  • Heavy processing requirements
staff line removal identification
Staff line removal/identification
  • Horizontal projection
  • Vertical slices
  • Wobble/track
  • Chords
  • Template
piece at an angle
Piece at an angle
  • Rotate until correct
object location
Object location
  • Fragmentation
  • Superimposed
  • Touching objects
identifying objects
Identifying objects
  • Flood fill
  • Template matching
  • Hough transform
constructing musical features
Constructing musical features
  • Grammars
  • Decision tree
  • Rules
musical semantics
Musical semantics
  • Treble clef determines pitches
  • Accidentals change pitch
  • Time signature changes note lengths
commercial systems
Commercial systems
  • Sharpeye
  • Vivaldi
  • Neuratron PhotoScore
  • … and more
is 96 recognition good enough
Is 96% recognition good enough?
  • One mistake in 24 notes
  • No interpretation if playing music
  • Time to set up, train and correct greater than typing?
slide65

Visual

display

Digital

image

Optical music

recognition

in practice!

Human

memory

Digital

semantic

Audio

the gulf of interpretation
The “gulf of interpretation”
  • Classical tempo and dynamics
  • Jazz improvisation
  • Rock style (e.g. syncopation, articulation)
  • Figured bass
  • Cadenzas
  • MIDI vs. Orchestra
slide69

Visual

display

Digital

image

Pen-based music

data entry

Human

memory

Digital

semantic

Audio

coloured staveline removal
Coloured staveline removal
  • Scanned as RGB
  • Convert to HSV and CMYK
  • V indicates colour
  • K indicates pencil, black pen