slide1
Download
Skip this Video
Download Presentation
Project 3

Loading in 2 Seconds...

play fullscreen
1 / 25

Project 3 - PowerPoint PPT Presentation


  • 286 Views
  • Uploaded on

first used for music. Biologically-driven musical instrument ... allows musician to act on the sound like in a traditional musical instrument ...

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Project 3' - Kelvin_Ajay


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

eNTERFACE 2005

Project 3 :Biologically-driven Musical Instrument

Quentin Noirhomme - Jean-Julien Filatriau

Communication and Remote Sensing Lab.

Université catholique de Louvain

July 18th 2005

slide2

Mapping

ElectroEncephalogram

Sound

Synthesis

EKG

EMG

Biologically-driven musical instrument

Objectives

Analysis

July 18th 2005

slide3

Biologically-driven musical instrument

EEG: Origin

Brain Facts

July 18th 2005

slide4

Biologically-driven musical instrument

EEG Recording

DTI cap

July 18th 2005

slide6

Biologically-driven musical instrument

EEG

  • Noise
  • Background activities
  • Activities with partial control
    • used for Brain Computer Interface
    • Training possible

July 18th 2005

slide7

Biologically-driven musical instrument

EEG: Rhythms

  • Alpha
    • 8-13 Hz
    • first discovered
    • first used for music

July 18th 2005

slide8

Biologically-driven musical instrument

EEG: Rhythms

  • Alpha
  • Delta
    • 0.1-3.5 Hz
  • Theta
    • 4-7.5 Hz

July 18th 2005

slide9

Biologically-driven musical instrument

EEG: Rhythms

  • Alpha
  • Delta
  • Theta
  • Mu
    • 8-12 Hz
  • Beta
    • 14-30 Hz

July 18th 2005

slide10

Biologically-driven musical instrument

Mu and Beta rhythms

Wolpaw et al., 2002

July 18th 2005

slide11

Biologically-driven musical instrument

Event Related Potentials

July 18th 2005

slide13

Biologically-driven musical instrument

ElectroCardioGram

July 18th 2005

slide14

Biologically-driven musical instrument

ElectroMyoGram

July 18th 2005

slide15

ElectroEncephalogram

Sound

Synthesis

EKG

EMG

Biologically-driven musical instrument

Objectives

Mapping

Analysis

July 18th 2005

slide16

Biologically-driven musical instrument

EEG Analysis

  • Frequency Analysis
    • Fourier, auto-regressive modelling
    • Wavelets
  • Event detection
  • Localization
  • Hjort Analysis

July 18th 2005

slide17

ElectroEncephalogram

Sound

Synthesis

EKG

EMG

Biologically-driven musical instrument

Objectives

Mapping

Analysis

July 18th 2005

slide18

ElectroEncephalogram

Sound

Synthesis

EKG

EMG

Biologically-driven musical instrument

Objectives

Mapping

Analysis

July 18th 2005

slide19

Biologically-driven musical instrument

Sound synthesis

  • Sound synthesis
    • = creation of a sound signal from specific algorithms implemented on a computer.
    • = synthesis parameters that influence sound characteristics (pitch, spectral content, timbre...)
    • = ex : additive synthesis, soustractive synthesis, FM synthesis, waveshaping synthesis...
  • Ex : Frequency modulation synthesis
  • y(t) = A sin[ωC t + I sin(ωM t ) ]

Synthesis parameters

July 18th 2005

slide20

Gesture transducer

Mapping

Synthesis model

Synthesis parameters

Sound

Gesture data

Gesture

Biologically-driven musical instrument

Digital music instruments

  • Real-time sound synthesis for « live interpretation »- Sound synthesis parameters controlled by player’s gestures => interaction allows musician to act on the sound like in a traditional musical instrument => Mapping = correspondance functions between gestures and synthesis parameters.

July 18th 2005

slide21

Biologically-driven musical instrument

Examples of digital music instruments (from LMA, Marseille)

The photosonic emulator (training)

The Voicer

(in live situation)

July 18th 2005

slide22

Biologically-driven musical instrument

Biologically-driven musical instrument

  • Objective of our project : using infos extracted from EEG/EMG analysis as sound synthesis parameters to drive a digital music instrument.- Two main issues : => synthesis algorithm(s) => adequate « mapping » between EEG/EMG data and sound synthesis parameters.- Previous works in interaction biology/music : => Brouse (2001) : Interharmonium (EEG) => Tanaka (2002) : BioMuse (EMG) => Miranda & Brouse (2005) :BCI-Piano (EEG)

July 18th 2005

slide23

Biologically-driven musical instrument

References

  • Papers :
  • « Brain–computer interfaces for communication and control », Wolpaw & al., 2002
  • « Toward direct Brain-Computer musical interface », Miranda & Brouse, 2005
  • « Musical Performance Practice on Sensor-based Instruments », Tanaka, 2002
  • Web sites :
    • http://www.tele.ucl.ac.be/~noirhom/eNTERFACE3/index.html
    • http://cmr.soc.plymouth.ac.uk/interaction.htm
    • http://www.music.mcgill.ca/~brouse/conversation/

July 18th 2005

slide24

Biologically-driven musical instrument

Team

  • Benoît MACQ - professor (UCL)
  • Jean-Julien FILATRIAU - PhD student (UCL)
  • Quentin NOIRHOMME - PhD student (UCL)
  • Burak ARSLAN - invited professor (TCTS, Mons)
  • Rolando BONAL CACERES - professor (La Havane, Cuba)
  • Andrew BROUSE - PhD student (University of Plymouth)
  • Julien CASTET - future PhD student (ACROE, Grenoble)
  • Rémy LEHEMBRE - future PhD student (UCL)
  • Cédric SIMON - future PhD student (UCL)

July 18th 2005

ad