Tailoring tabletop interfaces for musical control
Download
1 / 16

Tailoring Tabletop Interfaces for Musical Control - PowerPoint PPT Presentation


  • 72 Views
  • Uploaded on

Trinity College Dublin. Tailoring Tabletop Interfaces for Musical Control. Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland. Tailoring Tabletop Interfaces for Musical Control. Proliferation of multitouch teechnology : Smart phone/ iPod etc.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Tailoring Tabletop Interfaces for Musical Control' - anoush


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Tailoring tabletop interfaces for musical control

Trinity College Dublin

Tailoring Tabletop Interfaces for Musical Control

Liam O'Sullivan

Electronic and Electrical Engineering,

Trinity College Dublin, Ireland


Tailoring tabletop interfaces for musical control1
Tailoring Tabletop Interfaces for Musical Control

Proliferation of multitouchteechnology:

  • Smart phone/ iPod etc.

  • iPad/ Galaxy tab etc.

  • Microsoft Surface, Diamond Touch etc.

  • Bespoke multitouch tables. Smart phone/ iPod.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control2
Tailoring Tabletop Interfaces for Musical Control

Traditional/ acoustic musical instruments:

  • Direct manipulation of the sound producing mechanism -> feedback in multiple modes.

  • Tight input-output coupling -> fast system response.

  • Result: sense of intimate control.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control3
Tailoring Tabletop Interfaces for Musical Control

Computer-based interactive music system (IMS):

  • Control of complex musical output, timbre.

  • Interface detached from the sound generator.

  • Disrupts the player's perceived relationship with the system.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control4
Tailoring Tabletop Interfaces for Musical Control

Wessel et. al. - design goals for control intimacy:

  • Ease of use/ potential for virtuosity.

  • Highly reactive system.

  • Meaningful interactions.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control5
Tailoring Tabletop Interfaces for Musical Control

Related Work:

  • The reacTable: modular synthesis paradigm.

  • SurfaceMusic: traditional instrument interaction metaphors & physical models.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control6
Tailoring Tabletop Interfaces for Musical Control

Benefits of camera system for a musical interface:

  • Multitouch input- collaborative & bi-manual play, multiple gesture scales.

  • Simultaneous control of many parameters.

  • Superimposed feedback on control surface.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control7
Tailoring Tabletop Interfaces for Musical Control

Weaknesses with regard to intimate musical control:

  • Low temporal resolution/ high latency.

  • Poor strength-of-interaction detection.

  • GUI designs.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control8
Tailoring Tabletop Interfaces for Musical Control

Prototype 1:

  • twoHand: relates shapes to sound parameters.

  • Another camera-based system!

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control9
Tailoring Tabletop Interfaces for Musical Control

Approach:

  • Examination of all functional stages of an IMS.

  • Sensing, Processing, Feedback.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control10
Tailoring Tabletop Interfaces for Musical Control

Acoustic sensing: sampling in 1 KHz range.

Gesture recognition: capturing expressive intent.

Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters.

Virtual objects: qualities mapped to sound synthesis parameters.

Sound synthesis: physical models.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control11
Tailoring Tabletop Interfaces for Musical Control

Diffraction and reflection of vibrational waves in plates- difficult to model.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control12
Tailoring Tabletop Interfaces for Musical Control

Abstract graphical controllers based on sound symbolism:

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control13
Tailoring Tabletop Interfaces for Musical Control

Pilot user survey of audio-visual mappings:

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control14
Tailoring Tabletop Interfaces for Musical Control

Automation of low level processes using fuzzy logic:

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control15
Tailoring Tabletop Interfaces for Musical Control

Thank you!

Talk to me at my poster!

[email protected]

Liam O’Sullivan, Trinity College Dublin.


ad