Tailoring tabletop interfaces for musical control
Sponsored Links
This presentation is the property of its rightful owner.
1 / 16

Tailoring Tabletop Interfaces for Musical Control PowerPoint PPT Presentation


  • 41 Views
  • Uploaded on
  • Presentation posted in: General

Trinity College Dublin. Tailoring Tabletop Interfaces for Musical Control. Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland. Tailoring Tabletop Interfaces for Musical Control. Proliferation of multitouch teechnology : Smart phone/ iPod etc.

Download Presentation

Tailoring Tabletop Interfaces for Musical Control

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Trinity College Dublin

Tailoring Tabletop Interfaces for Musical Control

Liam O'Sullivan

Electronic and Electrical Engineering,

Trinity College Dublin, Ireland


Tailoring Tabletop Interfaces for Musical Control

Proliferation of multitouchteechnology:

  • Smart phone/ iPod etc.

  • iPad/ Galaxy tab etc.

  • Microsoft Surface, Diamond Touch etc.

  • Bespoke multitouch tables. Smart phone/ iPod.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Traditional/ acoustic musical instruments:

  • Direct manipulation of the sound producing mechanism -> feedback in multiple modes.

  • Tight input-output coupling -> fast system response.

  • Result: sense of intimate control.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Computer-based interactive music system (IMS):

  • Control of complex musical output, timbre.

  • Interface detached from the sound generator.

  • Disrupts the player's perceived relationship with the system.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Wessel et. al. - design goals for control intimacy:

  • Ease of use/ potential for virtuosity.

  • Highly reactive system.

  • Meaningful interactions.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Related Work:

  • The reacTable: modular synthesis paradigm.

  • SurfaceMusic: traditional instrument interaction metaphors & physical models.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Benefits of camera system for a musical interface:

  • Multitouch input- collaborative & bi-manual play, multiple gesture scales.

  • Simultaneous control of many parameters.

  • Superimposed feedback on control surface.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Weaknesses with regard to intimate musical control:

  • Low temporal resolution/ high latency.

  • Poor strength-of-interaction detection.

  • GUI designs.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Prototype 1:

  • twoHand: relates shapes to sound parameters.

  • Another camera-based system!

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Approach:

  • Examination of all functional stages of an IMS.

  • Sensing, Processing, Feedback.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Acoustic sensing: sampling in 1 KHz range.

Gesture recognition: capturing expressive intent.

Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters.

Virtual objects: qualities mapped to sound synthesis parameters.

Sound synthesis: physical models.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Diffraction and reflection of vibrational waves in plates- difficult to model.

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Abstract graphical controllers based on sound symbolism:

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Pilot user survey of audio-visual mappings:

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Automation of low level processes using fuzzy logic:

Liam O’Sullivan, Trinity College Dublin.


Tailoring Tabletop Interfaces for Musical Control

Thank you!

Talk to me at my poster!

[email protected]

Liam O’Sullivan, Trinity College Dublin.


  • Login