Tailoring tabletop interfaces for musical control
This presentation is the property of its rightful owner.
Sponsored Links
1 / 16

Tailoring Tabletop Interfaces for Musical Control PowerPoint PPT Presentation


  • 34 Views
  • Uploaded on
  • Presentation posted in: General

Trinity College Dublin. Tailoring Tabletop Interfaces for Musical Control. Liam O'Sullivan Electronic and Electrical Engineering, Trinity College Dublin, Ireland. Tailoring Tabletop Interfaces for Musical Control. Proliferation of multitouch teechnology : Smart phone/ iPod etc.

Download Presentation

Tailoring Tabletop Interfaces for Musical Control

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Tailoring tabletop interfaces for musical control

Trinity College Dublin

Tailoring Tabletop Interfaces for Musical Control

Liam O'Sullivan

Electronic and Electrical Engineering,

Trinity College Dublin, Ireland


Tailoring tabletop interfaces for musical control1

Tailoring Tabletop Interfaces for Musical Control

Proliferation of multitouchteechnology:

  • Smart phone/ iPod etc.

  • iPad/ Galaxy tab etc.

  • Microsoft Surface, Diamond Touch etc.

  • Bespoke multitouch tables. Smart phone/ iPod.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control2

Tailoring Tabletop Interfaces for Musical Control

Traditional/ acoustic musical instruments:

  • Direct manipulation of the sound producing mechanism -> feedback in multiple modes.

  • Tight input-output coupling -> fast system response.

  • Result: sense of intimate control.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control3

Tailoring Tabletop Interfaces for Musical Control

Computer-based interactive music system (IMS):

  • Control of complex musical output, timbre.

  • Interface detached from the sound generator.

  • Disrupts the player's perceived relationship with the system.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control4

Tailoring Tabletop Interfaces for Musical Control

Wessel et. al. - design goals for control intimacy:

  • Ease of use/ potential for virtuosity.

  • Highly reactive system.

  • Meaningful interactions.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control5

Tailoring Tabletop Interfaces for Musical Control

Related Work:

  • The reacTable: modular synthesis paradigm.

  • SurfaceMusic: traditional instrument interaction metaphors & physical models.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control6

Tailoring Tabletop Interfaces for Musical Control

Benefits of camera system for a musical interface:

  • Multitouch input- collaborative & bi-manual play, multiple gesture scales.

  • Simultaneous control of many parameters.

  • Superimposed feedback on control surface.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control7

Tailoring Tabletop Interfaces for Musical Control

Weaknesses with regard to intimate musical control:

  • Low temporal resolution/ high latency.

  • Poor strength-of-interaction detection.

  • GUI designs.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control8

Tailoring Tabletop Interfaces for Musical Control

Prototype 1:

  • twoHand: relates shapes to sound parameters.

  • Another camera-based system!

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control9

Tailoring Tabletop Interfaces for Musical Control

Approach:

  • Examination of all functional stages of an IMS.

  • Sensing, Processing, Feedback.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control10

Tailoring Tabletop Interfaces for Musical Control

Acoustic sensing: sampling in 1 KHz range.

Gesture recognition: capturing expressive intent.

Mapping input to output: complex mapping is more engaging, simultaneous control of many parameters.

Virtual objects: qualities mapped to sound synthesis parameters.

Sound synthesis: physical models.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control11

Tailoring Tabletop Interfaces for Musical Control

Diffraction and reflection of vibrational waves in plates- difficult to model.

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control12

Tailoring Tabletop Interfaces for Musical Control

Abstract graphical controllers based on sound symbolism:

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control13

Tailoring Tabletop Interfaces for Musical Control

Pilot user survey of audio-visual mappings:

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control14

Tailoring Tabletop Interfaces for Musical Control

Automation of low level processes using fuzzy logic:

Liam O’Sullivan, Trinity College Dublin.


Tailoring tabletop interfaces for musical control15

Tailoring Tabletop Interfaces for Musical Control

Thank you!

Talk to me at my poster!

[email protected]

Liam O’Sullivan, Trinity College Dublin.


  • Login