1 / 13

Dr. Brian Duffy brd@media.mit

Dr. Brian Duffy brd@media.mit.edu. A Flexible Framework for All. Socially engage each other on an equal footing by encouraging and facilitating minority groups to seamlessly integrate with everyone through universal design and a modular peripherals approach. The Multimodal Approach

gannon-douglas
Download Presentation

Dr. Brian Duffy brd@media.mit

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Dr. Brian Duffy brd@media.mit.edu

  2. A Flexible Framework for All Socially engage each other on an equal footing by encouraging and facilitating minority groups to seamlessly integrate with everyone through universal design and a modular peripherals approach The Multimodal Approach Flexible integration between sensor modalities: Fusion Flexible integration of actuator modalities: Fission

  3. keyboard Typing Handwriting Pushing and clicking Gloved hand gestures Speaking Body movement Head movement Free hand gestures Facial expression Eye movement Hand pressure Muscle activity Body stress levels Brain activity Position / Motion tablet mouse glove Audio microphone Video camera Tactile / Force haptic device EMG Voltage Skin Conductance GSR Neural EEG Multimodal Fusion

  4. Plug′n PLAY Active Chair Flexible Hardware :: Social Interfaces :: Play with Reality :: Robotics Virtual &AugmentedReality

  5. The Active Chair :: Design Air System 3 pneumatic cylinders Variable air speed controllersPressure controllersSolenoid valves Control System USB system using a PIC controller (PIC16F87x) with Serial Communications Interface in full duplex mode (asynchronous) & a USB interface circuit Design Holds the occupant in a minimal-stress posture between the neutral body posture of zero gravitation and a normal posture of relaxation on a flat, level surface (based on NASA experimentation).

  6. The Active Chair :: Control

  7. The Active Chair :: Vicarious Adrenaline OBJECTIVE: the transference of adrenaline-based motor sport experiences to an observer through a complex inter-modal interaction. Can you really know how I feel? … where the OBSERVER becomes the PARTICIPANT

  8. The Active Chair :: Vicarious Adrenaline “I used the term ‘rodeo-chair’. It is embedded in therapeutic connotations that are attached to the medical viewpoint of disability. However, the haptic chair uses a reality that involves a playful atmosphere. This maze allows the mind to be in tune with an exterior force. It can be set in a virtual environment or ultimately in a social context. If the body is paralysed, it does not mean it has to curl up. It needs exercise. The mind is in the driving seat.”JAMES BROSNAN

  9. Immersive Play for All :: TRUST Installed at the KK Women & Children’s Hospital in Singapore in 2005

  10. Social Interfaces :: JoeRobot OBJECTIVE: To develop a robust modular robot for explicit social interaction between a robot and one or more other robots, virtual avatars or humans The ideal is a balance between developing a system that can realistically meet the expectations of the people it interacts with while still embracing its machine-like qualities that make it ultimately useful

  11. Social Interfaces :: JoeRobot Articulation When it moves it comes “alive” Perception Vision: Colour tracking, feature recognition Localisation Biosensors Communication Speech recognition & synthesis Gestures Control Modular code structure Behaviour libraries Vision algorithms Communication protocols Software interfaces (presentation) Embedded systems (e.g. speech)

  12. Play with Reality :: Seamless Worlds Manage how Virtual & Augmented Reality can become a powerful medium in our social play fuse the REALGAME Judicious synthesis between the real & the virtual Seamless integration of realities

  13. Make it real … A strong need to develop flexible modular designs to promote real interaction regardless of abilities, age, or situation. SENSE – FEEL –EXPERIENCE The integration of multi-sensory stimulation creates a highly immersive environment that helps facilitate motor control rehabilitation. “… allows the mind to be in tune with an exterior force.” James Brosnan

More Related