1 / 61

Hands-free Mice: what’s available and how to make the “right” choice

Hands-free Mice: what’s available and how to make the “right” choice. Heidi Koester, Ph.D. hhk@kpronline.com Koester Performance Research, Ann Arbor, MI https:// kpronline.com. Overview. Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice

elizabethtucker
Download Presentation

Hands-free Mice: what’s available and how to make the “right” choice

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hands-free Mice: what’s available and how to make the “right” choice Heidi Koester, Ph.D. hhk@kpronline.com Koester Performance Research, Ann Arbor, MI https://kpronline.com

  2. Overview Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice Feature-matching process Data collection tools for evidence-based choice

  3. What is a hands-free mouse? • Allows full control of mouse functions without use of the hands • Can be used to access computer (Windows, Mac, etc.), as well as tablet or smartphone (Android, iOS) • Primary user is someone with motor impairments • Cervical spinal cord injury • Cerebral palsy • Neuromuscular disease

  4. What is a hands-free mouse? Often (but not always) controlled using the head Mouth, lips, speech, eyegaze, feet, etc. are other possibilities.

  5. A sampling of hands-free mice Lip/chin joysticks Target trackers Speech recognition Wearable sensors Eye trackers Face trackers

  6. Some other mouse methods Switch control Mouthstick stylus MouseKeys

  7. Considerations for choosing a hands-free mouse https://kpronline.com/blog/13-considerations-for-choosing-a-hands-free-mouse • Key things to think about before making a choice • Relative importance depends on specific needs • But a good starting point for making a well-reasoned decision • Considerations about the HFM itself (How it works) • Considerations of user requirements (What the user needs)

  8. Considerations: cursor control • Exactly what you need to do to move the mouse cursor around the screen • Direct control: • Your body movements translate directly into cursor movements • Indirect control: • Hone in on desired location with a series of commands • Speech recognition • Point mode for Switch Control

  9. Considerations: cursor control • Indirect control: • Mouse Grid for speech • Show Numbers for speech • Point mode for Switch Control • 4 switch hits • https://www.youtube.com/watch?v=DRUg2UqGVNc

  10. Considerations: indirect cursor control “Show numbers”, “Choose 12”

  11. Considerations: indirect cursor control

  12. Considerations: indirect cursor control

  13. Considerations: mouse buttons • Activating mouse buttons • left-click, right-click, double-click • drag • scroll • Switches (external or built-in) • Dwell • Button palette

  14. Considerations: required components • Hardware • Sensor unit? • Wireless receiver? • Switches? • Mounting system? • Software • Special drivers? • Button palette software? • Built-in to OS?

  15. Considerations: wired or wireless? • Wired-to-you (tethered) • Cable “tying” you to the workstation • Roll-up-and-use

  16. Considerations: wearable required? • Target trackers often require a small wearable • Small reflective dot • Wearable sensors have headsets • Speech recognition might require a headset • For best accuracy • (This also makes it tethered, unless you use a wireless mic)

  17. Considerations: something close to face? • Mouth or chin joysticks usually are • Wearable sensors may be • Usually unobstructed: • Eye or face trackers • Speech recognition

  18. Considerations: mounting? Mouth or chin joysticks usually need mounting Target and eye tracker units often do Does the system come with a good mounting solution already? Will it satisfy needs in your setting?

  19. Considerations: compatibility Will it work on the platform(s) you use? Windows, Mac OS, iOS, Android

  20. Considerations for choosing a hands-free mouse • Key things to think about before making a choice • Relative importance depends on specific needs • But a good starting point for making a well-reasoned decision • Considerations about the HFM itself (How it works) • Considerations of user requirements (What the user needs)

  21. Considerations: tasks What are the main tasks that you use the mouse for? Clicking buttons, links only? Running the desktop? (drag, resize) Text entry (on-screen keyboard) Presentations, images, drawing (nudging, cropping, fine adjustments) Consider combining strengths of different mouse solutions to meet your needs

  22. Considerations: need 100% independent use? How important is to be able to use your computer/device with no help from anyone else? If very important or necessary, pay close attention to considerations for wearables, mounting, and connection

  23. Considerations: portability/transferability Do you need to use the system on multiple computers/devices? If software is required, can you install it on all your devices? (feasibility and $)

  24. Considerations: robustness How “touchy” is this system? Positioning Environment Maintenance

  25. Considerations: cognitive load • How much learning and thinking is required to start using this system? • To get good at using it?

  26. Overview Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice Feature-matching process Data collection tools for evidence-based choice

  27. Questions at this point?

  28. 6 families of hands-free mice Lip/chin joysticks Target trackers Speech recognition Wearable sensors Eye trackers Face trackers https://kpronline.com/blog/your-guide-to-25-hands-free-mice

  29. Details for each family: https://kpronline.com/blog/wp-content/uploads/2018/11/KPR-hands-free-mice-family-features.pdf

  30. Lip/chin joysticks • Mouse button activation • Built-in sip/puff (IntegraMouse, Jouse3, QuadJoy) • Built-in switch pads (BJOY Chin) • Second joystick (TetraMouse) • Price range:$449 (TetraMouse) to $2496 (IntegraMouse)

  31. Detailed considerations for each device: https://kpronline.com/blog/wp-content/uploads/2018/11/KPR-25-hands-free-mice-features.pdf

  32. Wearable sensors • Mouse button activation • GlassOuse includes jack for 1 switch. All else a la carte. • Zono includes all button options (palette, 2 jacks, dwell) • GlassOuse: Bluetooth. Zono: USB • Prices: $499 (Glassouse) $999 (Zono)

  33. Detailed considerations for each device: https://kpronline.com/blog/wp-content/uploads/2018/11/KPR-25-hands-free-mice-features.pdf

  34. Wearable target trackers • Mouse button activation • Button palette, dwell not included (HeadMouse, TrackerPro) • Wireless receiver for switches (HeadMouse) • Prices: $990 (HeadMouse, TrackerPro)

  35. Webcam face trackers Open Sesame • Possibility of a free solution? • “Tied” to face, which not everyone likes • Resolution, responsiveness may be an issue • Windows only, except Open Sesame (Win + Android)

  36. Eye trackers • Windows 10 Eye Control is intriguing

  37. Speech recognition • Mac OS and iOS due for major upgrade in speech recognition • Price range: $0 (built-in) to $150-300 (Dragon)

  38. Overview Intro + considerations when choosing a hands-free mouse Current landscape of available hands-free mice Feature-matching process Data collection tools for evidence-based choice

  39. Questions at this point?

  40. Feature matching • Find candidate devices that seem likely to meet your needs • Do this before trialing any devices • Identify your requirements (needed features) • Use HAAT model for overall considerations of your abilities/needs, context/setting, activities/tasks • Use the 13 considerations for specific hands-free mouse considerations • Prioritize your requirements • Match needed features to available features

  41. Resources for identifying needs wati.org educationtechpoints.org SETT framework HAAT model

  42. Meet “Adam” High school student with quadriplegia (C4-5 SCI) Head/neck movements are fairly strong Hand/arm movements very limited – can activate a light touch switch with back of right hand Speech, vision, cognition are all unaffected Grade-appropriate schoolwork, plans on college

  43. Adam’s main needs and current setup • Mouse control and text entry for Windows • Also has Android phone and tablet • Use browser-based software • Home: uses Dragon NaturallySpeaking for dictating text and some mouse commands. HeadMouse tracker (when set up) for remaining mouse control • School: DNS not ideal in most classroom situations. Trying HeadMouse + dwell for mouse control and for text entry with on-screen keyboard. • HeadMouse working OK but is there something better?

  44. Primary questions to address HeadMouse working OK but is there something better, especially for school? Is Dragon OK as the main solution at home, or should he have another mouse solution readily available?

  45. Adam’s feature list Cursor control: direct. Head control probably best but all options possible (lip/chin, face, speech, eye) Mouse buttons: built-in switches, but dwell ok if needed Components/connections: The fewer, the better. Will be set up at start of each class. Prefer not to be tethered. Wearable-free: Would rather don a headset for class than wear a dot on forehead Away from face: preferred Mounting: prefer to have none Compatibility: Needs to be available for Windows & Android, with options for additional platforms.

  46. Adam’s feature list Tasks: typing with on-screen keyboard. Regular mouse control + precise control for drawing, presentations 100% independent use: not strictly needed in school but good as a goal Portability/transferability: has own laptop, so needs to be portable but not necessarily transferable. (Secondary consideration is having a solution for school computers when laptop not convenient or available) Robustness: Easy to setup & position. Works in all lighting conditions. Speech not usually best option in classrooms. Needs to be pretty tough, transportable Cognitive load: prefer typical mouse paradigm but cognition not a concern

  47. Feature-match at the family level Can we eliminate any families at this point? Lip/chin joysticks: for school, not a good fit due to mounting, components, and setup. (Might be a great option for home, however.) Eye trackers: less direct and precise cursor control Speech: not a good fit for school Consider wearable sensors, target trackers, and face trackers

  48. Feature-match at the device level Narrow down to devices in each family Feature-matching table to identify any unsuitable devices Use checklist, spreadsheet, etc. to compare Adam’s feature list to the features available in each hands-free mouse option

  49. Feature-match at the device level Example spreadsheet

  50. Adam’s candidate devices After feature-matching each family: Wearable sensors: GlassOuse, QuhaZono Target trackers: HeadMouse Nano, Tracker Pro Face trackers: several Windows options

More Related