New Interaction Techniques

1. New Interaction Techniques Data Input through Friction and Vibration Data Input through Friction and Vibration Grigori Evreinov Department of Computer SciencesUniversity of Tampere, Finland Department of Computer SciencesUniversity of Tampere, Finland www.cs.uta.fi/~grse September – December, 2003

2. http://www.gkos.net/ Fossil Wrist PDA with Palm OS http://www.fossil.com/ Smartquill of British Telecom http://oud.refdag.nl/weet/981013weetfo07.html http://www.spbsoftwarehouse.com/products/fsk/ data input through friction & vibration • how many buttons do you need???? TAUCHI MMIG G. Evreinov p 01_23 11.11.2003

3. Samsung Scurry wearable keyboardhttp://www.futurelooks.com data input through friction & vibration Body Coupled FingeRing: Wireless Wearable Keyboard [Fukumoto & Tonomura, CHI’97] TAUCHI MMIG G. Evreinov p 02_23 11.11.2003

4. www.n-scribe.com/ data input through friction & vibration VPenTM http://www.otmtech.com/vpen3.asp SmartQuill http://www.neoambiental.com.br/html/terceiromilenio/html/texto_terc_tecnologia04.htm XWpenhttp://www.research.microsoft.com/users/lyn/ ANOTO penhttp://www.anoto.com TAUCHI MMIG G. Evreinov p 03_23 11.11.2003

5. data input through friction & vibration • ANOTO Pen • the digital pen writes on ordinary paper printed with a special pattern that is almost invisible to the naked eye • the dots have a nominal spacing of 0.3 mm (0.01 inch) • a minute portion of the total pattern uniquely defines its position in the full pattern http://www.anotofunctionality.com/navigate.asp TAUCHI MMIG G. Evreinov p 04_23 11.11.2003

6. data input through friction & vibration • Optical Translation Measurement OTM™ • OTM™ sensor measures the relative motion of surfaces placed adjacent to its aperture • it includes a laser diode, detectors and optics integrated into a small transistor-style package • the grating reflected beam serves as a local oscillator, which interferes with the reflected surface light for coherent homodyne detection by the detector chessboard grating relief profile of the chessboard grating http://www.otmtech.com/otm.asp TAUCHI MMIG G. Evreinov p 05_23 11.11.2003

7. data input through friction & vibration InkLinkTM binaural technology the InkLink™ Data Clip continuously listens for communications from the InkLink pen while it tracks the natural movement of the hand http://www.jdjstore.com/jdjstore/inhansys.html TAUCHI MMIG G. Evreinov p 06_23 11.11.2003

8. data input through friction & vibration a pair of ear-microphones output signals were examined to detect the side of teeth-chattering, right or left [Hashimoto, Yonezawa and Itoh, 5th Int. Conf. ICCHP’96] TAUCHI MMIG G. Evreinov p 07_23 11.11.2003

9. I I discrete textured input as a prototype of command mode for menu pointing task continuous variable textures with definite decrement of roughness homogenous texture with definite angle of ribs data input through friction & vibration TAUCHI MMIG G. Evreinov p 08_23 11.11.2003

10. data input through friction & vibration • potential of diverse effects depends on pressuring force and speed of relative motion between end effector and surface • when the size of the end of the pen is commensurable to the ribs, increasing applied force will increase the magnitude of recorded roughness • if vibratory signals take place during fingers manipulations along of texture they can be recorded through piezoelectric transducer TAUCHI MMIG G. Evreinov p 09_23 11.11.2003

11. data input through friction & vibration ScrollStrip http://www.synaptics.com/products/index.cfm • diverse textures can produce different sound patterns by strengthening primary feedback during finger manipulation along of textured surfaces • these signals and their combinations could be used to input commands or add new functions to keyboard, mouse, joystick or another controls • texture recognition has various interesting applications which include both medical and more autonomous mobile robotics TAUCHI MMIG G. Evreinov p 10_23 11.11.2003

12. data input through friction & vibration 18 common materials were explored through a sensing “finger” with an piezoelectric microphone, covered by a rugged material a system for tactile texture detection achieved more than 93% of recognition Mayol-Cuevas et al, 1998 Mayol-Cuevas, W.W., Juárez-Guerrero, J. & Muñoz-Gutiérrez, S. The first approach to tactile texture recognition http://ganso5.fi-b.unam.mx/ligasdoc/TCTSMC98.PS.gz TAUCHI MMIG G. Evreinov p 11_23 11.11.2003

13. data input through friction & vibration x.wav input device and the experimental setup TAUCHI MMIG G. Evreinov p 12_23 11.11.2003

14. data input through friction & vibration spectrums of vibration patterns during a linear motion across four textures TAUCHI MMIG G. Evreinov p 13_23 11.11.2003

15. data input through friction & vibration • segmented textured layout (modulator) and miniature microphone (M294) performed spatial-temporal coding of pen position • Unistroke and Graffiti alphabet characters were used to simulate gestures with definite structure (uninterrupted hand motion) • the goal of our experiment was to evaluate spatial-temporary segmentation of vibration patterns formed by handwriting TAUCHI MMIG G. Evreinov p 14_23 11.11.2003

16. A B C D E F G H I J K L M Unistroke adapted combined continuous N O P Q R S T U V W X Y Z Unistroke adapted combined continuous data input through friction & vibration TAUCHI MMIG G. Evreinov p 15_23 11.11.2003

17. . . . . . . data input through friction & vibration vibratory patterns of the adapted unistrokes and combined continuous gestures (B, G, W) TAUCHI MMIG G. Evreinov p 16_23 11.11.2003

18. data input through friction & vibration • diverse textures were assembled and explored to shape vibration patterns when pen rubs over textured layout • 52 sound patterns during input of continuous gestures coding the characters of English alphabet were registered and had a recognizable structure • spectral averaging over the frequency range was found to be effective tools for segmentation of vibration patterns received on the textured layout • the proposed method has a potential for development new interaction techniques for wearable computers TAUCHI MMIG G. Evreinov p 17_23 11.11.2003

19. data input through friction & vibration SoundPen h.wav TAUCHI MMIG G. Evreinov p 18_23 11.11.2003

20. Freq.V d Freq.N  Freq.H data input through friction & vibration assume, Freq.N = 400 Hz, then at average speed of the pen motion Vf = 25 mm/s d = Vf / Freq.N , i.e., d = 0.06 mm if  = 65 then dV = dN / cos  dV = 0.14 mm dH = dN / sin  dH = 0.066 mm correspondingly Freq.V 180 Hz Freq.H 380 Hz thus, if we shall provide texture with given polarization, vibratory patterns will have recognizable structure TAUCHI MMIG G. Evreinov p 19_23 11.11.2003

21. b.wav a.wav d.wav f.wav h.wav o.wav data input through friction & vibration vibratory patterns of the characters TAUCHI MMIG G. Evreinov p 20_23 11.11.2003

22. data input through friction & vibration • western script has several handwriting styles for elementary school-aged children • loops and other groups can provide systematic steps for letter analysis and are often used for learning of the recognition system • for designing of diverse gestures, we have selected seven segments, which are most often used in handwriting sheets for learning to write characters in cursive TAUCHI MMIG G. Evreinov p 21_23 11.11.2003

23. _.wav _.wav _.wav _.wav _.wav _.wav _.wav data input through friction & vibration vibratory patterns of handwriting elements for cursive performance TAUCHI MMIG G. Evreinov p 22_23 11.11.2003

24. data input through friction & vibration • the ribbed polarized textures similar to the diffraction grid were proposed and explored to shape sound patterns when pen rubs over these surfaces • while the size of the end of the pen was commensurable to the ribs, sound patterns during input of handwriting characters were registered and had recognizable structure • the vertical and horizontal components of the vibration frequency had difference in two times • this method was not intended for text entry, but has a potential for human-computer interaction through special gestures along textured surface TAUCHI MMIG G. Evreinov p 23_23 11.11.2003

25. data input through friction & vibration TAUCHI MMIG G. Evreinov p 00_00 11.11.2003