1 / 1

Tablet-Based Gaze Tracker

P13541 2012-2/ 2012-3. Tablet-Based Gaze Tracker. Susan Farnand (Sponso r). Les Moore (Faculty Guide). Matt Kelly (CE). Michael Krenzer (EE). Hemsley Pichardo (EE). Tina Podrasky (ISE). Brad Wideman (CE). MISSION STATEMENT:

jed
Download Presentation

Tablet-Based Gaze Tracker

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. P13541 2012-2/ 2012-3 Tablet-Based Gaze Tracker Susan Farnand (Sponsor) Les Moore (Faculty Guide) Matt Kelly (CE) Michael Krenzer (EE) Hemsley Pichardo (EE) Tina Podrasky (ISE) Brad Wideman (CE) • MISSION STATEMENT: • TO DESIGN AND MANUFACTURE A TABLET-BASED GAZE TRACKER THAT USES A MODIFIED WEB CAMERA TO DETERMINE WHERE THE USER IS LOOKING IN RESPECT TO A SECONDARY VIDEO BEING RECORDED BY THE TABLET’S BUILT-IN REAR CAMERA. • MOTIVATION: • TEACHING TOOL FOR NOVICE PHOTOGRAPHERS • ALLOWS FOR THE GREATEST LEVEL OF PORTABLITY CURRENTLY AVAILABLE • BACKGROUND: • CURRENTLY EXISTING GAZE TRACKERS • REMOTE GAZE TRACKER- ATTACHES TO A DESKTOP COMPUTER –NOT PORTABLE • EYEGLASSES WITH INTEGRATED CAMERAS- REQUIRES THE USER TO WEAR A LAPTOP BACKPACK- SEMI PORTABLE • ADDITIONAL INFORMATION: • FOR ADDITIONAL INFORMATION VISIT OUR TEAM WEBSITE AT http://edge.rit.edu/edge/P13541/public/Home • DESIGN PROCESS: • SAFE AND PORTABLE DEVICE THAT OPERATES IN REAL-TIME • UTILIZES TWO CAMERAS: ONE TO CAPTURE THE USER’S EYE ANOTHER TO CAPTURE THE USERS SUBJECT MATTER • PROVIDES VISUAL FEEDBACK THAT OVERLAIYS THE USER’S GAZE POINTS WITH THE IMAGE ON THE TABLET’S DISPLAY • DESIGN SPECIFICATIONS: • ALL COMPONENTS MUST RUN OFF THE TABLET’S INTERNAL BATTERYAND LAST FOR 30 MINUTES BEFORE RECHARGING • TABLET MUST HAVE A REAR-FACING CAMERA AND RUN ANDROID • TABLET MUST HAVE A USB PORT FOR INTERFACING WITH THE CAMERA • THE DEVICE MUST OPERATE SUCCESSFULLY INDOORS AND OUTDOOES • THE SOFTWARE ON THE TABLET MUST NOT HAVE RESTRICTIONS ON MODIFICATION THAT CANNOT BE BYPASSED • INFRARED LED CIRCUIT: • USED TO CREATE THE GLINTS REQUIRED FOR GAZE TRACKING • 6 IR LEDS IN TWO CLUSTERS • 2 RESISTORS 150Ω AND 22Ω • TWO PCB BOARDS ON EITHER END OF THE TABLET • OSRAM SFH-4550 LEDS • LEDs SANDED TO DIFFUSE INFRARED LIGHT • MODIFICATION OF WEBCAM: • ORIGINAL CAMERA IS THE LOGITECH C510 • CAMERA’S IR FILTER WAS REMOVED • REPLACEMENT FILTER MADE FROM FILM NEGATIVES WAS PLACED ABOVE THE IMAGE SENSOR DISASSEMBLED CAMERA WITH REPLACEMENT FILTER • MOUNT AND CASE DESIGN: • ABS PLASTIC CASE – USED TO MOUNT CAMERA AND IR LEDS • CLEAR PLASTIC COVERS – ALLOWS IR LIGHT TO REFLECT OFF THE USERS EYE WHILE PROTECTING THE CAMERA’S LENS • MOUNT MADE OUT OF GOPRO CAMERA PARTS • CONNECTOR MADE OF ALUMINUM ALLOY – SIMILAR DESIGN TO EXISTING GOPRO CONNECTOR • CAMERA FOCUSING: • CAMERA WAS FOCUSED USING THE ISO12233 CHART TESTING CAMERA FOCUS • TEST RESULTS FOR USABILITY: • 15 SUBJECTS RUN FOUR RANDOMIZED CALIBRATION ROUTINE • THE SUBJECT FOLLOW A SINGLE DOT TO FIVE DIFFERENT LOCATIONS ON THE SCREEN • TWO DIFFERENT CALIBRATION VARIABLES - FAST OR SLOW AND WITH OR WITHOUT DIRECTION • FAST WITH DIRECTION WAS DETERMINED TO BE THE MOST ACCURATE ROUTINE • IMAGES USED FOR DEBUGGING: • PUPIL IS FOUND BY ALGORITHM AND CIRCLED • PUPIL CENTER IS CROSSED • CORNEAL REFLECTION CANDIDATES ARE FOUND AND CROSSED • COMBINATION OF PUPIL CENTER AND CONREAL REFLECTIONS USED TO DETERMINE GAZE POINT DEBUGGING IMAGES TAKEN WITH GAZE TRACKER MAIN EFFECT AND RESIDUAL PLOTS FOR SPEED AND DIRECTION SUBJECT USING THE CALIBRATION ROUTINE • RESULTS/ CONCLUSIONS: • MANY CUSTOMER NEEDS WERE MET, BUT GAZE TRACKING SHOULD BE MORE ROBUST • GAZE TRACKING IS DIFFICULT TO ACCURATELY IMPLEMENT, BUT EXTREMELY USEFUL • HUGE IMPLICATIONS FOR RESEARCH AND ACCESSIBIILITY PURPOSES • A POWERFUL AND PORTABLE OPEN-SOURCE GAZE TRACKING LIBRARY IS HIGHLY DESIRABLE ACKNOWLEDGEMENTS: SPECIAL THANKS TO: • ADRIANA BECKER-GOMEZ • FRANK COST • KEVIN ENCARNACION • CHRIS FEUZ • DAVID HATHAWAY • BO HU • JAN MANETI • JEFFERY PELZ • FLURIN RINDISBACHER • ANDREW SHUMAN

More Related