1 / 25

Blind Assistive Technology Bill Reading Device (BATBRD) Professor Aura Ganz Ian McAlister

TEAM GANZ Final Project Review. Blind Assistive Technology Bill Reading Device (BATBRD) Professor Aura Ganz Ian McAlister Colin Smith Chris Neyland Erick Drummond. OUTLINE. Motivation Product Requirements Product Design Manufacturing Image Processing Experimental Results

wallis
Download Presentation

Blind Assistive Technology Bill Reading Device (BATBRD) Professor Aura Ganz Ian McAlister

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TEAM GANZ Final Project Review Blind Assistive Technology Bill Reading Device (BATBRD) Professor Aura Ganz Ian McAlister Colin Smith Chris Neyland Erick Drummond

  2. OUTLINE • Motivation • Product Requirements • Product Design • Manufacturing • Image Processing • Experimental Results • Conclusions • SDP Demonstration Day Tasks • Future Enhancements

  3. Motivation • Population • 1.8 million legally blind individuals in the U.S. • 21.2 million reported experiencing vision loss • US Currency Problem • No current identification methods • Current technology is very expensive • Goals • Develop low cost, easy-to-use, portable electronic bill reader for the blind community

  4. Product Requirements • Product Requirements • Low Cost • Intuitive Interface Design – 2 to 3 buttons max • Small Form Factor - <50in3 • Performance - <10 sec, >90% Accuracy • Upgradable Bill Library • Battery Life – One Hour Continuous Use

  5. Final Product Design – Hardware System Block Diagram: Production Model:

  6. Cost list here with total • Costs • Beagleboard: $160 • Enclosure: $14.60 • Microcontroller and Misc Hardware: $15 • PS3 Eye: $35 • Battery/Charger $25 • SD Memory Card: $12 • Total: 246.60

  7. Product Requirements • Product Requirements • Low Cost • Intuitive Interface Design – 2 to 3 buttons max • Small Form Factor - <50in3 • Performance - <10 sec, >90% Accuracy • Upgradable Bill Library • Battery Life – One Hour Continuous Use

  8. Manufacturing of PCB • Custom PCB needed for User Interface • Designed Schematic Using Eagle • Photo Paper used for layout relative to Beagleboard • Top/Bottom layers printed separately on glossy paper • Bottom layer taped to copper board and holes drilled • Top layer mirrored, placed on reverse side, and lined up with holes • Hot iron used to transfer toner to copper board • Paper rinsed in water bath • PCB place in Ferric Chloride bath to dissolve unwanted copper • Toner washed off with acetone and through holes drilled • PCB fit and tested

  9. Product Requirements • Product Requirements • Low Cost • Intuitive Interface Design – 2 to 3 buttons max • Small Form Factor - <50in3 • Performance - <10 sec, >90% Accuracy • Upgradable Bill Library • Battery Life – One Hour Continuous Use

  10. Manufacturing of Project Enclosure • Polycarbonate Case – Best for BATBRD Project • Dimensions in inches • 4.53L X 3.54W X 2.17H = 34.8 in3 • Meets size requirements • Painted for lighting/cosmetic • purposes • Holes drilled for switches and • power connections • Rails installed for user interface

  11. Product Requirements • Product Requirements • Low Cost • Intuitive Interface Design – 2 to 3 buttons max • Small Form Factor - <50in3 • Performance - <10 sec, >90% Accuracy • Upgradable Bill Library • Battery Life – One Hour Continuous Use

  12. Image Processing • Find Best Match by Using Normalized Cross-Correlation Coefficients Function (NCC) • C = Correlation Matrix • I = Captured Image, = Sample Image Mean at location: u,v • T = Template Image, = Template Mean • u,v = Indices at Point of Correlation • Best Match Retrieved by OpenCV Function: cvMinMaxLoc( image, &minval, &maxval, &minloc, &maxloc, 0 ); Where maxval is a number from -1 to +1 corresponding to best match. • This Value Can then Be Used to Determine if There is a Match

  13. Experimental Design • Experiment 1 • Timing/Accuracy with Ideal Images • Experiment 2 • Thresholds with Ideal Images and Second ID • Experiment 3 • Thresholds/Accuracy with degraded images • Experiment 4 • Thresholds/Accuracy with further degraded images • Experiment 5 • Project Enclosure Threshold/Accuracy worst case degraded image.

  14. Experiment 1 – Timing/Accuracy with Ideal Images • Pixel Size • 360 x 240 • Templates under complete • darkness (no backlighting) • Results • Significant time delay • Reduced Accuracy • Thresholds too low • New generation bill • Rail Structure

  15. Exp. 2 – Thresholds with Ideal Images and 2nd ID • Changes from Experiment 1 • Pixels reduced to 160x120 • Templates retaken with • tinted backlighting • Camera moved • Rails more securely fixed • Max Threshold  .85 • Results • Worst case time < 4 seconds • All corners identifying well • Backlighting no longer a • problem

  16. Exp 3 Threshold/Accuracy non-ideal images • 1 Diagonal Stripe added to image capture area to simulated • degraded/damaged bills

  17. Exp. 4 – Continued Bill Degradation Tests • Simulated Degradation • 2 Stripes • 3 Stripes • 4 Stripes

  18. Exp. 5 – Project Enclosure, Non Ideal Images • Maximum Threshold Identification  over 11% wrong identification • Using Greater than .65 for threshold  Zero Wrong IDs • High rescan rate  no incorrect identification

  19. Product Requirements • Product Requirements • Low Cost • Intuitive Interface Design – 2 to 3 buttons max • Small Form Factor - <50in3 • Performance - <10 sec, >90% Accuracy • Upgradable Bill Library • Battery Life – One Hour Continuous Use

  20. Power Usage • Battery Power Supply: • The Battery Provides 7.4V and 2.2Ahr • 7.4V * 2.2A hr = 16.28W hr • BATBRD Power Usage • Beagleboard and supporting hardware operates at 5V and draws 600 – 800mA • The BATBRD draws a maximum of 4W. • We can safely operate the board for at least ~4hrs

  21. Product Requirements - Conclusion • Product Requirements • Low Cost • Intuitive Interface Design – 2 to 3 buttons max • Small Form Factor - <50in3 • Performance - <10 sec, >90% Accuracy • Upgradable Bill Library • Battery Life – One Hour Continuous Use

  22. TBD for SDP Demonstration Day • Work out minor issues with user interface, power-up sequence • Meet with Jenny again: let her use it, get her input • Audio adjustments: improve playback, eliminate ‘pops’ • Possibly remake templates, modify lighting • Continue testing for accuracy as changes are made

  23. Future Outlook • Jenny’s requests • Audio notification of battery life/charging status • Prerecorded audio user’s manual • Physically unique charging plug shape • Beyond SDP 2010 • Tailored processing hardware (FPGA, ASIC) • Application-specific DSP techniques in IP algorithm • Smaller, low-profile imaging device & battery

  24. Questions ?

More Related