1 / 37

Section 508 Testing

Section 508 Testing. Gettysburg 2009. Presentation Topics. Section 508 Testing Principles Process Development Testing Tools Testing Process Results Reporting Governance Section 508 Training Customs and Border Protection US Citizenship and Immigration Services. Testing Principles.

decker
Download Presentation

Section 508 Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Section 508 Testing Gettysburg 2009

  2. Presentation Topics • Section 508 Testing • Principles • Process Development • Testing Tools • Testing Process • Results Reporting • Governance • Section 508 Training • Customs and Border Protection • US Citizenship and Immigration Services

  3. Testing Principles • 508 standards-based testing, not AT • Software and Web go together • Reliable test results • Document procedures • Easy to use testing tools • Minimize subjective outcomes • Document results • Repeatable by other testers • QA vs. IV&V

  4. Application Testing Development • Automated Testing Tools - none • Manual Testing Tools • Web Accessibility Toolbar (WAT) • JAWS • Object Inspector • Java Ferret • Developed Testing Script (for Windows XP)

  5. Testing Tools Web Accessibility Toolbar • IE plug-in • http://www.paciellogroup.com/resources/wat-ie-about.html

  6. Testing Tools Update JAWS • Assistive Technology, not a testing tool • Inaccurate 508 testing results • Steep learning curve • JAWS scripts seek information • JAWS functionality varies by version • Object Inspector overrules • JAWS compatible ≠ 508 compliant

  7. Object Inspector • Microsoft Active Accessibility (MSAA) • Test Software standards • SW (c) – focusable (state) • SW (d) – identity (name), operation (role), state • SW (f) – text information (value) • SW (l) – form labels (name) • http://www.microsoft.com/downloads/details.aspx?familyid=3755582A-A707-460A-BF21-1373316E13F0&displaylang=en • Java Ferret for JAVA Apps

  8. Object Inspector - Forms

  9. Object Inspector – Grid controls

  10. Object Inspector - Flash

  11. Testing Tools Update Web • WAT • Internet Explorer Software • Object Inspector • Java Ferret • JAWS removed No more JAWS testing?? Yay!

  12. Script 1.0 SW script (12) Web script (16) In order of standards a, b, c, … Not logical Duplicate standards Script 2.0 SW+Web script (14) Rich Web apps Keyboard access Element based Interactive elements Non-text elements Identify SW or Web? Testing Script Update

  13. Testing Script Excerpt • Interactive Elements • Keyboard access • Visual Keyboard focus • Labels for Assistive Technologies • Forms (SW, Web) • Scripts (Web) • Non-Text Elements • Images (SW, Web) • Animation (SW) • Audio or Video files (Web) • Image Maps (Web)

  14. Updated Testing Script

  15. Testing Reports • Report Cover • Application details (URL, COTS, version) • Functions tested (login, search, navigation) • Results (which standards failed) • Report Details • Explain failures and cite examples • Based on Sample Testing • Impact Guide

  16. Impact Guide Report

  17. Impact Guide Report

  18. What to do with Test Results? • Examples of governance activities include • Enterprise architecture reviews • Change control • Ready-to-test review

  19. Multi-agency Implementation • Must train testing personnel • Must ensure testing requirement in acquisition contracts • Must ensure testing results are integrated into governance process

  20. Testing Training • Testing Applications and Websites for Accessibility • Hands-on • Two days • Instructor led • 259 DHS personnel trained • Follow-up support

  21. Recipe for Success • Lifecycle • Standard Testing • Training

  22. Section 508 Testing in CBP • Implemented within the: • Technology Insertion Process • Architecture Alignment and Assessment (AAA) Process

  23. CBP Technology Insertion Process *Recently added to the TI Process (May 2009) • Receive TI Requests (COTS Products) • New Technology or Major Version Upgrade • Section 508 testing completed by CBP Enterprise Testing Team • Section 508 team makes recommendations to CTO’s office • TRC and ARB make final decision

  24. Difficulties Integrating 508 Testing • Adequate Buy in from Upper Management • Importance of 508 Testing • Staff/Support for 508 Testing

  25. Educating our Testers • Currently utilizing the CBP Enterprise Testing Team for 508 Testing • All testers are required to take the OAST Testing Applications and Websites for Accessibility training • Continuous assistance from OAST to ensure testing is accurate

  26. Eliminating JAWS • There may be some minor pushback • Some testers appreciate eliminating JAWS since there will be one less step to perform • New testers are not aware of the older method

  27. Benefits for Integrating 508 testing • Importance of 508 is heightened • Consideration of eliminating failed products from the TRM • Projects becoming more aware to include 508 in project implementation

  28. Challenges • Training and awareness of what documentation is necessary for 508 reviews (from product requestors) • Initial 508 results taken lightly • Employee turnover = ensuring new employees are trained and made of aware of section 508 compliance

  29. Measuring Success • Currently - continue to test all product requests • Receiving feedback from requestors and Chief Technology Officer regarding testing results - what should they do? • Future – Continue to educate about Section 508 so testing is seamless throughout all CBP processes.

  30. Educating Industry • In coordination with OAST- developed vendor letter if product chosen is not 508 compliant. • Working with procurement for pushback on vendor if products are not 508 compliant.

  31. Section 508 Testing at USCIS • Section 508 fully integrated into USCIS IT Lifecycle Management (ITLM) • IT Document Library • D&F Form • Market Research Report • Section 508 Test Document • COTS/GOTS Workflow • Custom Development Workflow • Developer testing verified by Independent testers

  32. USCIS Section 508 Test Documents • Introductory Material -- who, what, when, and why • Standard test tools • Roles and responsibilities • How to conduct COTS market research • Test-Specific Scope • 508 product categories • Tasks/pages to be tested • Test tools/methods used with justifications for selection

  33. USCIS Section 508 Test Documents • Standardized Procedures for Testable Standards • Software Applications and Operating Systems • Web-based Applications • Self-contained and Closed Products • Information, Documentation and Support • Test Results • Summary of builds tested, dates, and outcomes • Functional Performance Criteria Matrix (disabilities impacted) • Section 508 Test Problem Reports (TPR)

  34. “Solved” Section 508 Test Challenges • Projects now regularly employ a Project Tailoring Plan • Projects no longer approach ITLM for test review without prior engagement and claim 508 “ignorance” • Projects are not asking for “baseline” 508 testing to determine their status for repair in next release • Some Legacy systems plan for testing new code for compliance and others seek to employ the long term solution of the USCIS Transformation (TPO) • Progress recently made in acquisitions plans to require documentation of Market Research in a D&F form prior to purchase

  35. USCIS Section 508 Test Methods

  36. USCIS Section 508: 101 Training • Tailored to specific processes at USCIS • Eight hours of training, offered once per month, beginning May 2009 • Intended audience • Testers • IT project managers • Acquisition • Application designers and developers • Quality assurance • Purpose • Overview of Section 508 categories, standards, and exemptions • How 508 fits into ITLM • How to conduct market research • How to complete a D&F Form for items assessed during market research and tested for compliance • Certification exam

More Related