Hear it, See it, Do it, Know it

Hear it, See it, Do it, Know it Solving scale and efficacy challenges in on-demand learning James Wrubel (jcw@sei.cmu.edu) Software Engineering Institute Carnegie Mellon University

Briefly, about me Carnegie Mellon University Software Engineering Institute (FFRDC) CERT (Information Security) Enterprise Workforce Development Me (Focus on technical security training)

Challenge 100,000 Defense Dept. computer security professionals around the world need to pass a commercial certification in six months.

Our solution: VTE

VTE: Design Goals Efficacy Scalability

VTE: Capabilities READ IT HEAR IT SEE IT DO IT Recordeddemonstrations Hands-ontraining labs Documents White papers Technical briefs Lecture modules Mastery Content Richness

READ IT READ IT HEAR IT SEE IT DO IT Recordeddemonstrations Hands-ontraining labs Documents White papers Technical briefs Lecture modules Mastery Content Richness

HEAR IT, SEE IT READ IT HEAR IT SEE IT DO IT Recordeddemonstrations Hands-ontraining labs Documents White papers Technical briefs Lecture modules Mastery Content Richness

Recorded Lecture and Screencasts

DO IT READ IT HEAR IT SEE IT DO IT Recordeddemonstrations Hands-ontraining labs Documents White papers Technical briefs Lecture modules Mastery Content Richness

Hands-on Labs

VTE: Courses

VTE: Impact • 740 hours of training; 78 hands-on labs • Averaging 340 FTE weeks of training per month (equiv. 4.25 continuous courses @ 20 students) • 80% cost savings per student compared to instructor-led training

Why not best-of-breed? We tried. Here’s what we found: • Hands-on lab products need work • Online attention span • Transcription vs. SMIL • ‘Deep’ integration

Hands-on lab products need work Expensive ($1m!) No integrated authentication Complex to administer and maintain Quality control issues

Online attention span Average length: 2.7 minutes Average length: 50-80 minutes

Benefit: VTE Library

Transcription vs. SMIL

Benefit: Deep Search & Takeaways

‘Deep’ integration

Benefit: Synergy One number to call for problems Consistent User Experience Reporting Progress Tracking and Auditing

Bottom line The big players focus on biggest slice of the pie Source: 2007 ASTD Survey

Lessons Learned High-fidelity asynchronous learning is possible • You might have to get your hands dirty though… Virtualization is the new flight simulator • Rube Goldberg scenarios The Transcript is HUGE • SMIL doesn’t cut it Roll-your-own on the cheap • YouTube (et. al) and VMWare Server are free

If Time: VTE Demonstration

Questions? Access VTE at: https://www.vte.cert.org More information: Me jcw@cert.org vte-support@cert.org

Hear it, See it, Do it, Know it

Hear it, See it, Do it, Know it

Presentation Transcript

LET'S HEAR IT

Think it. Say it. Believe it. See it. Demand it. Chase it. Respect it. Want it. Taste it. Smell it. Breathe it. Dream

IT IT IT IT IT IT

Wisdom—you know it when you see it

See it! Believe it! Teach it!

Write it Do it

GOOD SPORTSMANSHIP Know It When You See It

Economic Development: Know it When You See It

See it, define it, report it !

You Hear It, You Understand It, You’ll Never Forget It!

Do It!

Quality—I’ll know it when I see it!!!

We don ’t know it, because we don’t see it!

Write It, Do It (WIDI)

LET'S HEAR IT

WRITE IT DO IT

WRITE IT DO IT

Evaluation of the “See it, Hear it, Say it “ Campaign Visibility research

Academic Language What is it? How do I know it if I see it?

‘ Dream it do it'

See it. Believe it

Write It, Do It