Building a winning infrastructure for distance education a case study
Download
1 / 41

Building a Winning Infrastructure for Distance Education: A ... - PowerPoint PPT Presentation


  • 417 Views
  • Uploaded on

Building a Winning Infrastructure for Distance Education: A Case Study Stuart Varden Kitty Daniels Susan Feather 2002 OSRA Conference St. Louis, MO February 21, 2002 Overview Web and Database Support Stuart Varden Faculty Support Kitty Daniels Testing in an Online Course: A Challenge

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Building a Winning Infrastructure for Distance Education: A ...' - jacob


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Building a winning infrastructure for distance education a case study l.jpg

Building a Winning Infrastructure for Distance Education: A Case Study

Stuart Varden

Kitty Daniels

Susan Feather

2002 OSRA Conference

St. Louis, MO

February 21, 2002


Overview l.jpg
Overview Case Study

  • Web and Database Support

    • Stuart Varden

  • Faculty Support

    • Kitty Daniels

  • Testing in an Online Course: A Challenge

    • Susan Feather


Web and database support l.jpg
Web and Database Support Case Study

  • Use Blackboard, Inc. System (BB5)

  • Use HorizonLive and Real Presenter Systems for Voice-Over-Graphics Presentations

  • NACTEL Web Page


Support staff l.jpg
Support Staff Case Study

  • BB5 Systems Support

  • Two Course Technology Support persons:

    • Graphics support

    • Implement Quizzes, Exams, Syllabi, Assignments and other instructional documents

    • Student/Instructor Help Desk

  • Database Administrator


Database function l.jpg
Database Function Case Study

  • Administration System

    • Student Registration

    • Maintain Records on Screening Tests

  • Reporting for:

    • Internal Control

    • External Funding Agencies & Sponsors

      • Sloan Foundation

      • U.S. Government

      • NACTEL Board

      • New York State

      • Regional Accreditation Agencies (Middle States)


Database functions cont l.jpg
Database Functions (Cont.) Case Study

  • Research

    • Three Main Thrusts (FIPSE/LAAG):

      • Enhanced Student Services

      • Secure Online Test Proctoring

      • Mentoring

    • Student/Faculty Research Data Source

      • Doctoral Dissertation Research

      • Faculty Research


Evolution of database function l.jpg
Evolution of Database Function Case Study

  • Stage 1:

    • Standalone MS Access Databases

  • Stage2:

    • Perceived as Having Low Impact

    • Proctoring

    • Courseware (Lack of control; change management issues)


Evolution of database function8 l.jpg
Evolution of Database Function Case Study

  • Stage 3:

    • Integration of All Databases

    • Move from MS Access to Sequel Server

  • Stage 4:

    • Interface to University Registration Systems

    • Calendar Issues

    • Billing Structure

    • Third Party Tuition Payments


Evolution of database function9 l.jpg
Evolution of Database Function Case Study

  • Stage 5:

    • Leadership  Heading to Mainstream

      • Major Program

      • More Online Program Demand – the 9/11 Effect

      • Translates Into Dollars ($)

    • It Is Now Understood That NACTEL Web Page Must Guide the Student Through a Sequence of Functions and Services with the Database Having a Role Throughout

    • Still Learning and Reinventing


Faculty support l.jpg
Faculty Support Case Study

  • Orientation for NACTEL faculty

  • On-going support for NACTEL faculty

  • University-wide support


Orientation l.jpg
Orientation Case Study

  • Online Seminar

    • Student version

    • Faculty version

    • Provide introduction to Blackboard, Horizon Live

    • Provide essential Internet concepts

    • Prepare computers for online education


Orientation contd l.jpg
Orientation contd. Case Study

  • “Shadowing” of experienced faculty


On going support l.jpg
On-Going Support Case Study

  • Faculty support

    • Team Teaching

    • Team Course Development

    • Team Course Maintenance

    • Faculty Meetings

  • Technical support

  • Instructional design support


University wide support l.jpg
University-Wide Support Case Study

  • Center for Instructional Technologies

    • Blackboard Seminars and Conferences

    • Online Seminars

      • Online Course Design

      • Designing Accessible Courses

      • Moderating Online Discussions

      • Using Audio and Video for Online Courses—An Introduction to Web Streaming

  • Faculty Resource Web Site

  • Teaching, Learning, and Technology Roundtable


Testing in online courses a challenge l.jpg
Testing in Online Courses: Case StudyA Challenge

  • Student assessment and evaluation (how much, how often, hands-on, practical vs. theoretical)

  • Secure testing – need for authentication


Tests l.jpg

“Feared by learners, discounted by instructional designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.” (Horton, 2000)

Tests


Assessment at a distance l.jpg
Assessment at a Distance designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

Two Types . . .

  • Formal

    • Online Quizzes

    • Cumulative exams (midterm, final)

    • Submission of homework assignments (fax, e-mail, Drop Box)

    • Projects/Papers (individual and group work)

    • Lab assignments and reports

  • Informal

    • Participation in class discussion board

    • E-mail responses

    • Responses to open-ended questions in an online chat


Distance learning software l.jpg
Distance Learning Software designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Course Management Systems

    • Blackboard - www.blackboard.com (adopted by Pace)

    • WebCT – www.webct.com

  • Other Assessment Software

    • Question Mark – www.questionmark.com

    • eZ.Exam – www.ncspearson.com/ncscorp/ezexam

    • ExamSoft – www.examsoft.com

    • Secure Exam – www.softwaresecure.com

    • Test.com – www.test.com

    • Cyber Exam – www.atpcorp.com/cyberexam.htm

    • Test Pilot – www.clearLearning.com/index.html

    • Chi Tester – www.chitester.weber.edu


Blackboard assessment features l.jpg
Blackboard Assessment Features designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Assessment Manager

    • Creates quizzes, exams, and surveys

    • Password protects exam(s)

    • Enables timed quizzes/exams

    • Calculates and records grades

  • Pool Manager

    • Stores questions to be used and reused

  • Online Gradebook (Spreadsheet)

    • Stores grades, allows editing, weighting

    • Exports Gradebook into Excel

    • Resets quizzes/exams


Blackboard question types l.jpg
Blackboard Question Types designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • True/False

    • Make a binary decision – right or wrong?

    • Make question simple and straightforward

  • Multiple choice

    • Maximum 20 choices

  • Multiple Answer

    • Choose more than one answer

  • Fill in the blank

    • Evaluated on an exact text match

    • Doesn’t accept synonyms, grammatical variants, common misspellings


Blackboard question types21 l.jpg
Blackboard Question Types designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Matching

    • Maximum 20

    • Keep the list short!

  • Ordering/Ranking

  • Short Answer/Essay

    • Not automatically graded

    • Learner can cut/paste from another open program

    • Limit on number of characters


Blackboard advanced options l.jpg
Blackboard Advanced Options designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Categorize questions to create from Question Pool

    • Specific or random

    • Import and export capability

  • Allow HTML coded text

  • Upload multimedia

    • Images

    • Audio

    • Files/websites

      • Create a Link to file (Example: Link to File)

      • Display it on the page


Options not available yet l.jpg
Options Not Available . . . Yet designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Spell Checker

  • Enter mathematical symbols/functions

  • Greater storage for essay type questions

  • E-mail sent upon completion

  • Interactive questions (hot spot, drag and drop)


Hot spot question l.jpg
Hot Spot Question designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

In the above diagram, place the marker on the area that makes this a parallel circuit. Then click the Submit button.


Drag and drop question l.jpg
Drag and Drop Question designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”


How can cheating be reduced l.jpg
How Can Cheating Be Reduced? designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

Trust Approach

  • Remind learners . . .

    • they are responsible for their own learning.

    • they only cheat themselves.

    • that you trust them.

      Fence Approach

    • Try to make cheating impossible or harder than actually studying.

    • Create new test questions for each test.

    • Randomly select questions from a list.

    • Randomly order multiple choice answers.

    • Require proctored exams.

      Threat Approach

    • Threaten punishment with clearly stated policy if caught cheating.


Purpose of proctoring program l.jpg
Purpose of Proctoring Program designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • The proctoring program was designed to focus on the issue of periodic student verification when taking an examination in an online course.

  • “The basic purpose of having a test administrator or proctor in the room is to prevent the test from being compromised.”

  • “Ninety percent of respondents will usually be honest. The other 10 percent can be a real headache.” (Odin Westgaard, Ed.D, Tests That Work)


The proctor defined l.jpg
The Proctor Defined designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • A person selected by the student and approved by Pace University

  • The proctor will be responsible for administering and supervising any major examinations throughout the student’s degree (i.e. midterm and final exams)


Proctor criteria l.jpg
Proctor Criteria designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Cannot be a relative, student in the program, or coworker

  • Acceptable proctors . . .

    • Company Supervisor/Manager

    • Corporate Instructor

    • Official College Testing Service

    • Librarian

    • Official Learning/Tutoring Center

      (And more . . .)


Consortium of testing centers http testing byu edu consortium find asp l.jpg
Consortium of Testing Centers designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.” http://testing.byu.edu/Consortium/find.asp


Proctor responsibilities l.jpg
Proctor Responsibilities designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Verify the identity of a student when taking a proctored exam

  • Have e-mail and Internet access (access to fax machine helpful)

  • Gain access to the examination via the Internet using provided password

  • Validate an exam by ensuring that the student is adhering to the exam guidelines

  • Sign and return a verification form upon completion of the proctored examination


Proctored exam considerations l.jpg
Proctored Exam Considerations designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Determine the specific course criteria:

    • Which exam/s will require a proctor?

    • When will they be available?

    • How will the proctor receive the examination?

    • How will the completed examination be returned?

    • What resources will be allowed?

    • What is the time limit?


Proctored exam considerations33 l.jpg
Proctored Exam Considerations designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Determine the specific course criteria:

    • When is the completed examination due?

    • What kind of feedback will the students receive after exam?

    • When will the grades be posted?


Proctoring program steps l.jpg

1. designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.” Selection of person to serve as proctor

Change

Proctor

4.Proctor administers exam and returns a signed verification form

5. Exam Complete

2.Complete online proctor application process

3.Provide proctor with the exam information and password

Proctoring Program Steps


Nactel s proctoring program http support csis pace edu nactel program proctoring cfm l.jpg
NACTEL’s Proctoring Program designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.” http://support.csis.pace.edu/nactel/program/proctoring.cfm


Proctor database sql server spring 2001 l.jpg
Proctor Database designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.” SQL Server (Spring 2001)


Proctor database l.jpg
Proctor Database designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Instructors have access to proctor information and e-mail capability for their courses only

  • Students have ability to edit, verify, invalidate proctor and apply for a new proctor

  • Students have ability to search for currently approved proctors by location (only those proctors who are willing to proctor for other students

  • Soon . . .

  • Proctors will have access to update contact information, retrieve exam information/passwords and verify administration of any proctored exam


Current problems concerns l.jpg
Current Problems/Concerns designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

  • Scheduling a day/time with proctor

  • Computer/printer malfunctions

  • Problem accessing/submitting online exam

  • Proctor database is student dependent, rather than proctor dependent

  • Lost connection during exam requiring that it be reset

    • Connection Keeper (sends ping to ISP)

      http://www.gammadyne.com/conkeep.htm


Proctor survey responses l.jpg
Proctor Survey Responses designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

“Your services are great to help people further their education/careers.”

“This was accomplished seamlessly. It demonstrated a lot of thought went into this procedure.”

“Your communications are clear, organized, and allow for ease in response. You've made the process simple and easy to use. Thanks!”

“The use of e-mail and the Internet is an excellent method to distribute the needed information as opposed to regular mail service.”

“I think the process works very well. Tricia keeps in contact and the e-mails I have gotten all have the pertinent information. I’ve enjoyed working with Pace and the students.”


References l.jpg
References designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”

Horton, W. (2000). Designing Web-Based Training

Westgaard, O. (1999). Tests That Work

“Survey of Course and Test Delivery/Management Systems for Distance Learning”http://www.student.seas.gwu.edu/~tlooms/assess.html

“Web-Based Assessment” http://sunil.umd.edu/documents/assess.htm

“Quizzing and Testing On the Internet”http://illinois.online.uillinois.edu/stovall.quizzes


Questions l.jpg
Questions? designers, tests are, nevertheless, an essential element of learning. We may call them quizzes, drills, examinations, assessments, competence monitors, or demonstrations of mastery. We may cloak them as games or puzzles. Yet, they remain an essential ingredient for gauging a learner’s progress.”


ad