1 / 9

Final Preparations for Evaluation: Roles, Scripts, and Pilot Studies

In this chapter, we finalize our evaluations by outlining critical roles, responsibilities, and the importance of using scripts. Whether you're executing every task yourself or delegating, clear roles enhance the evaluation process. Key roles include the facilitator, sportscaster, and observer, among others. We emphasize the necessity of informed consent, highlighting participant rights and procedural details. Finally, running a pilot study helps identify and rectify issues before the main evaluation, ensuring efficient data collection and minimizing potential hindrances.

kert
Download Presentation

Final Preparations for Evaluation: Roles, Scripts, and Pilot Studies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 24 Final preparations for evaluation

  2. Completing preparations • Geez, I thought we were all ready… • This chapter dots the i’s and crosses the t’s I guess…

  3. Roles for evaluators • If you’re the only person, you have to do everything…or, assign, I mean, delegate responsibilities • Facilitator: • “flight attendant”, looks after well being of participant • “sportscaster”: data collector, keeps the participant talking (if talk-aloud, presumably) • “scientist”: ensuers data collected in scientific manner (objective, unbiased, etc.)

  4. Other roles • How many roles are there? Lots… • Note-taker: self-explanatory • Equipment operator: self-explanatory • Observer: good for “outsiders” (e.g., stakeholders) • Meeter and greeter • Recruiter • Lone Evaluator: does all of the above

  5. Use a script • (Seems like I said to use a script several times already…) • Scripts are important for several reasons: • so you don’t forget to say or do something (e.g., get consent form signed) • so you don’t influence the participant, or if you do, at least the influence is consistent (e.g., between groups)

  6. Script example

  7. Informed Consent • What’s on the Informed Consent Form? • Rights of the participant • minimal risk (no harm) • procedural info (what is going to happen) • comprehension (does user understand) • voluntariness (no coercion or pressure) • human rights (participants must be informed) • Rights of the company/school • nondisclosure (is an NDA needed?) • confidentiality (thought this was subject’s identity kept secret) • waivers (for pictures, video recordings, etc.) • legalese (use plain English) • expectations (not clear on this…)

  8. Example of IC form • See Clemson’s IRB: • http://www.clemson.edu/research/orcSite/orcIRB.htm

  9. Pilot study • Before running the full experiment, run a pilot study: • this will expose “minor annoyances” that you may have missed, that are easy/quick to fix, but that may hinder collection of the “real data” • you can generally expect to throw away all data collected in the pilot

More Related