Evaluation & Metrics

1. Evaluation & Metrics Evaluating the New Directions Project As a quantitative measure of assessment we adapted the “Evaluator Competency for Professional Development” document developed by the Visitor Studies Association. The questionnaire encompassed the five strands of competency identified by VSA and asked students to rate their level of perceived experience and knowledge both at the start of the Introduction course, and at the conclusion of the 10 week course. As a qualitative measure, each student was asked to submit a 1 page reflection paper detailing their experience in the course, including their perceptions of Visitor Studies before they took the Intro course, and after completing the course. Other summative evaluation methods are being developed for final project year. Overall Competency: Overall mean score for Visitor Studies competency assessment questionnaire (n=24) *At the start of the Intro course 70% of students rated themselves as “Weak: Minimal or no Knowledge”. After the course no student rated themselves as Weak, rather 83% rated themselves “Competent: I have some knowledge but would like more” with the remaining students rating themselves “Excellent: Extremely knowledgeable”. Student count Self-assessed ranking Individual areas of competency identified by VSA: Competency A: Principles and Practice of Visitor Studies Competency B: Principles and Practice of Informal Learning Competency C: Knowledge of and Practices with Social Science Research and Evaluation Methods and Analysis Competency D: Business Practices, Project Planning, and Resource Management Competency E: Professional Commitment to the field of Visitor Studies Comments from student reflections: “I came into the course not knowing quite what to expect; I didn’t know if I felt audience research was truly valuable, and secondly, if I had any interest in studying it at all. At the end of the course I can say that audience research is definitely an important area of Museology that is very pertinent to the field and my future.” “This course has been eye opening for me.” “I can see that audience research really is necessary. Visitors to a museum do so many things, no two alike.” “I can see how audience research has impacted the museum field and will continue to influence the production of exhibits, programs, and the many other facets of museums.”