1 / 63

Annual BEAP Report March 20, 2010

Annual BEAP Report March 20, 2010. 27 th Annual BPD Conference Atlanta, GA. Introduction. Foundation Curriculum Assessment Instrument. Purpose of the FCAI. Provides Pre/Post test in seven major curricular areas of a BSW program

nalanie
Download Presentation

Annual BEAP Report March 20, 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Annual BEAP ReportMarch 20, 2010 27th Annual BPD Conference Atlanta, GA

  2. Introduction

  3. Foundation Curriculum Assessment Instrument

  4. Purpose of the FCAI Provides Pre/Post test in seven major curricular areas of a BSW program Seeks to help the program assess “value added” from entry to exit Assists with identification of curricular areas that may need attention Provides national comparative data

  5. Curricular components

  6. Sample HBSE Question • The concept “person-in-environment” includes which of the following: • Clients are influenced by their environment • Clients influence their environment • Behavior is understood in the context of one’s environment • All of the above

  7. Sample Practice Question • Determining progress toward goal achievement is one facet of the _____ stage. • a. Engagement • b. Evaluation • c. Assessment • d. Planning

  8. Testing History – 2006-2010 • Version 3 1 Test 65 ?s n= 305 • Version 4 1 test 55 ?s n= 381 • Version 5 1 test 82 ?s n= 286 • Version 6 1 test 74 ?s n= 36 • Version 7 1 test 72 ?s n= 318 • Version 8 1 test 64 ?s n=1576 TOTAL =2902

  9. Reliability Testing – Version 8 • Tested in two junior practice classes • Students tested twice, 2 weeks apart • Pearson’s correlation coefficient: r = .86 • a

  10. Item difficulty index • Overall difficulty or average should be around .5 (Cohen & Swerdlik, 2005) • FCAI = .523 (n=415) • “This is a very good difficulty level for the test. Not likely to misrepresent the knowledge level of test takers”.

  11. Expansion beyond BSW • Based upon CSWE assertions related to educational levels in social work education, we expanded testing to three additional groups: • MSW foundation students: • entering • exiting • Advanced standing students: • entering

  12. Mean scores by Educational level – Version 8

  13. Instrument Discriminant Analysis

  14. Pre/post test for differenceBSW & MSW Foundation

  15. Tests of Difference by Educational Level

  16. Tests of Difference by Educational level

  17. Domain Comparisons- Version 8 Overall

  18. Domain Comparisons- Version 8 Overall

  19. Domain Comparisons-Version 8 Overall

  20. Domain Comparisons- Version 8 Overall

  21. Field Practicum/Placement Assessment Instrument (FPPAI)

  22. Need for Field Evaluation In response to evaluate social work program outcomes related to the 2008 EPAS competencies and practice behaviors The need for a field/practicum assessment that measures competencies related to practice behaviors

  23. FPPAI Piloting Phases • Initial Piloting was conducted May 2008 • Second Piloting was conducted in Fall 2008/Spring 2009 • Third Piloting phase was conducted Fall 2009 • Full implementation: Fall 2010

  24. Assessment Methodology 55 Likert Scale questions measuring practice behaviors linked to the EPAS 2008 competencies. Qualitative feedback form for each domain available for program use. Will be available online and in print format. Individual program outcomes report with national comparisons. Individual program outcomes report with national comparisons for EPAS 2008 Competencies & Practice Behaviors Can be used as a final field assessment and mid-test/post test design. MSW pilot in the planning stages.

  25. FPPAI Scale

  26. FPPAI: Instrument Sample (Quantitative)

  27. FPPAI Sample: Qualitative Feedback Form

  28. BEAP & EPAS 2008

  29. FPPAI: Overview & Key Findings 204 participants from 18 schools and 18 states participated in the FPPAI pilot project. Overwhelming positive feedback from participating schools. Incorporated pilot feedback survey results into final pilot revisions. Cronbach’s Alpha reliability test of internal consistency was completed, (n=204, .962) reporting excellent internal consistency. Fall online MSW foundation pilot

  30. Call for Foundation Year MSW Participation If your program is interested in being a part of the national ”MSW Foundation Online” pilot, please access the FPPAI website: http://www.lcsc/bchristenson/fpai.htm Dr. Brian Christenson: • blchristenson@lcsc.edu Dr. Ruth Gerritsen-McKane: • Ruth.Gerritsen-McKane@socwk.utah.edu

  31. http://beap.socwk.utah.edu/

  32. http://www.lcsc.edu/bchristenson/fpai.htm

  33. 2009 Report on the Revised BEAP Instruments

  34. Sample Profile Overview of all Respondents

  35. Sample vs. Population Program Type

  36. Sample Profile Response Rates

  37. Auspices of College or University(Overall-Entrance)

  38. Ethnicity at Entrance Note: Percentages equal more than 100% due to multiple self-reported ethnicities.

  39. Financial Aid at Entrance *Includes Federal and State only.

  40. Plan to be Employed During BSW Education (Reported at Entrance)

  41. Future Educational Plans-Exit Note: Percentages equal more than 100% due to multiple self-reported future educational plans.

  42. KSV- Exit (Scale of 0-10)

  43. Exit Advising Scores (Scale of 0-10)

  44. Overall Advising Scores by Auspice- Exit (Scale of 0-10)

  45. Overall Advising Scores by Program Type-Exit N= 20,833 t- test *p= .000 (Scale of 0-10)

  46. Current Employment Information Primary Function - Exit n= number reporting

  47. Current Employment Information Primary Role - Exit n= number reporting

  48. Client Systems - Alumni/ae

  49. Income Level Most Represented by Clients - Alumni/ae

  50. Professional Development During the Last Year(Reported at Alumni/ae)

More Related