1 / 86

Annual BEAP Report February 24, 2011

Annual BEAP Report February 24, 2011. 28 th Annual BPD Conference Cincinnati, Ohio. BEAP Team.

Download Presentation

Annual BEAP Report February 24, 2011

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Annual BEAP ReportFebruary 24, 2011 28th Annual BPD Conference Cincinnati, Ohio

  2. BEAP Team Vicky BuchanColorado State UniversityBuchan@cahs.Colostate.eduBrian ChristensonLewis-Clark State Collegeblchristenson@lcsc.eduhttp://www.lcsc.edu/bchristensonRuth Gerritsen-McKaneUniversity of Utahruth.gerritsen-mckane@socwk.utah.edu Tobi DeLong HamiltonUniversity of Nebraska at Kearneyhamiltont2@unk.eduRoy (Butch) RodenhiserBoise State UniversityRoyRodenhiser@boisestate.eduMarshall Smithdocsmith@umich.edu Erin Gerdes Graduate Student: Colorado State University

  3. To Access BEAP • http://beap.utah.edu/ Or • http://www.bpdonline.org • “Resource Center” • BEAP • Resource Center • Accreditation Resources

  4. Foundation Curriculum Assessment Instrument

  5. Purpose of the FCAI • Provides Pre/Post test in seven major curricular areas of a BSW program • Provides a direct measure to assist programs with evaluation of their curriculum • Assists with identification of curricular areas that may need attention • Provides national comparative data

  6. Curricular Components

  7. Sample HBSE Question • The concept “person-in-environment” includes which of the following: • Clients are influenced by their environment • Clients influence their environment • Behavior is understood in the context of one’s environment • All of the above

  8. Sample Practice Question • Determining progress toward goal achievement is one facet of the _____ stage. • a. Engagement • b. Evaluation • c. Assessment • d. Planning

  9. Testing History – 2006-2010 • Version 3 1 Test 65 ?s n= 305 • Version 4 1 test 55 ?s n= 381 • Version 5 1 test 82 ?s n= 286 • Version 6 1 test 74 ?s n= 36 • Version 7 1 test 72 ?s n= 318 • Version 8 1 test 64 ?s n=2231 TOTAL =3557

  10. Reliability Testing • Version 8 • Tested in two junior practice classes • Students tested twice, 2 weeks apart • Pearson’s correlation coefficient • r = .86 • a

  11. Item difficulty index • Overall difficulty or average should be around .5 (Cohen & Swerdlik, 2005) • FCAI = .523 (n=415) • “This is a very good difficulty level for the test. Not likely to misrepresent the knowledge level of test takers”.

  12. Expansion beyond BSW • Based upon CSWE assertions related to educational levels in social work education, we expanded testing to three additional groups: • MSW foundation students: • entering • exiting • Advanced standing students: • entering

  13. Mean Scores by Educational Level – Version 8

  14. Pre/post test for differenceBSW & MSW Foundation

  15. Tests of Difference by Educational Level

  16. Tests of Difference by Educational Level

  17. Domain Comparisons- Version 8 Overall

  18. Domain Comparisons- Version 8 Overall

  19. Domain Comparisons-Version 8 Overall

  20. Domain Comparisons- Version 8 Overall

  21. Foundation Curriculum Assessment Instrument (FCAI)Program Name: Students are: Entering BSW Program ______ Exiting BSW Program _______ Month ____, Year ____, Semester ____ • Program Cumulative Scores Compared with all Student Scores

  22. II. Program: Section Scores Compared with all FCAI Section

  23. III. Program: BSW Student Scores by Individual Curricular Area

  24. Field Practicum/Placement Assessment Instrument (FPPAI)

  25. Need for Field Evaluation In response to evaluate social work program outcomes related to the 2008 EPAS competencies and practice behaviors The need for a field/practicum assessment that measures competencies related to practice behaviors

  26. FPPAI Piloting Phases • Initial Piloting was conducted May 2008 • Second Piloting was conducted in Fall 2008/Spring 2009 • Third Piloting phase was conducted Fall 2009 • Full implementation: Fall 2010

  27. Assessment Methodology 55 Likert Scale questions measuring practice behaviors linked to the EPAS 2008 competencies. Qualitative feedback form for each domain available for program use. Will be available online and in print format. Individual program outcomes report with national comparisons. Individual program outcomes report with national comparisons for EPAS 2008 Competencies & Practice Behaviors Can be used as a final field assessment and mid-test/post test design. MSW pilot in the planning stages.

  28. FPPAI Scale

  29. BEAP & EPAS 2008

  30. FPPAI Reporting and EPAS 2008 Overview: Click on the screen to see the video.

  31. Call for Foundation Year MSW Participation If your program is interested in being a part of the national ”MSW Foundation Online” pilot, please access the FPPAI website: http://www.lcsc/bchristenson/fpai.htm Dr. Brian Christenson: • blchristenson@lcsc.edu Dr. Ruth Gerritsen-McKane: • Ruth.Gerritsen-McKane@socwk.utah.edu

  32. http://beap.socwk.utah.edu/

  33. Student demographics Assessment on Knowledge, Skills, & Values Employment information Advising feedback Professional development of students & alumni/ae Peer comparison by region, program type, auspice & nationally …and more What BEAP can do for your program

  34. BEAP Instruments & EPAS Competencies/Practice Behaviors The Matrix

  35. BEAP & EPAS 2008

  36. BEAP InstrumentsNational Overview of Data 2010

  37. Sample vs. Population Program Type

  38. Sample Profile Overview of all Respondents* *Note: SWVI no longer reported

  39. Sample Profile Response Rates

  40. Auspices of College or University(2010 Entrance)

  41. Ethnicity at Entrance Note: Percentages equal more than 100% due to multiple self-reported ethnicities.

  42. Financial Aid at Entrance- 2000-2009 *Includes Federal and State only.

  43. 2010 Financial Aid at Entrance *Includes Federal and State only.

  44. Plan to be Employed During BSW Education (Reported at Entrance)

  45. Future Educational Plans-Exit Note: Percentages equal more than 100% due to multiple self-reported future educational plans.

  46. KSV- Exit *2010 Likert scale changed from 0-10 to 1-9 (Scale of 0-10)

  47. Exit Advising Scores *2010 Likert scale changed from 0-10 to 1-9 (Scale of 0-10)

  48. 2010 Advising Scored by Auspice- Exit (Scale of 1-9)

  49. 2010 Advising Scores by Program Type-Exit N= 568 t- test *p= .000 (Scale of 1-9)

  50. Current Employment Information Primary Function- Exit n= number reporting

More Related