Doctoral Program Assessment

1. Doctoral Program Assessment of the Department of Business Administration Joe Mahoney Director of Graduate Studies Department of Business Administration University of Illinois at Urbana-Champaign August 28, 2011

2. Doctoral Program Assessment • Business Administration Department for 2010-2011 had 50 doctoral students spanning six areas of concentration: • Information Systems • International Business • Marketing • Organizational Behavior • Process Management • Strategic Management • The BA Department has maintained a close to a one-to-one faculty-to-student ratio.

3. Doctoral Program Assessment • In Spring 2011, Interim Vice Chancellor for Academic Affairs and Provost, Richard Wheeler, called for a Doctoral Program Assessment for each of our 98 doctoral programs on the campus of the University of Illinois at Urbana-Champaign, and the implementation of this charge was carried out under the leadership of Deba Dutta, Dean of the Graduate College.

4. Doctoral Program Assessment • The 98 doctoral programs on the UIUC campus were grouped into four areas for review: • Engineering and Physical Sciences (I) • Humanities and Creative Arts (II) • Behavioral and Social Sciences (III) -- 28 programs • The Business Administration Doctoral Program was included in category III, and thus evaluated by the Area III subcommittee. • Agricultural and Biological Sciences (IV)

5. Doctoral Program Assessment: 28 programs • Accountancy • Agricultural & Applied Economics • Anthropology • Audiology • Business Administration • Community Health • Curriculum & Instruction • Economics • Education Organization & Leadership • Education Policy Studies • Educational Psychology • Finance • Geography • HR & Industrial Relations • Human and Community Development • Human Resource Education • Informatics (new program) • Kinesiology • Law (JSD) • Library & Information Science • Political Science • Psychology • Recreation, Sport, Tourism • Regional Planning • Social Work • Sociology • Special Education • Speech & Hearing Science

6. Doctoral Program Assessment • The Business Administration Department was reviewed by the Area III sub-committee: • Thomas Schwandt (College of Education), Chair • Christine Jenkins (Library Science) • Joseph T. Mahoney (College of Business) • Anna-Marie Marshall (Sociology) • Jeffrey Woods (Kinesiology)

7. Doctoral Program Assessment Best Practices identified by the Graduate CollegeBA? • Efforts made to yield high demand YES (e.g., day for campus visits) • Admissions highly selective (less than 20%) YES • New student orientation provided YES • Curriculum requirements are clarified; • Meet with faculty, department staff, and returning students • Timelines provided to doctoral studentsYES • Financial support listed and for what duration guaranteed YES • Annual review process YES • Reviewed by Advisor • Reviewed by Director of Doctoral Studies

8. Doctoral Program Assessment Best Practices identified by the Graduate CollegeBA? • (Bi-annual) Workshops on: YES • Research Ethics; Grant Writing; Academic Publishing; Teaching Strategies; and the Job Search Process • Graduate Studies Director should facilitate students YES achieving Certificates of Teaching (Bi-annual) • Records of job placements should be precisely kept, YES and successful placements of students should be shown.

9. Doctoral Program Assessment Strong Outcome Indicators identified by the Graduate College • Strong placements YES • HEC- Paris (2009) • Hong Kong University of Science & Technology (2005 & 2009) • Louisiana State University (2008) • Santa Clara University (2009) • SUNY – Buffalo (2006) • University of Minnesota (2007 & 2010) • University of Toronto (2010) • Washington University, St. Louis (2007

10. Doctoral Program Assessment Strong Outcome Indicators identified by the Graduate College • Publish their research YES • Authored or co-authored a paper: 42% • Behavior & Social Science Average: 44% • Attend national and international meetings YES • National Meetings: 59% • Behavior & Social Science Average: 61% • International Meetings

11. Doctoral Program Assessment • The BA Doctoral Program was rated Medium (in terms of the three categories of Low, Medium, and High) in terms of “best practices” listed in the previous e-mails. • However, the BA Doctoral Program was rated Low based on the 27 doctoral students who responded to the Graduate College survey. Category I: (High, High); (High, Low), (Low High) Category II: (High, Low); (Medium, Medium); (Low, High) Category III: (Medium, Low); (Low, Medium); (Low, Low)

12. Doctoral Program Assessment • The Business Administration Department was rated by the sub-committee (in which I was recused) as a program that Needs Improvement: Campus (98) Area III (32) Excellent 09 05 (High, High) Good 29 05 Satisfactory 26 08 Needs improvement 16 07 Requires further Evaluation 13 03 (Low, Low) No formal ranking 05 04

13. Doctoral Program Assessment • How Satisfied are you with your education experience in your doctoral program? Mean Std. Dev. N • Business Administration 3.1 1.3 27 • Behavior & Social Sciences 3.6 1.0 639 • Campus 3.6 1.0 2,014

14. Doctoral Program Assessment Feedback from our BA Doctoral Students: • Approximately 50% of female students reported being slightly or not at all satisfied with the BA Ph.D. program; • Almost 65% of female students report being slightly or not at all well prepared; and • Approximately 50% of the international students report being slightly or not at all well prepared.

15. Doctoral Program Assessment • The charge of the BA Graduate Studies Committee is to formulate and oversee the implementation of mechanisms to move the program effectiveness rating from Medium to High, and to move the Student Evaluations from Low to Medium or High • Joe Mahoney, Graduate Studies Director, Chair • Mike Bednar, Organizational Behavior • Joe Clougherty, International Business • Michael Lim, Process Management • Deepak Somaya, Strategy & Entrepreneurship • Madhu Viswanathan, Marketing

16. Doctoral Program Assessment Best Practices: Areas for Improvement • Updated BA Doctoral Program Guide on Website • Requirements for Preliminary Exams, Papers, Dissertation Proposal & Final Defense • Policies & Procedures • Both general requirements and those specific to each Group • Processes put in place to update the curriculum • Processes put in place to disseminate this information (on web) • Increase the pool of money for doctoral students to present at conferences • Workshops should be provided on research ethics, grant writing, academic publishing, teaching strategies, and the job search process.

17. Doctoral Program Assessment Best Practices: Areas for Improvement • Records of doctoral students working papers, publishing and co-authoring with faculty should be kept; • To facilitate the support of diversity in admission to the doctoral program, some BA faculty members should work with Summer Research Opportunity (SROP) and McNair Scholars to nurture minority undergraduates into the graduate program. • Note: The Graduate College report indicated that the BA program “lacks diversity”: 0% of its graduate enrollment in FY10, and FY11 is from an under-represented minority (URM) group, and the numbers have been low over the past 5 years.

18. Questions?