Tuning USA: Meeting the Challenges of US Higher Education

1. Tuning USA: Meeting the Challenges of US Higher Education John H. Yopp, PhD Strategic Partnerships, Tuning USA David W. Marshall, PhD Associate Director, Tuning USA

2. Goals of the Presentation • Describe the Origin, Nature, and Goals of the Tuning Process in the U.S.: Tuning USA, Initiated and Co-Funded (with the Hewlett Foundation) by the Lumina Foundation Through a Comparison with the Tuning Educational Structures in Europe Project that started Tuning Worldwide • Discuss How the Unique Features of U.S. Higher Education Challenge the Tuning USA Process • Show How These Challenges are Being Addressed and the Role of the Institute for Evidence-Based Change (IEBC) in the Process • Provide a Progress Report on Tuning USA from its Origins in 2009 to its Current State and Its Relationship to Lumina’s Degree Qualifications Profile

3. The Origins of Tuning USA1a

4. Tuning USA, Like Other Tuning Processes Worldwide, Had Its Origins in Europe (1999) in a Project Called “Tuning Educational Structures in Europe”1,1a

5. The Tuning Project in Europe, Unlike Tuning USA and Tuning in Other Regions of the World, was Initiated (September 1999) Almost Simultaneously, and in Parallel, Within the Strong Supportive Environments of the Two Major European Reform Initiatives: Bologna Process (June 1999) and the Lisbon Agenda (March 2000) 2,3 These Two European Reform Initiatives Contain Philosophical, Educational, and Societal Elements that Strongly Influenced those Driving Similar Goals for Tuning USA

6. THE BOLOGNA PROCESS The Bologna Process Evolved from the Bologna Declaration Signed in Bologna, Italy by Ministers of Higher Education From 29 European Countries Following the Recognition of the Need to Create a European Higher Education Area (EHEA) by 2010. Currently, 47 European Countries are signatories to the Initiative.4,5 The EHEA was Established as the Overarching Reform Goal of the Bologna Process to Address the Lack of Comparability and Compatibility of Degrees Granted by the Very Diverse Higher Education Systems of Nations of the European Union (EU) and the General Lack of Relevance of Degrees for the Changing Needs of European Labor Markets and Society as a Whole.4,5,6

7. A Key Goal of Degree Reform Required a Common Definition of a Degree (Qualification) to achieve comparability (but not Standardization) Across European Higher Education Systems. A Tripartite Structure Based Upon a Common Framework of Reference for a First Bachelor-type, a Second Master-type, and a Third Doctoral-type Level of Qualification (Degrees).2 The Other Key Goals Included Linking Award of Qualifications (Degrees) to Systems for the Accumulation and Transfer of Credits Compatible with the Established European Credit Transfer and Accumulation System (ECTS) and the Creation of Quality Assurance Systems Whose National Features Possessed Compatibility and Articulation within the Entire EHEA.4,5,6a

8. Critical to the Success of the Bologna Process Was That: • It Involved the Effective Participation of representatives from the Stakeholders in Higher Education Reform: Higher Education Institutions, Students, Faculty, Administrators, Employers and Quality Assurance Agencies Within the European Commission, Council of Europe and UNESCO-CEPES.2,6 • It Articulated Early in Its Formation a Necessary Respect For the Autonomy of Europe's Higher Education Institutions and Cultural Distinctiveness of the Higher Education Systems In Bologna Signatory Countries.2,5

9. In March 2010 the Ministers of All 47 Participating European Countries and the Educational and Other Consultative Organizations Met in Budapest and Vienna to Officially Launch the European Higher Education Area (EHEA).5 The Goals Are, as they were in its Inception, to: • “Facilitate Mobility of Students, Graduates, and Higher Education Staff Throughout the EHEA; • Prepare Students for their Future Careers and for Life as Active Citizens in Democratic Societies, and Support their Personal Development; • Offer Broad Access to High-Quality Education, Based on Democratic Principles and Academic Freedom.”5

10. The Lisbon Agenda (Strategy)7 The European Council Met in Special Session on March 23-24, 2000 in Lisbon to Formulate a Strategic Goal for the European Union that would “Strengthen Employment, Economic Reform, and Social Cohesion as Part of the Knowledge-Based Economy”. The Lisbon Strategy was Focused on: • “preparing the transition to a knowledge-based economy and society by better policies for the information society and R&D, as well as stepping up the process of structural reform for competiveness and innovation and by completing the internal market; • modernizing the European Social Model, investing in people and combating social exclusion; and • sustaining the healthy economic outlook and favorable growth prospects by applying an appropriate macro-economic policy mix”. 7

11. Modification of the Lisbon Strategy by the European Council in 20057a The Council modified the original Lisbon Strategy (Agenda) to focus mainly on growth creation and jobs. The overall objectives were defined as: “delivering stronger, lasting growth and creating more and better jobs in order to unlock the resources needed to meet Europe’s wider economic, social, and environmental ambitions, thus making Europe a more attractive place to invest and work while improving knowledge and innovation for growth in Europe.”7a Economic modernization was seen to be the key “to increased growth and jobs, as well as to maintain Europe’s unique social model in the face of increasingly global markets, technological change, environmental concerns, and demographic changes.”7a

12. The Elements of the Original Tuning Process that Began in Europe • Tuning Educational Structures in Europe (Tuning Europe)[September 1999] was the name of a project and process “that was designed and implemented ‘by and for universities’ and led to the development (in phases) of an operational methodology for the design of degree programmes in specific thematic areas within the framework of the emerging common education space in Europe” (i.e. The EHEA).2 “It became known as the universities’ response to the Bologna Challenges put to them by their Governments.”2 • It was recognized from the beginning of the Bologna Process that to achieve its overarching objectives (see earlier slide) especially as the fundamental locus of reform (i.e. the universities, their faculty, and their programs) that there had to be a focus on qualifications (degrees). This meant achieving an understanding of what elements constituted a qualification (degree).3

13. Five educational bodies at the Ministerial European Union and University levels were engaged in this task: (1) TheMinisters of Higher Education through their declarations from biennial meetings (1999-2010)during The Bologna Process; (2) The Joint Quality Initiative Group within the Bologna Process; (3) The European University Association (EAU) that issued “Trends” reports on the progress of Bologna-related reforms before each Ministerial meeting; (4) The Council of Europe-Higher Education; and (5) The Tuning Educational Structures in Europe Project.3 • The Ministers, in their Communique’ following the Berlin meeting (2003), and in response to input from the other influencing groups, stated: “ Ministers encourage the member States to elaborate a Framework of comparable and compatible qualifications for their higher education systems (re-affirming the Bologna Declaration goal), which should seek to describe qualifications in terms of workload, level, learning outcomes, competencies, and profile”.Learning outcomes were to be the “dominant characteristic of the Bologna-degrees”. 3

14. The European Tuning Project provided this very first definition of the new Bologna Degree (2003): “Qualification awarded by a higher education institution after successful completion of a prescribed programme of study. In a credit accumulation system, the programme is completed through the accumulation of a specified number of credits awarded for the achievement of a specific set of learning outcomes.”3 • The determination of the essential constituent elements of the degree by the Tuning Process required five different lines of investigation: (1)Generic competences; (2) Subject-specific competences; (3) European credits; (4) Approaches to Teaching, Learning, and Assessment; and (5) Program Quality. These investigative studies led to the first definition of European Tuning Degree components: (1) Profile; (2) Learning Outcomes and Competences (generic and subject-specific); (3) Workload; (4) Levels of Qualifications; (5) Teaching/Learning and Assessment Methodologies; and (6) Program Quality. 3

15. These components were to become essential parts of the description of disciplinary degrees at all three degree (qualification) levels known as the Degree Profile. 3 • Attention to the need to preserve the cultural diversity of the national higher education systems and their qualifications was a critical recognition from the start of the Bologna Process and Tuning in Europe. It was reinforced by the continuing Ministerial Communiques’. As has been stated “The tensionbetween the identification of the common and the richness of the diverse runs in each of the documents of the Tuning Process”. 3

16. The Evolution of Tuning European Structures (i.e. Tuning Europe)2,3 • Initial Tuning Project (Tuning Europe) that began in 1999: • Defined Common language and methodology for updating or creating a degree program (grass roots level). The approach was student-centered and defined average student workload measured in ECTS credits. The objective of degree programs was defined as each learner achieves well-defined learning outcomes at the end of the educational process, through which the learner acquires competences important for future life, both professional and personal.2Learning Outcomes, at both degree and course levels are defined by the subject area faculty through large multinational consensus from dialogue/debate and the other stakeholders (student, employers, alumni, etc.). 2 • Through Subject Area Groups (SAGs), in concert with Thematic Network Projects (TNPs) of the Socrates Program, “Tuning Reference Points (both subject specific and generic student learning outcomes) were defined for nine subject areas (Business, Chemistry, Earth Sciences, Education Sciences, European Studies, History, Mathematics, Nursing, and Physics). These were provided for European educators in nine Tuning Brochures.2

17. The European Commission in 2002 recommended that the approximately 35 Socrates TNPs Adopt Tuning in their own projects. This resulted in “Tuning Reference Points” and Brochures in 24 more subject areas.2 This collaboration, in turn, led to the creation of two European Tuning Information and Counseling Centers and 38 national Tuning Information Points (TIPs). 2 • Tuning Europe entered into a partnership (2005) with The European Organizations responsible for the recognition of academic and professional degrees (qualifications) in the European Commission and Council of Europe/UNESCO. These partners, the European Network of Information Centres (ENIC) and National Academic Recognition and Information Centres (NARICS), in order to promote a process of objective descriptions of theDegree Profile, created a project called Competences in Recognition and Education. Its phase 2 had the acronym CORe2.2,8a

18. Competences in Education and Recognition Project (CoRe)8a A Tuning Guide to Formulating Degree Programme Profiles Including Programme Competences and Programme Outcomes JennekeLokhoff and Bas Wegewijs (Nuffic)Katja Durkin (UK NARIC)Robert Wagenaar, Julia Gonzlez, Ann Katherine Isaacs, Luigi F. Dona dalle Rose and Mary Gobbi (TUNIING) EditorsBilbao, Groningen and The Hague, 2010

19. The Goal of the Bologna Process to Increase Student and Graduate Mobility Across the Borders of the Countries Within the European Higher Education Area Requires More than a Definition of the “Bologna Degree” and Creation of Degree Profiles from Tuning.2,3 Frameworksof Common Reference Points for Learning Outcomes and Competences at the National and European Levels were found to be Necessary.

20. The Qualifications Frameworks6,8 As the Bologna Process and Tuning Europe progressed with the creation of the Bologna Three Cycle Qualifications (bachelor-type, master-type, and doctoral type degrees) and an understanding of the nature of degrees at all levels through Tuning, the Ministers of Higher Education in the participating countries (2003, Berlin) requested that each country develop a National Framework of Qualifications(NFQ) and an overarching European Qualification Framework(EQF). For the 3-cycle ‘Bologna Degrees” this first framework was termed the Bologna Framework, developed by a working group appointed by, and reporting to, the Bologna Follow-up Group (BFUG). The Ministerial Conference in Bergen (2005) adopted this Framework.6 National Qualifications Frameworks must include the broad consensual sets of learning outcomes for all educational qualifications of each country. Learning outcomes, or what students are expected to know, understand, and be able to do on the basis of a given qualification. Their definition is a result of collaboration within a broad consultation process involving all of the previously mentioned stakeholders. 6,8

21. Once the national qualifications have been developed, they must be tested and certified to demonstrate that they are consistent with the EQF. The Bologna Process has published a 10-Step Guide for Developing National Qualifications Frameworks.6 Important among these 10 steps are three that are relevant to the forthcoming discussion of Tuning USA: • “Approval according to national tradition by Minister/Government/Legislation; • Implementation at the institutional/programme level; reformulation of individual study programmes to learning outcomes-based approach; and • Self-certification of compatibility with the EHEA Framework, (i.e. EQF) including alignment to the Bologna cycles, etc”6

22. The rationale for the Bologna Framework, according to the Official Bologna website6 is to provide a mechanism to relate the different national qualifications frameworks to each other so as to enable: (a) “International transparency – this is at the heart of the Bologna process and while devices, such as the Diploma Supplement, have a role to play in this objective, it is difficult to ensure that qualifications can be easily read and compared across borders without a simplifying architecture for mutual understanding. (b) International recognition of qualifications – this will be assisted through a framework, which provides a common understanding of the outcomes represented by qualifications for the purposes of employment and access to continuing education. (c) International mobility of learners and graduates – this depends on the recognition of their prior learning and qualifications gained. Learners can ultimately have greater confidence that the outcomes of study abroad will contribute to the qualification sought in their home country. A framework will also be of particular help in supporting the development and recognition of joint degrees from more than one country.” 6

23. The first, second, and third cycles (bachelor degree-type, master-degree-type, and doctoral degree-type respectively“)of the Bologna Process are the key qualifications in the overarching Bologna Framework. These degrees (cycles) are referenced to a set of descriptors, called the “Dublin descriptors” developed jointly by the Bologna stakeholders across Europe (Working Group on Qualifications Framework, 2005). “They are broad and general in nature to both a wide range of disciplines and degree profiles and the national variations in how qualifications (degrees) have been developed and specified.”6 A process was established that would require all National Qualifications Frameworks to be compatible with the Bologna Framework. This process includes a detailed series of procedures and criteria, “that includes the designation of competent bodies responsible for the maintenance of the Framework by the national ministry with the responsibility for higher education, a clear and demonstrable link between the qualifications in the national framework and the cycle descriptors of the Bologna Framework. The existence of national quality assurance systems consistent “with the communiqués agreed upon by the ministers in the Bologna Process.6

24. There is sometimes confusion among educators in other countries outside of Europe regarding the overarching Bologna Framework and the second overarching Framework called the European Qualifications Framework for Lifelong Learning (EQF) also called for by the Ministers.6 The EQF is a much broader Framework designed to incorporate all education and training awards in Europe, including prominently, the 3-cycle degrees of the Bologna Process. This Framework resulted from recommendations coming out of an April 2008 meeting of the European Parliament and European Council. From the official Bologna Communications the rationale and purposes are described: • “The EQF aims to establish a common reference framework as a translation device between different qualification systems and their levels. This framework comprises general, higher and vocational education and training, and should lead to better transparency, comparability and portability of citizens’ qualifications (e.g. diplomas, certificates etc.)

25. The EQF recommends that each level of qualification should, in principle, be attainable by way of a variety of educational and career paths. This should foster lifelong learning and increase the employability, mobility and social integration of workers and learners. The recommendation should also facilitate building bridges between formal, non-formal and informal learning. • The EQF neither replaces nor defines national qualification systems nor  qualifications. It does not describe any particular qualifications or individual competences, but describes the eight EQF levels via descriptors for the three categories “knowledge”, “skills” and “competences”.9 Note the intent in encouraging lifelong learning as a critical need for the EHEA. The intent of the European Council that all participating countries will align their national Frameworks of qualifications with the EQF by 2012. This is still a work in progress.6,8,9

26. An excellent example of the relationship of the various qualifications, awards, certificates, etc. in the 8-level EQF is provided by the Quality and Qualifications Ireland (QQI). This is the National Coordination Point for the EQF.2 Note that vocational education qualification are included.10

27. The next phase in Tuning Europe began in 2008 in response to the establishment of National and European Qualifications Frameworks called for by the European Ministers of the Bologna Progress in their communique of the Berlin (2003) and Bergen Conferences (2005).2,3 This response to the now existing Bologna National and European Qualifications Frameworks was for Tuning Europe to develop Sectorial Qualifications Frameworks (SQF).2

28. Five Sectors were identified: Natural Science, Health Sciences, Humanities and Arts, Social Sciences, and Sciences and Technology. For each broad sector the SQF consisted of faculty-identified Tuning Reference Points. Two SQF projects were funded: Humanities and Fine Arts (HUMART) and Social Sciences. They resulted in the identification of 8 new Tuning Reference Points. In the Social Science SQF, these were in International Relations2, Law, Psychology and Social Science. For the HUMART SQF these were in Art, History, Literary Studies, Linguistics, and Theology/Religious Studies.2 Tuning Europe has also partnered with the Organization for Economic Co-operation and Development (OECD) on the development of a global test of student achievement of students in Economics and Engineering. Tuning Reference Points were developed for these two disciplines.

29. To date this makes 43 subject areas for which Tuning Reference Points have been produced. In addition, 31 generic competences have been identified by Tuning Europe.2 The global test project, “Assessment of Higher Education Learning Outcomes” (AHELO) is still in its validation stages and has generated concern in some quarters. 2 • Tuning Europe is now at the stage of the Tuning Academy, announced in 2008 and launched in 2011.2 The Academy has, in turn, launched two new initiatives that have recently taken form: (1) the Tuning Journal in Higher Education with the twin goals of creating continuing generations of new Turning individuals and dissemination the outcomes of Tuning; and (2) the meta-profile concept and its attendant process. 2

30. As discussed in two recent publications 2,3in the new Tuning journal, the Meta Profile: • “makes explicit the relationship and hierarchy among competences in a given subject area (i.e. discipline); the earlier lists of generic and subject-specific competences are merged into a reasoned structure of competences;” 2 • “includes innovative competences as a source of inspiration for concrete programme re-planning in the given subject area;” 2 • Facilitates and enriches “the dialogue between the European Tuning Community and Tuning processes elsewhere in the world, notably Latin America, Russia, and Africa, where the coverage of subject areas tends to be similar to European ones; 2

31. is built, by subject area, at the level of the region and its participating countries (e.g. Europe, Latin America, and Africa) “jointly built, owned, and later validated at regional level. There is normally a further level of comparison with other world regions and eventually at global level. However, this way of reaching the global level implies that it is again (as everything in Tuning) a bottom-up approach” (i.e. local level-centered); 3 • finally, serves to greatly facilitate joint and double degrees and international student exchanges. 3

32. Why Tuning USA?

33. The Tuning Educational Structures in Europe Project gained the attention and earned the respect of a growing number of U.S. educators, policy experts, major educational associations, and the Lumina Foundation.1,1a • This has been facilitated by an increasing number of presentations by U.S. and European educators working on the Bologna Process to the annual conferences of the major international education associations in the U.S. (e.g. NAFSA, AIEA, CGS, AACRAO) since 2002.1,1a • Global education is borderless and the U.S. is a global player.

34. The Tuning Europe Process associated with, and serving, the 49 Bologna signatory countries of Europe (from 2005) has now spread to many other regions of the world2,3,11: • Tuning Latin America (in 2005) initially with 12 disciplines, more than 180 universities, and 18 countries, now in second expanded phase (2011 to present) http://www.tuningal.org • Tuning Russia (in 2011 to present) http://www.russia.org • Tuning Africa (in 2011 to present) began with 5 disciplines in 5 regions http://www.africa.org • Pilot in Australia -stared 2010-2011 • Pilot in China – started 2012-2013 • Each Tuning project utilized similar processes but with different but related goals (e.g. Europe-cross border mobility and comparability of degrees; Latin America, institutional cooperation).

35. The Lumina Foundation saw “Tuning” as a major opportunity to support its “Big Goal” of “increasing the percentage of Americans with high quality two or four-year college degrees and credentials from 39% of the population to 60% by 2025, an increase of 23 million graduates above current rates.” Lumina established and funded the first U.S. Tuning.1a,12,13 Pilot project: TUNING USA, co-funded by the William and Flora Hewlett Foundation.14

36. “Tuning USA: Lumina Foundation launches faculty-led process that will involve students and employers in linking college degrees to workforce relevance and students’ mastery of agreed-upon learning objectives.” April 8. 2009 – News Release, Lumina Foundation

37. “What the United States lacks is a comprehensive approach to defining learning outcomes representative of degrees in specific disciplines across different degree levels. Lumina wants to determine whether Tuning offers a potential approach for the U.S. to better define higher education learning outcomes on a larger scale.” Cliff Adelman13

38. The Tuning USA Pilot Program Contributes to six key benefits:14 • “Facilitating student success and retention, especially among students from underserved groups, by creating clear expectations for, and pathways to, degree completion; • Simplifying the process for students transferring credits between institutions; • Emphasizing lifelong learning and important but often undervalued transferable skills; • Aligning the roles of higher education institutions; Increasing higher education’s responsiveness to changes in knowledge and its application; • Ensuring that the knowledge and applied skills associated with coursework align with civic, societal, and workforce needs.”

39. Tuning USA’s Principal Advisors14 Dr. Tim Birtwistle, a Bologna expert and emeritus professor at Leeds, Metropolitan University in the United Kingdom Dr. Clifford Adleman, senior associate, Institute for Higher Education Policy Dr. William Evenson, an emeritus physics professor, form university administrator and consultant to the Utah State Board of Regents Dr. Robert Wagenaar, a professor at the University of Groningen in The Netherlands, and co-coordinator of the projects Tuning Educational Structures in Europe, Tuning South-East and Eastern Europe, Tuning Latin America, Tuning Russia, and Tuning Georgia.

40. Tuning USA’s Operational Partner: the Institute for Evidence-Based Change (IEBC).1a,14 • Serves as the primary consulting group for states and associations that initiate the Tuning USA initiative; • Serves as a expert staff resource, guide, problem-solver, and advisor through the multi-stage Tuning process, from concept paper to implementation; • Serves as a collaborator with the IHE-appointed Faculty Tuning Working groups, the state higher education governing boards, and other stakeholders to continually improve the Tuning USA process; • Is charged by Lumina and the Tuning USA Advisory Board to expand the initiative nationally; • Works with U.S. faculty consultant experts on the Tuning European Structures and Bologna Process and their differences from Tuning USA; and • Performs analyses and evaluative instruments to assess the success of Tuning USA Projects in achieving the project goals.

41. Tuning USA’s Tuning Process“Tuning American Higher Education: The Process”

43. Define Draft general degree profile Identify core concepts Draft competency statements Draft measurable student learning outcomes Figure 1: The base structure of a Tuning Initiative Discipline Core Map Career Pathways Research student career destinations Develop career pathways map Consult Stakeholders Identify stakeholders Draft survey instruments or focus group protocols Gather stakeholder input Hone Discipline Core Implement Review stakeholder feedback Review discipline core in light of feedback Locally Identify departmental assets/priorities/missions Emphasize departmental distinctiveness Write degree specifications for each degree level

44. The Outcomes of “Tuning European Structures” and “Tuning USA”: Degree Profiles and Degree Specifications, Respectively1a,14

45. Components of the Degree Profile in Europe8a • Title Field: Full name of the degree (qualification) in original language (and English translation) • Full name of the programme offered by the institution • Type of degree (cycle) and length; name of awarding institution(s); accreditation organization(s) • Purpose: General statement about the degree program (2 sentences) • Characteristics: Main subject areas/disciplines of the degree programme; orientation (research, practical, professional, applied, etc.); distinctive features (that distinguish it from other similar degree programmes)

46. Employability and Further Education: Employment opportunities (3 sentences); further studies (opportunities for access to further studies (e.g. Master programmes) • Education Style: Main teaching and learning strategies and methods • Programme Competences: List of generic and specific programme competences • Complete List of Programme Learning Outcomes: All learning outcomes up to total of 20.

47. Degree Specification Template From Tuning USA14 Institution Name & Department Degree Name This field can be used to provide a succinct statement of a Purpose department’s philosophy as it relates to the specific degree level. The field might begin with a more general statement about the nature and purpose of the degree. This field can highlight the distinctive features of the Characteristics degree track, including disciplines and featured subject areas, general and specific focuses, etc. This field identifies possible destinations of the degree Career Pathways program’s graduates. This field identifies the department’s particular learning/ teaching approaches, such as lectures, small seminars, Education Style and labs, and describe the assessment methods used by the department, such as discursive tests, analytical papers, culminating research projects, and comprehensive exams. This field lists the program-level learning outcomes, Program organized by competency area, that were developed by Competencies & the Tuning work group. It should also include additional Outcomes competencies and their relevant learning outcomes in addition to those developed by the Tuning work group.

48. Lumina Foundation’s Degree Qualifications Profile (DQP)15 • The second version, DQP 2.0, enhances the first iteration, launched in January 2011 by incorporating the input of almost 400 colleges and universities that have used this guide. “In addition, four of the seven regional accrediting associations and constituency organizations such as The Council of Independent Colleges (CIC), The American Association of State Colleges and Universities (AASCU), and the Association of American Colleges and Universities (AAC&U) have found the DQP a stimulus to creative and innovative projects.” 15 • The DQP 2.0’s authors are:Dr. Cliff Adelman, senior associate at the Institute for Higher Education Policy (IHEP); Dr. Peter Ewell, vice president at the National Center for Higher Education Management Systems (NCHEMS); Dr. Paul Gaston, trustees professor at Kent State University and author of The Challenge of Bologna; and Dr. Carol Geary Schneider, president of the Association of American Colleges & Universities (AAC&U) and Dr. Tim Birtwistle, UK Bologna Process Expert, Consultant at “Tuning USA,” and Professor Emeritus, Leeds Metropolitan University, also has provided guidance and expertise .

50. The Essential Elements of the DQP 2.015 • The fundamental elements of the DQP are the “succinct, active definition of what degree recipients know and are able to do at each degree level (associate, bachelor’s, and master’s)” regardless of field of study (discipline). The DQP “describes concretely what is meant by each of the degrees addressed.” • “The DQP describes generic forms of student performance appropriate for each degree level through clear reference points that indicate the incremental, integrative, and cumulative nature of learning.” Clarity and consensus on these reference points is the goal and certainly not “standardization” of U.S. degrees. • The reference points of the DQP are expressed as proficiencies (rather than competences) because the DQP learning outcomes are written using active verbs (e.g. “identifies”, “categorizes”, “prioritizes”, etc.) because such verbs describe what students actually do when they demonstrate proficiency through assignments (e.g. performances, projects, examinations, exhibits, etc.)