Implementing the New Curriculum Inventory Standard:

1. Implementing the New Curriculum Inventory Standard: Will our current curricular systems meet the needs? Susan Albright -Tufts University Marc Triola – New York University

2. Agenda • Tufts Implementation and Challenges • NYU Implementation and Challenges • Benefits of Implementation

3. What is TUSK? • Enterprise educational system which contains the following elements: • Curriculum Management • Course Management • Content Management/Delivery(computer and cell) • Personalized Knowledge Management • Clinical Teaching • 250 + Database Tables • http://opentusk.org

4. School-wide Competencies TUSK Data Model Teaching Sites Time Periods Users Sequence Objectives Users Groups Groups Sequence Blocks (courses) Sequence Blocks (courses) Sequence Blocks (courses) Schedule: Who What Events Event Types When:Time Faculty UMLS Keywords • Events: • Content Learning objectives

5. Umls Keywords Selected by System

6. Tufts: Clerkship events Black Box Black Box

7. Where in the world is TUSK? • Domestically • New York Medical College • Emory • U. Hawaii • Einstein Medical School • Tufts (Medical, Dental, Vet, Public Health, Graduate Biological Sci’s) • Others thinking!!! International • Makerere – Uganda • Muhas – Tanzania • Karolinska – Sweden • St. Johns – Bangalore • CMC – Vellore • KAU- Saudi Arabia • Planned • Congo, • Ethiopia, • Thailand • Ghana

8. Sorting things outorWhere in the Database is everything? Metadata? What elements do we store? What is missing? • Sequence Blocks within Sequence Blocks – parent and child courses • Levels of Courses are implied by the groups associated … what to do with 4th year courses? • Resources?

9. TUSK: Curriculum Report Mapping Competencies stored with content in events – events will have to inherit from content Academic Level implied from group associated with course Course table – joined with class meeting table Class meeting table – events, type, title, duration

10. Challenges to Cope with • At Tufts • Decentralized data entry • Multiple data entry points- will it be done comprehensively? • Build tool that links competencies - one to many relationship. Build the tool so that is human readable an useful for curricular development • Add missing data elements - some of which are implied • Clerkship data • What resources used • At other institutions • Access to data from multiple systems • Access to data from proprietary systems (another black box)

12. NYU Curriculum Data • LMS: Sakai • Evaluation: Vendor system • Various home-grown systems • Education Data Warehouse: Pentaho/MySQL

13. NYU Curriculum Data: Mapping to XML • 2006 Events • 1491 Objectives • 364 Goals • 1024 keywords

14. NYU Curriculum Data: Data Challenges • Compliance overall, especially clerkships • Description field is used for a variety of purposes. • Many entries include student names • Very few vocabulary-based key words • No quantitative data on Inter-professional activities

15. NYU: Academic Event <Event id="482cabb1-3a93-454e-b8cb-b84778fb9013"> <EventCategory>Class section - Lecture</EventCategory> <Title>Defense against infection/ Ernst</Title> <EventDuration>PT1.0H</EventDuration> <keyword hx:source = "UMLS" hx:id = "None"> <string language = "en">Infections</string> </keyword> <keyword hx:source = "UMLS" hx:id = "None"> <string language = "en">Immune System</string> </keyword> <keyword hx:source = "UMLS" hx:id = "None"> <string language = "en">Flu</string> </keyword> <ComptencyObjectReference>/CurriculumReport/Expectations/CompetencyObject[lom:lom/lom:general/lom:identifier/lom:entry="g_482cabb1-3a93-454e-b8cb-b84778fb9013"]</ComptencyObjectReference> <ComptencyObjectReference>/CurriculumReport/Expectations/CompetencyObject[lom:lom/lom:general/lom:identifier/lom:entry="o0_482cabb1-3a93-454e-b8cb-b84778fb9013"]</ComptencyObjectReference> <ComptencyObjectReference>/CurriculumReport/Expectations/CompetencyObject[lom:lom/lom:general/lom:identifier/lom:entry="o1_482cabb1-3a93-454e-b8cb-b84778fb9013"]</ComptencyObjectReference> <ComptencyObjectReference>/CurriculumReport/Expectations/CompetencyObject[lom:lom/lom:general/lom:identifier/lom:entry="o2_482cabb1-3a93-454e-b8cb-b84778fb9013"]</ComptencyObjectReference> <ComptencyObjectReference>/CurriculumReport/Expectations/CompetencyObject[lom:lom/lom:general/lom:identifier/lom:entry="o3_482cabb1-3a93-454e-b8cb-b84778fb9013"]</ComptencyObjectReference> <ComptencyObjectReference>/CurriculumReport/Expectations/CompetencyObject[lom:lom/lom:general/lom:identifier/lom:entry="o4_482cabb1-3a93-454e-b8cb-b84778fb9013"]</ComptencyObjectReference> </Event>

16. NYU: Competency Objects <CompetencyObject> <lom:lom> <lom:general> <lom:identifier> <lom:catalog>URI</lom:catalog> <lom:entry>o2_b32f23a4-47c5-4edd-9c78-7189b52cbd6e</lom:entry> </lom:identifier> <lom:title> <lom:string language="en">Objective</lom:string> </lom:title> <lom:description> <lom:string language="en">Practice communicating empathy through use of both verbal (PEARLS statements) and non-verbal responses to emotions</lom:string> </lom:description> </lom:general> </lom:lom> </CompetencyObject>

17. NYU: The curriculum for the 21st Century • Overall this draft standard worked well for our curriculum • Required direct access to our Education Data Warehouse and new programming to extract and transform the data into a linked XML report • Already being used to drive improved meta-data at our institution

18. Benefits • NYU • Tufts