Industrial Technologist’s Toolkit For Technical Management (ITTTM) Assessment Overview:

1. Industrial Technologist’s Toolkit For Technical Management (ITTTM) Assessment Overview: Orientation Tutorial Presentation 4 • 1. Explanation of this presentation, context • Courseware process structure, portfolio • Assessment levels, types, outcomes • Portfolio outcome assessment matrix (POAM) • Review, broader ITTTM relationships Dr. John W. Sinn, Professor, Bowling Green State University jwsinn@bgnet.bgsu.edu, www.bgsu.edu/colleges/technology/qs

2. Explanation Of This Presentation, Context This is the fourth of four related presentations used to help you understand and use ITTTM courseware. The four ITTTM orientation tutorials can help you see relationships in core knowledge and technical management as part of ITTTM. The four related presentations are: 1. ITTTM Introduction, Overview 2. ITTTM Content Overview 3. ITTTM Process Overview 4. ITTTM Assessment Overview

3. ISO Total Quality, Baldridge Leadership Context, Continuous Improvement Analysis, Global Views, Values Quality Management System Integration, Pragmatic Field Information Interaction, Problem Solving, Decision Making Synchronous Tools, New Product Development Documentation Tools, Lean Resource Management Measurement Analysis Improvement Applied Research, Project Team Primer Inputs Professional Outputs Data Tools, Six Sigma Service, Tools Manufacturing, Non-Manufacturing Management Responsibility Product Realization Communication, Internal, External, E-commerce Disciplined Knowledge, Research And Development Cultural Change, Industrial And Academic Core Values Model System: Industrial Technologists’ Toolkit For Technical Management (ITTTM) Explanation Of This Presentation, Context

4. Explanation Of This Presentation, Context • Six sets define core, overview 42 tool courseware system: • Primer Tools • Cultural Tools • Data Tools • Documentation Tools • Service Tools • Synchronous Tools • Tool set is about a course, used as base for assessment • Electronic structure is flexibile for strong communication • MS Word Office Suite tools aid in assessment Portfolio development, assessment, six tools……… startup activity in course is where assessment begins

5. Courseware Process Structure, Portfolio • Courseware forms have important portfolio structure: • SDA’s, RCA’s, documents, grows portfolio around project • Initial individual responses by each become grand forms • Format guides project, details structure of portfolio • Analysis, reflection, writing are introspective assessment • RCA’s evolve with project, iteratively document progress • SDA’s, content assessments of tool applications in project • Systematic, disciplined, structure for communication RCA and SDA format as key assessment vehicle………

6. Courseware Process Structure, Portfolio RCA’s, SDA’s help team assess project progress, improve based on ITTTM tools, systematic portfolio development 1. Regular Critique Assessment (RCA’s) 2. Standard Dedicated Audit (SDA’s) 3. RCA’s Grows, SDA Different Each Tool 6. RCA’s Improve, Format As Portfolio 5. Analyze, Synthesize, Question Project 4. Grow Knowledge, Assess Project Work

7. Courseware Process Structure, Portfolio • ITTTM courseware facilitates team project with technical management content applied for assessment in portfolio: • Course format grows technical management system • Forms require team analysis, management via PPDPOA • Content areas researched, detailed, “do” project processes • Form questions assess ISO/QS 9000 project relationships • Work posted by each is one content analysis, interpretation • At phase review enhanced SDA’s as grand form, portfolio • Phase portfolio documents progress compared to startup All available electronically for portfolio assessment………

8. Courseware Process Structure, Portfolio Courseware facilitates a long form report, portfolio developed with the SDA and RCA forms, tools……… 1. Tools Completed, Assessed, Improved 2. Phase I Portfolio Total Long Form Work 3. RCA’s, SDA’s Done Continuously In Each Tool 6. Long Form Does Project, Improvement Assessed 5. Total Long Form, Phase II, Final Portfolio 4. Growth In Knowledge, Team, From Assessment

9. Courseware Process Structure, Portfolio Team, project facilitates a short form, Power Point compatible with portfolio, to explain long form……… 1. Short Form Power Point Grown Iteratively 2. As tools, Phases Done, Short Form Evolves 3. Short Form Is An Executive Summary 6. Short Form Stands Alone, No One To Explain…… 5. Uses 15-18 Slides, Not Duplicating Long Form 4. Explains Growth In Knowledge, All Functions

10. Assessment Levels, Types, Outcomes • ITTTM interfaces with various assessments, outcomes: • Self assessment, goals set by individuals at start, various points along the way to guide progress • Course assessment, course outcomes, objectives provide assignments reflecting curriculum • Collegial, university assessment, broad-based values, curricular requirements relating to general education • Professional assessment, advisory groups, professional bodies to validate, certify, accredit skills, knowledges ITTTM electronic courseware interfaces, documents various technical management outcomes for assessments.

11. Assessment Levels, Types, Outcomes ITTTM courseware is course level assessment vehicle, via syllabus, statement of anticipated student outcomes 1. Syllabus Identifies Outcomes, Content 2. Content Leads To Rubrics, Metrics 3. Learning Activity Defined As Matrix 6. Content Synthesis, Feedback, Portfolio 5. Matrix In Syllabus Guides Portfolio 4. Syllabus Matrix Blend Assessment, Courseware

12. Assessment Levels, Types, Outcomes Course outcomes drive the assessment process, defining key deliverables, syllabus focus. Examples in a course include: • Change, improvement and people. Change, improvement in services is studied, focused on “human issues”. • 2. Global, local quality, technology service relationships. Student teams do service projects focused on assessment. • 3. Auditing ISO/QS 9000 services. ISO/QS 9000 systems provide a platform, documentation systems for audit. Usually three to five course outcomes identified, content expands the definition of what actually gets studied. All of this is part of the typical syllabus related to ITTTM.

13. Portfolio Outcome Assessment Matrix (POAM) Course outcomes are further defined in the POAM, a matrix assessment system with all desired requirements: • Course outcomes stated in achievable terms • Content tied to course outcomes, relationally • Values reflecting broader educational, professional norms • All basic, general requirements to be met The POAM matrix provides a mechanism to assess work done by teams, and give feedback for improvement at the course level, part of the typical syllabus related to ITTTM. POAM is shown in next slide with all elements as original.

14. Portfolio Outcome Assessment Matrix (POAM)

15. Portfolio Outcome Assessment Matrix (POAM) Top and bottom of form, is important general information, and how to assess persons on team individually as needed: General use of POAM stated, broader context defined, part of ITTTM Work done by individuals, posted in discussion area, assessed as separate points General team, project assessment information, total points awarded

16. Portfolio Outcome Assessment Matrix (POAM) Each outcome, defined in POAM, provides response from instructor, assessment to requirements, and points earned: Outcome is stated, context explained Feedback for improvement potentials is explained here Rubrics, specific areas, items assessed, described as courseware, project portfolio relationships Possible (P) points for rubric, outcome identified and actual (A) space for assigned value

17. Portfolio Outcome Assessment Matrix (POAM) Context of course outcomes, broad relationships in ITTTM, reflecting ISO quality elements, BGSU core values, to derive anticipated general programmatic outcomes, rubrics………

18. Review, Broader ITTTM Relationships • This was the third of four presentations to help understand, • use ITTTM courseware. The four presentations in the • ITTTM Orientation Tutorial folder include: • ITTTM Introduction, Overview • ITTTM Content Overview • 3. ITTTM Process Overview • 4. ITTTM Assessment Overview • After viewing these, best in order, you can review or use the • courseware provided in the ITTTM 42 Tools folder. Give • feedback by using forms in the ITTTM Research Folder. • Contact the author at jwsinn@bgnet.bgsu.edu