1 / 22

Presenter: Vathsala I. Stone vstone@buffalo

Psychometric Properties of the Level of Knowledge Use Survey (LOKUS) Tool (Shreya Telang, Machiko Tomita, Vathsala Stone). Presenter: Vathsala I. Stone vstone@buffalo.edu University at Buffalo/Center on Knowledge Translation for Technology Transfer http://kt4tt.buffalo.edu

elaine-hart
Download Presentation

Presenter: Vathsala I. Stone vstone@buffalo

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Psychometric Properties of the Level of Knowledge Use Survey(LOKUS) Tool(Shreya Telang, Machiko Tomita, Vathsala Stone) Presenter: Vathsala I. Stone vstone@buffalo.edu University at Buffalo/Center on Knowledge Translation for Technology Transfer http://kt4tt.buffalo.edu NARRTC Annual Meeting, Apr. 27, 2011

  2. Background Overall Context: Knowledge Translation (KT) (CIHR, 2009; Sudsawad, 2007). Knowledge (Evidence)  Practice  Impact on beneficiaries Specific Context: Technology based Research - Sub-optimal level of demonstrated impact from R&D investment KT4TT Center: Develop KT models, methods & metrics for technology based R&D Conducting “end-of-grant” KT interventions in 3 technology areas – Augmentative and Alternative Communication (AAC), Environmental Access & Wheeled Mobility. LOKUS measures Knowledge Use as indicator of intervention effectiveness.

  3. Background (contd.) KT Intervention Project in AAC Selected AAC Study (new knowledge): End-of-grant; NIDRR funded; Innovative Intervention strategy: Contextualized Knowledge Package (CKP) + Training (webinars) + Technical Assistance Effect on 6 types of Knowledge Users (stakeholders): Manufacturers; Clinicians; Transition Brokers; Researchers; Policy makers; Consumers with disabilities

  4. Level of Knowledge Use Survey (LOKUS) tool seeks to: identify the level of use (and the corresponding categories) ofnew knowledge generated by technology-based research (attained) by stakeholders(users) of that knowledge. Developed by the Knowledge Translation on Technology Transfer (KT4TT) Center Based on Hall et al (2006) Psychometric study of LOKUS conducted by Shreya Telang (2011).

  5. Development of LOKUS: Content Validation Tool based on Hall’s (2006) framework - Levels and Categories - educational setting. Expert testing of items – 3 KT scholars and 4 Technology Transfer (TT) experts. Tool showed 100% Face Validity. Tool altered: added/changed levels, eliminated irrelevant categories; closer to KT4TT context. Web version pilot tested by 6 individual stakeholders. Resulted in LOKUS, subject of this study.

  6. Framework for Item distribution in LOKUS (Based on Halls et al, 2006)

  7. Focus of the Psychometric Study Reliability Test-Retest Alternate Assessment method (Web based Vs. Paper-and-Pencil method) Responsiveness to change Ability to detect changes in knowledge use over time; Examination of Developmental nature of levels and categories.

  8. Method: Research Design

  9. Method: Participants Represent one of the 5 stakeholder types in the KT4TT Center intervention project – the “Clinicians”. Inclusion: College Students / faculty members from allied health disciplines (Occupational therapy, nursing…..) and clinicians experienced in AAC; 18 years or older; Exclusion: participation in similar survey/focus group within past 6 months. Sample Size:Based on power analysis. large effect size d =.94 (Colbert, 1977); N = 64 (needed); 72 recruited, pre-screened and randomly assigned to two groups; Final N = 69 (35, paper-and-pencil, 34 web based).

  10. Method: Intervention LOKUS items asked about New Knowledge from 3 NIDRR funded published studies in AAC - Study A, Study B and Study C. To identify Responsiveness to changes, a simulated Intervention condition was introduced between T2 and T3 by providing a CKP on Study A (treatment) only to both groups. and no CKP on the other two studies (controls).

  11. Method: Data Analysis

  12. Results: Demographics There was no significant difference between the two groups regarding: Age ( t = .757; p = .452); AAC experience (t = .880; p = .382); Gender (chi sq = 1.292; p = .256); Marital status (chi sq = 4.872; p = .301) and Education (chi sq = 1.003; p = .793)

  13. Results: Test-Retest Reliability

  14. Results: Responsiveness to Change

  15. Results: Difference between the Methods

  16. Number who moved up levels at T3

  17. Summary and Conclusions LOKUS demonstrated: Good Face Validity. Excellent Test-Retest Reliability for both levels & categories. Good responsiveness to detect change regarding use of New Knowledge. Developmental nature for lower levels. LOKUS is a usable tool at least for AAC field. Longitudinal study needed to extend conclusion for higher levels and for categories.

  18. Key References CIHR. About knowledge translation. Retrieved October 25, 2009, fromhttp://www.cihr-irsc.gc.ca/e/29418.html Hall, G.E., Dirksen, D.J., and George, A.A. (2006). MeasuringImplementation in Schools: Levels of Use. Austin, TX: SouthwestEducationalDevelopmentLaboratory (SEDL). Lane, J.P., Stone, V.I., Bauer, S. M., Leahy, J.A., and Tomita, M.R. (2008). Center on Knowledge Translation for Technology Transfer. Proposal submitted to National Institute for Disability and Rehabilitation Research (NIDRR)’s Disability and Rehabilitation Research (DRRP) Program (84.133A-7). Sudsawad, P 2007. Knowledge Translation: Introduction to Models, Strategies, and Measures. Austin: Southwest Educational Development Laboratory, National Center for the Dissemination of Disability Research. (p.4; 21-22) Telang, S.R. Establishing Psychometric Properties of the Level of Knowledge Use Survey (LOKUS) Questionnaire for Knowledge Translation for Technology Transfer. (Unpublished Masters Thesis). University at Buffalo, State University of New York.

  19. Acknowledgement This is a presentation based on Shreya Telang’s (2011) work for her masters’ thesis which was partially supported by the KT4TT Center under funding by the National Institute on Disability and Rehabilitation Research of the U.S. Department of Education, under grant number H133E030025. The opinions contained in this presentation are those of the grantee and do not necessarily reflect those of the U.S. Department of Education.

  20. Thank you!! Contact: vstone@buffalo.edu http://kt4tt.buffalo.edu Questions?

  21. Appendix Study A Light, J. and Drager, K. (2007). AAC technologies for young children with complex communication needs. State of the science and future directions. Augmentative & Alternative Communication, 23 (3), 204-16. Study B Light, J., McNaughton, D., Weyer, M. & Karg, L.(2008). Evidence-based literacy instruction for individuals who requireAugmentative and Alternative Communication: A case study of a student with multiple disabilities. Semin Speech Lang, 29 (2), 120-132. Study C Quach, W.(2007). Facilitating children’s learning of Augmentative and Alternative Communication systems. Retrieved from Proquest Digital Dissertations. (AAT 3275080).

  22. LOKUS and the LoU Scale: Differences

More Related