1 / 22

Smart searches … Smarter metadata

Smart searches … Smarter metadata. Evan Bailey and Sue Carpenter Knowledge Sharing Services. Outline. Testing of intelligent search Does it provide an alternative to human-assigned metadata? Background Our users The Teaching and Learning Exchange Our metadata standards

camden-davenport
Download Presentation

Smart searches … Smarter metadata

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Smart searches … Smarter metadata Evan Bailey and Sue Carpenter Knowledge Sharing Services

  2. Outline • Testing of intelligent search • Does it provide an alternative to human-assigned metadata? • Background • Our users • The Teaching and Learning Exchange • Our metadata standards • Processes for author-created metadata capture

  3. Our users • NSW public school teachers • TAFE NSW teachers • What we know about what they want • Easy to access online learning resources • Re-usable components • Mapped to NSW curriculum • Like Google

  4. TaLe | Teaching and Learning exchange • Online delivery of learning resources for NSW Department of Education • Schools • TAFE • Parents and Community • Search and browse by learning area and educational level • Easy preview and download

  5. Our metadata • Metadata underpins TaLe • Standardisation • Interoperability • DET Learning Resource Metadata • NSW DET vocabularies • Crosswalks

  6. Making metadata invisible • Workflow integration • Content creators capture metadata • Easy to use template - The Learning Reference Repository • Automated and default values • QA and training by librarians

  7. The Learning Reference Repository Describe and publish resources • Easy to use metadata capture template • Workflow integration with resource publishing system

  8. Getting buy-in • High level of compliance • Easy to use tool for metadata capture • Workflow integration • Quick feedback in TaLe search results • High quality author-created metadata • They get it! Metadata matters! • Captures subject expert’s knowledge – efficient and effective

  9. The promise of the new • Intelligent search engines • Make sense of unstructured information • Conceptual and contextual understanding • Related concepts • Improved efficiency? • Let the machine do it! • Eduction • Generation of metadata values by the search engine

  10. Proof of concept testing • Can search engine eduction provide a satisfactory alternative to human-assigned metadata on Curriculum Support site, in terms of assigning metadata values for stages of learning and key learning areas? • Test environment • Curriculum Support resources (24,000) • Test cases • Comparison with human-assigned metadata • Review of search engine-assigned values

  11. Results • Search engine eduction alone not reliable enough • Did not assign values where it should have – false negatives 30% • Assigned values where it should not have – false positives 25% • Users would lose confidence in search • Time and resources needed to train the engine • Aid human-assigned metadata – not a replacement

  12. Characteristics of educational resources • Student resources • Context not always explicit • Trigger terms not present

  13. The value of evidence • Strengths of the existing process • Content experts = Expert taggers • Easy capture tool • Metadata standard • Specific terminology for NSW curriculum • Metadata adds value

  14. What’s next • Watching brief and more testing • Intelligent search with intranet content • Implement related concepts • Social tagging

  15. More … for later • TaLe http://www.tale.edu.au • Who are we? • The Centre for Learning Innovation http://www.cli.nsw.edu.au/cli/index.shtm • Knowledge Sharing Services http://www.cli.nsw.edu.au/cli/focus/standards.shtm • evan.bailey@det.nsw.edu.au • sue.carpenter@det.nsw.edu.au • Our metadata profile • The DETLRM

More Related