Crosslingual ontology based document retrieval search in an elearning environment
This presentation is the property of its rightful owner.
Sponsored Links
1 / 20

Crosslingual Ontology-Based Document Retrieval (Search) in an eLearning Environment PowerPoint PPT Presentation


  • 60 Views
  • Uploaded on
  • Presentation posted in: General

Crosslingual Ontology-Based Document Retrieval (Search) in an eLearning Environment. Eelco Mossel LSP 2007, Hamburg. Framework. EU-Project LT4eL: Language Technology for eLearning ( www.lt4el.eu ) Goal: use of Language Technology to improve the effectiveness of Learning Management Systems

Download Presentation

Crosslingual Ontology-Based Document Retrieval (Search) in an eLearning Environment

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Crosslingual ontology based document retrieval search in an elearning environment

Crosslingual Ontology-Based Document Retrieval (Search)in an eLearning Environment

Eelco Mossel

LSP 2007, Hamburg


Crosslingual ontology based document retrieval search in an elearning environment

Framework

  • EU-Project LT4eL: Language Technology for eLearning (www.lt4el.eu)

  • Goal: use of Language Technology to improve the effectiveness of Learning Management Systems

  • Multilingual Setting: 8 languages

  • 12 European partner universities/institutes

  • Crosslingual search: work together with:

    • Cristina Vertan (University of Hamburg)

    • Kiril Simov (Bulgarian Academy of Sciences, Sofia)

    • Alex Killing (ETH Zürich (Eidgenössische Technische Hochschule))


Crosslingual ontology based document retrieval search in an elearning environment

Overview

  • Project framework

  • Learning Management System

  • Goals of semantic search

  • Resources for search function

  • Features (user side)

  • Internal components (developer side)

  • Evaluation


Crosslingual ontology based document retrieval search in an elearning environment

Learning Management System (LMS)

  • Learning Platform on the internet (interactive website)

    • Users can log in, have a profile, chat, …

  • Fundamental: store and access Learning Material

  • Units: Learning Objects (LOs) = documents

  • Test-System : open source platform ILIAS (www.ilias.de/)

  • Test material: text-based documents in 8 languages (PDF, HTML, MS-Word)

  • Domain of test material: Computer Science for non CS specialists


Goals of the approach

Crosslingual semantic search

Goals of the approach

1. Improved retrieval of documents

  • Find documents that would not be found by simple text search (exact search word occurs in text)

  • Example: search for “screen” – retrieve doc that contains “monitor” but not “screen”.

    2. Multilinguality

  • One implementation for all languages in the project

    3. Crosslinguality

  • Find documents in languages different from search/interface language

    • No need to translate search query

    • Search possible with passive foreign language knowledge


Crosslingual ontology based document retrieval search in an elearning environment

Resource: domain ontology

  • Approach: use a domain ontology

  • Creation:

    • Select keywords from LOs (also used for another project goal/task)

    • Choose keywords relevant for the domain “Computer Science for Non-Computer Scientists)

    • Derive a set of concepts from the set of keywords. Concepts have English names/labels

    • Provide a definition in English for each concept

    • Create OWL taxonomy/ontology from concepts, by specifying relations between domain concepts, and mapping to DOLCE and WORDNET ontology.

    • 1 ontology, for language-independent use, but contains English as common language for labels and definitions

    • Currently 707 concepts


Crosslingual ontology based document retrieval search in an elearning environment

Resource: term-concept lexicons

  • Connection between terms (words in a certain language) and concepts

  • Create term-concept lexicons:

    • For each language and each concept, specify terms (synonyms if relevant) that denote the concept

    • At least one term for each concept

    • German: currently 939 terms  707 concepts


Crosslingual ontology based document retrieval search in an elearning environment

Resource: concept-annotations

  • Concept  Document relations

  • Annotate concepts in documents in a semi-automatic way using the lexicons:

    • Occurrences of terms are annotated with corresponding concepts

    • Annotator (person) decides whether or not to annotate this occurrence, and chooses between concepts for ambiguous terms


Crosslingual ontology based document retrieval search in an elearning environment

Crosslingual semantic search

Starting points

  • A multilingual document collection

  • An ontology including a domain ontology on the domain of the documents

  • Concept lexicalisations in different languages

  • Annotation of concepts in the documents


Crosslingual ontology based document retrieval search in an elearning environment

Connecting the components

CommunicationsProtocol

HTTP

FTP

browse and select

Docs L1

Terms L1

Terms L2

Docs L2

HTTP

Docs L3

Terms L3

IP

FTP

search terms

SSL

Lexicons in different languages


Crosslingual ontology based document retrieval search in an elearning environment

Search with ILIAS


Crosslingual ontology based document retrieval search in an elearning environment

Features of the search functionality

  • Search using search words, concepts from the ontology or a combination of both

    • In case of combination: results of directly selected concepts come first

  • Search for documents with super- or subconcepts

    • For documents in which desired concept is not found

  • Ranking

    • Number of different searched concepts in document

    • Normalised annotation frequency

    • Super/subconcepts have lower weight

  • Shared concepts (occurring in e.g. 50% of the found documents)

    • Example: Concept “Report”  Some documents about academic writing Concept “Publication”

  • Navigate through ontology (get related concepts)


Search functionality comprises

Internal components

Search functionality comprises:

  • Find terms in lexicons that reflect search query.

  • Find corresponding concepts for derived terms.

  • Find relevant documents for concepts.

  • Create ranking for set of found documents.

  • Create ontology fragment containing necessary information to present concept neighbourhood

  • Find “shared concepts”


Crosslingual ontology based document retrieval search in an elearning environment

1: Query  Terms

  • Why start with a free text query?

    • User wants results fast (as in Google)

    • Compete with fulltext search and keyword search

    • Find starting point for ontology browsing

  • Query  lexicon: adopted/implemented strategies for

    • Tokenise  create combinations for multiword terms (e.g. "space bar"),

    • Loose match of diacritic and uppercase letters (é  e; E  e)

  • Other ideas to improve recognition of query:

    • Lemmatisation of search terms

    • Expansion of lexicon with word forms

    • Match similar strings

      • Insertion of function words

        e.g. “provedor acesso”  “provedor de acesso”

    • Automatic substring match

    • Dynamic list of available terms that contain input so far


Not always 1 1 mapping

2: Term  Concept

Not always 1:1 mapping.

  • Corresponding concept is missing from ontology

    • LT4eL: not in lexicon

  • Unique result: term is lexicalisation of one concept

  • Multiple concepts from one domain, e.g.:

    • Key (from keyboard)

    • Key (in database)

  • Concepts from more domains:

    • Window (graphical representation on monitor)

    • Window (part of a building)

  • Different concepts for different languages:

    • “Kind” (English: sort/type)

    • “Kind” (German: child)

       Let the user choose: present multiple browsing units


Crosslingual ontology based document retrieval search in an elearning environment

3: Concept  Documents

  • Simplest:

    • Disjunctive search with ranking

      • For each concept, each document that is annotated with it is returned

      • Documents with more desired concepts are ranked higher

  • Use super/subconcepts

  • Further possibilities

    • Conjunctive search:

      • Combination of concepts must occur in a document

      • Is taken into account in current ranking

    • Context search:

      • Combination of concepts must occur in a paragraph or sentence

    • Word & Concept search combined:

      • Document must contain concepts as well as certain words


Crosslingual ontology based document retrieval search in an elearning environment

3: Concept  Documents (continued)

  • How useful is it, to find documents that treat a superconcept?

    • Negative example: lt4el:Subroutine  lt4el:Software.Other children of Software are e.g.: Shareware, AuthoringLanguage

    • Positive example: GraphicalUserInterface  UserInterface

  • How useful is it, to find documents that treat a subconcept?

    • lt4el:Program has 93 subconcepts, e.g.:

      • ApplicationProgram

      • Computervirus

      • Driver

      • Unzip


Crosslingual ontology based document retrieval search in an elearning environment

Evaluation

  • Does semantic search return correct results? (appropriate documents)

  • How easy is it to use semantic search?

  • Are the results better (precision/recall) than with keyword search or fulltext search (also available in ILIAS)?

    • Relevant for monolingual scenario

  • Is the learning process improved?

    • Depends on quality of ontology and annotation

    • In multilingual case: depends on domain knowledge and language knowledge of multilingual test persons


Thank you

Thank you


  • Login