1 / 54

Consensus building workshop

Consensus building workshop. Conference track OAEI-2007. Ondřej Šváb The University of Economics The Department of Information and Knowledge Engineering. Outline. Introduction (ideas behind the track) Evaluation Discussion – ‘interesting’ mappings. Features of conference track.

dominick
Download Presentation

Consensus building workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Consensus building workshop Conference track OAEI-2007 Ondřej Šváb The University of Economics The Department of Information and Knowledge Engineering

  2. Outline • Introduction (ideas behind the track) • Evaluation • Discussion – ‘interesting’ mappings Consensus Building Workshop within Conference track

  3. Features of conference track • Broadly understandable domain of conference organisation • Free exploration by participants within collection of 14 ontologies • No a priori reference alignment • participants: 6 research group Consensus Building Workshop within Conference track

  4. Dataset in conference track Consensus Building Workshop within Conference track

  5. Participants of conference track • 6 participants • ASMOV • Falcon-AO • LILY • OLA • OntoDNA • SEMA Consensus Building Workshop within Conference track

  6. Outline… • Introduction (ideas behind the track) • Evaluation • Discussion – ‘interesting’ mappings Consensus Building Workshop within Conference track

  7. Evaluation • Manual evaluation as a precondition for Consensus Building Workshop • Assessment based on personal judgement • Tags: TP, FP, interesting, heterogenous mapping, unclear, trivial • Types of errors and phenomena: • Subsumption, inverse property, siblings • Subsumption mistaken for equivalence • - Document, Presentation • - Session, Tutorial • Siblings mistaken for equivalence • - Author, Reviewer • - hasMail, first_name • Inverseproperty • - has_a_review, write_review • - has_parts, isPartOf Consensus Building Workshop within Conference track

  8. Evaluation... precision (P) is computed as ratio of the number of all correct mappings to the number of incorrect plus correct mappings, rrecall (rR) is computed as ratio of the number of all correct mappings to the number of all correct mappings. This is our "relative" recall. ratioSubs shows ratio of the number of subsumption errors and the number of incorrect mappings, ratioTriv shows ratio of the number of so-called trivial mappings and the number of correct mappings http://nb.vse.cz/~svabo/oaei2007/ Consensus Building Workshop within Conference track

  9. Evaluation... • Some statistics as a side-effect of processing http://nb.vse.cz/~svabo/oaei2007/ Consensus Building Workshop within Conference track

  10. Outline… • Introduction (ideas behind the track) • Evaluation • Discussion – ‘interesting’ mappings Consensus Building Workshop within Conference track

  11. Consensus Building Workshop

  12. Our goal • Focus on ‘interesting’ (unclear) mappings • Discussion: • Why should they be mapped? • Arguments against and for • Track argumentation process Consensus Building Workshop within Conference track

  13. Our goal... • Discuss mappings • generally • wrt. application usage • Recall methodology of Grüninger and Fox • ‘Identification of motivating scenarios’ • ‘Elaboration of informal competency questions’ • But transport it into ontology matching field! Consensus Building Workshop within Conference track

  14. Use-case • Transformation application: • transfer of data of the conference from one 'software tool for organising conference' to other 'software tool for organising conference‘ • Mapping ontologies correspond with ‘sw tools’ Consensus Building Workshop within Conference track

  15. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  16. Mapping 1 Consensus Building Workshop within Conference track

  17. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  18. Mapping 2 Consensus Building Workshop within Conference track

  19. Mapping 2 ekaw.owl Reviewer is domain of: adjustBid assignedByAdministrator assignedExternalReviewer hasBeenAssigned markConflictOfInterest readPaper writeReview Reviewer is range of: adjustedBy assignedByReviewer assignedTo assignReviewer readByReviewer writtenBy cmt.owl Possible_Reviewer is domain of: reviewerOfPaper Possible_Reviewer is range of: hasReviewer ReviewWrittenBy Consensus Building Workshop within Conference track

  20. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  21. Mapping 3 Consensus Building Workshop within Conference track

  22. Mapping 3a Conference.owl PCS.owl ConferenceMember is domain of member_of_conference ConferenceMember is range of has_conference_member Consensus Building Workshop within Conference track

  23. Mapping 3b PCS.owl ekaw.owl ConferenceMember is domain of member_of_conference ConferenceMember is range of has_conference_member Consensus Building Workshop within Conference track

  24. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  25. Mapping 4 Consensus Building Workshop within Conference track

  26. Mapping 4 PCS.owl sigkdd.owl ConferenceMember is domain of member_of_conference ConferenceMember is range of has_conference_member Consensus Building Workshop within Conference track

  27. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  28. Mapping 5 Consensus Building Workshop within Conference track

  29. Mapping 5 Micro.owl crs_dr.owl Conference is domain of annualOrder begins ends isOrganizedBy isPartOf takesPlace Conference is range of isPartOf organizes event is domain of has_enddate has_startdate expectedAttendance hasTopic isPartOf Activity is domain of begins ends expectedAttendance hasTopic isPartOf Activity is range of isIncluded Consensus Building Workshop within Conference track

  30. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  31. Mapping 6 Consensus Building Workshop within Conference track

  32. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  33. Mapping 7 Consensus Building Workshop within Conference track

  34. Mapping 7 Iasted.owl ekaw.owl Individ... is domain of presentationOfPaper ends expectedAttendance hasTopic isPartOf Individ... is range of paperPresentedAs Consensus Building Workshop within Conference track

  35. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  36. Mapping 8 Consensus Building Workshop within Conference track

  37. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  38. Mapping 9 Consensus Building Workshop within Conference track

  39. Mapping 9 isTypeOf has subproperties: isAuthorTypeOf isPaperTypeOf Domain(isAuthorTypeOf)=Reviewer or Author Range(isAuthorTypeOf)={“invited”,”registred”} Domain(isPaperTypeOf)=Paper Range(isPaperTypeOf)={“invited”,”regular”} Consensus Building Workshop within Conference track

  40. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  41. Mapping 10 Consensus Building Workshop within Conference track

  42. Mapping 10 micro.owl edas.owl Topic is domain of: isIncluded Topic is range of: hasTopic ... Topic is domain of: isTopicOf Topic is range of: hasTopic Compilers, ForwardLookingIdea, Microarchitecture, Systems, are instances of Topic Consensus Building Workshop within Conference track

  43. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  44. Mapping 11 Consensus Building Workshop within Conference track

  45. Mapping 11 paperdyne.owl ekaw.owl Paper spokenBy only Speaker Consensus Building Workshop within Conference track

  46. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  47. Mapping 12 Consensus Building Workshop within Conference track

  48. Informal competency questions • After the transfer of data from one tool to another, will it be correct wrt. • the conflict of interests of authors vs. reviewers? • the assignment of papers to potential reviewers? • temporal aspect of the reviewing process? • temporal aspect of submission phase of papers/camera-ready versions? • registration requirements of participants of conference and members of commissions? • presentation of the contribution by at least one participant • ... Consensus Building Workshop within Conference track

  49. Mapping 13 Consensus Building Workshop within Conference track

  50. Mapping 13 conference.owl Conference_volume is subclass of Conference Inverse property of ‘is_submitted_at’ is ‘has_contributions’ cocus.owl Usage for ‘is_concerned_conference’: Consensus Building Workshop within Conference track

More Related