Digital Library Service Integration Senior Projects

1. Digital Library Service IntegrationSenior Projects Professors Bieber, Im and Wu Information Systems Department College of Computing Sciences New Jersey Institute of Technology http://is.njit.edu/dlsi For more senior project information: http://is.njit.edu/dlsi/dlsi-sr-projects-s2003.doc

2. DL = Distance Learning = Digital Library DLSI: DL Service Integration

3. Why Participate in DLSI? • Real-world project • very helpful for students and teachers worldwide • High visibility for you and NJIT • Gain research experience and work with research teams • Learning XML, XLS, and other skills • Support: DLSI project leader and bi-weekly DLSI project meetings

4. Outline • Motivation • supporting learning communities • DLSI Architecture • Senior Projects

5. documents (published papers, reports, photos, videos, lesson plans, syllabi, etc.) discussions decisions conceptual models formal educational modules workflows/processes people’s expertise links/relationships among all these Motivation:Community Knowledge Resides in...

6. DLSI Architecture Integration linking related documents • Digital Library: Multimedia Document Services for manipulating and maintaining data for storing data

7. DLSI Architecture Integration Discussing a document • Digital Library: Multimedia Document Services • Asynchronous Discussion Tools(Groupware) for manipulating and maintaining data for storing data

8. DLSI Architecture Integration Annotating a discussion Tours of documents and discussion comments • Digital Library: Multimedia Document Services • Asynchronous Discussion Tools/Groupware • Hypermedia Services(tours, annotation, linking)

9. DLSI Architecture Integration Annotating and discussing a community process • Digital Library: Multimedia Document Services • Asynchronous Discussion Tools • Hypermedia Services (tours, annotations, links) • Processes/Workflows

10. DLSI Architecture • Digital Library: Multimedia Document Services • Asynchronous Discussion Tools • Hypermedia Services • Processes/Workflows • Decision Analysis Support • Conceptual Knowledge Structures • Others...

11. DLSI: Integration throughLinking

12. DLSI is Based on theDynamic Hypermedia Engine • Automatically adds link anchors, links and other “hypermedia” services to applications: • comments • guided tours • structural search (based on links and relationships instead of keywords) • others... • See separate presentation

16. 1997 Sales 1997 Expenses $127,322.12 $85,101.99 Dynamic Hypermedia Engine • Links generated based on application structure, not search or lexical analysis • You cannot do a search on the display text “$127,322.12” to find related information… • But you can find relationships for the element Sales[1997]

17. Link Mapping Rules Relationship Manager Rule Base … Vendor - Vendor IS - Vendor Details - {commands} Vendor - Vendor IS - Vendor Reliability - {commands} Vendor - Vendor IS - Vendor Agreements - {commands} Vendor - Purchasing Data Warehouse - Who else uses vendor - {commands} Vendor - Purchasing IS - Your Purchasing History - {commands} Vendor - CASE Workbench - All screens with this vendor - {commands} … ...

18. DHE generates anchors and links from the Relationship Management Rule Base

19. DLSI: Integration throughLinking

20. Prototype

21. Prototype

22. Benefits of Integrationfor a system (collection/service) • Users: direct access to related systems • enlarges a system’s feature set • DLSI leads users to a system • systems gain wider use • Users become aware of other systems • systems gain wider awareness • Direct access to a system’s features • streamlined access (bypassing menus)

23. Finding Links • Structural links (as with DHE) • when we know the object type • Lexical analysis (Professor Wu) • NJIT Noun Phrase Extractor • NJIT Ontology Developer

24. Filtering & Rank Ordering Links • Collaborative Filtering (Professor Im) • customize the link set for each user • based on: • user-direct evaluations (ratings) • indirect evaluation (clickstream data) • using a Collaborative Filtering Engine

26. How to Integrate (1) Develop a Wrapper • Parse all display screens to identify the “elements of interest” that DLSI will make into link anchors. • Parse each kind of display screen • Parse based on the standard template/layout or metadata provided • Also call the lexical analysis routines to identify key phrases for you

27. How to Integrate, cont. (2) Develop Linking Rules • specify the “structural relationships” for recognized object types within the system being integrated. • e.g., author, address, concept, spacecraft, measurement • one rule per object type (class) per link • all linking rules are merged by DLSI, so rules for other systems apply automatically to your system • (e.g., annotations, discussions, related documents)

28. How to Integrate, cont. (3) Initiate Communications: • Several possible ways, depending on the application.

29. Outline • Motivation • supporting learning communities • DLSI Architecture • Senior Projects • Project 1: AVC and AskNSDL/VRD • Project 2: Metis Workflow and JESSE • Project 3: NASA’s NSSDC • Project 4: Lexical Analysis and User Preferences • Project 5: myKnowledge

30. NSDL(National Science Digital Library) • Sponsored by the National Science Foundation (NSF) • Purpose: to provide educational resources in an integrated environment to students and teachers (kindergarten-graduate school) • URL: http://www.nsdl.org/ • Flash Presentation: http://about.nsdl.org/flash

31. DLSI & NSDL • DLSI is providing the integration for all of the NSDL system! • Senior Projects will • be the first integration prototypes • provide necessary internal features

32. Project 1a Atmospheric Visualization Collection • Provides visualization tools and images of weather data from Atmospheric Radiation Measurement (ARM) program • ARM: the largest global change research program supported by the U.S. Dept. of Energy • based at the Argonne National Laboratory • URL: http://www.nsdl.arm.gov/visualization.shtml

33. Automated Links (AVC) • From concepts found in the glossary and from instruments: • link to the glossary definition • link to lesson plans containing it • link to an instrument's page • link to ARM publications containing the keyword/instrument

34. Automated Links, cont. (AVC) • From any relevant object to the appropriate data display page • From any relevant object to the appropriate internal data file (for AVC internal developers)

35. Automated Links, cont. (AVC) and, of course: • Links to related objects, teaching notes and documents in other systems • Links for additional services such as discussion, comments, guided tours, etc.

36. Project 1b Ask-NSDL & Virtual Reference Desk • Based at the University of Syracuse • See separate presentation

37. Automated Links(Ask-NSDL & VRD) • Lexical analysis to find key phrases recognized in glossaries • Links to other questions/answers for a key phrase • Direct links to all relevant functions for experts, administrators (e.g., show all answers this expert made)

38. Automated Links, cont. and, of course: • Links to related objects, teaching notes and documents in other systems • Links for additional services such as discussion, comments, guided tours, etc.

39. Project 1b Ask-NSDL & Virtual Reference Desk • Same kind of links for the Virtual Reference Desk! (http://www.vrd.org/)

40. Project 2aMetis Workflow Engine • based at the University of Colorado at Boulder • Workflow: the process to get something done • involves triggering events from/in different systems • some steps are automated (e.g., send email), others require people to do something • See separate presentation

41. Automated Linking (Metis) • Linking workflow definition tools to internal Metis documentation • Linking workflow specifications and Metis displays with the systems involved in the workflow

42. Automated Links, cont. (Metis) and, of course: • Links to related objects, teaching notes and documents in other systems • Links for additional services such as discussion, comments, guided tours, etc.

43. Project 2bJESSE/Picture of the Day • Journal of Earth System Science Education • Based at the Universities Space Research Association • See external presentation • URL: http://jesse.usra.edu/testing/ • Also, Earth Science Picture of the Day • URL: http://epod.usra.edu

44. Automated Links (JESSE/POTD) • Links among related pictures and articles and, of course: • Links to related objects, teaching notes and documents in other systems • Links for additional services such as discussion, comments, guided tours, etc.

45. Project 3: NASA’sNational Space Science Data Center • based at the Goddard Space Flight Center • URL: http://nssdc.gsfc.nasa.gov/ • preliminary starting demo connecting NSSDC with the University of Arizona Document Summarizer (see next page)

46. Prototype

47. Automated Linking (NSSDC) • Links among related space missions, experiments, astronauts & scientists, and definitions/explanations of key phrase/concepts • Links utilizing other NASA systems

48. Automated Links, cont. (NSSDC) and, of course: • Links to related objects, teaching notes and documents in other systems • Links for additional services such as discussion, comments, guided tours, etc.

49. Project 4a (internal): Linking through Lexical Analysis • See external presentation

50. Project 4b (internal): User Preference Module • UPM maintains database of user preferences for any module integrating with DLSI. • communicates with other modules through DLSI’s existing message passing protocol • UPM will communicate with users • to gather preferences • to get information from the user about his or her current task, so we can customize the links generated task and preferences • We have a fairly complete set of requirements already prepared.