1 / 45

The Web, Text, Data, and XML

The Web, Text, Data, and XML. December 3, 1998. Bruce Bargmeyer EPA/OIRM/EIM Division Tel: (202) 260-5306 bargmeyer.bruce@epa.gov WWW URL: http://sdct-sunsrv1.ncsl.nist.gov/~bargmeye. Terminology and the EDR. Thesaurus. Data Elements. Ontology. Sources. XML. Topics.

colt-davidson
Download Presentation

The Web, Text, Data, and XML

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Web, Text, Data, and XML December 3, 1998

  2. Bruce Bargmeyer EPA/OIRM/EIM Division Tel: (202) 260-5306 bargmeyer.bruce@epa.gov WWW URL: http://sdct-sunsrv1.ncsl.nist.gov/~bargmeye

  3. Terminology and the EDR Thesaurus Data Elements Ontology Sources XML Topics Sharing Environmental Information

  4. Users: • System managers • System developers • Subject area specialists • Program managers • Scientists • NGOs • Public • Legislative bodies • Statistician/analysts • Regulation writers • ……..

  5. Users: • System managers • System developers • Subject area specialists • Program managers • Scientists • NGOs • Public • Legislative bodies • Statistician/analysts • Regulation writers • ……..

  6. Activities: • Produce State of the Environment report • Design/build computer systems • Writing legislation and regulations • Track/monitor status of environment • Statistical analyses • Problem solving • Environmental planning

  7. Accessing text and data EEA Users DOE text text text data data data environ agriculture climate human health industry tourism soil water air ambiente agricultura tiempo salud hunano industria turismo tierra agua aero environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 123 345 445 670 248 591 308 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 ambiente agricultura tiempo salud huno industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 Others . . .

  8. 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text text data data text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero environ agriculture climate human health industry tourism soil water air environ agriculture climate human health industry tourism soil water air text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 Others . . . World Wide Web

  9. Search Engine Queries World Wide Web 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text text data data text datas environ agriculture climate human health industry tourism soil water air environ agriculture climate human health industry tourism soil water air ambiente agricultura tiempo salud humano industria turismo tierra agua aero text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 Others . . .

  10. Challenges World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA text data environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine text data environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Search engines do not find traditional data. data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . .

  11. Challenges World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA text data environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine text data environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Search engines are not used well for multilingual information. data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . .

  12. Challenges World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA data environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine data environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Hard to use retrieved data in PC software. data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . .

  13. Challenges World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA data ? environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine data environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Users lack information on data quality and meaning. data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . . ?

  14. Challenges World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA text data environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine text data environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Data exchange between systems is difficult. data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . .

  15. Challenges Search engines do not find traditional data Search engines and DBMSs not used well for multilingual information Users lack information on data quality and meaning Hard to use retrieved data in PC software Data exchange between systems is difficult Not tailored for environmental information

  16. Steps Forward World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA text data environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine text data Metadata Registry environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 TerminologyThesaurus Themes GEMET text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . . Catalog of Data Sources (CDS) Environmental Data Registry (EDR)

  17. Increased Understanding World Wide Web text datas ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA text data environ agriculture climate human health industry tourism soil water air 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Search Engine text data Metadata Registry environ agriculture climate human health industry tourism soil water air DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 TerminologyThesaurus Themes GEMET text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Structured Metadata data text ambiente agricultura tiempo salud humano industria turismo tierra agua aero Others . . . Catalog of Data Sources (CDS) Environmental Data Registry (EDR)

  18. Facilitates Data Access World Wide Web 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Middleware Metadata Registry DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 TerminologyThesaurus Themes GEMET text text text datas data data environ agriculture climate human health industry tourism soil water air ambiente agricultura tiempo salud humano industria turismo tierra agua aero environ agriculture climate human health industry tourism soil water air text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Structured Metadata Catalog of Data Sources (CDS) Environmental Data Registry (EDR) text data 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 Others . . .

  19. Enhanced Data System Exchange World Wide Web 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Middleware Metadata Registry DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 TerminologyThesaurus Themes GEMET text text text datas data data ambiente agricultura tiempo salud humano industria turismo tierra agua aero environ agriculture climate human health industry tourism soil water air environ agriculture climate human health industry tourism soil water air text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Data Standards EnhancedDataExchange EDI XML-EDI XML-Data Web Forms Catalog of Data Sources (CDS) Environmental Data Registry (EDR) text data 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 Others . . .

  20. Queries Through Middleware World Wide Web 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Intelligent Systems Metadata Registry Middle Ware DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 TerminologyThesaurus Themes text text text datas data data environ agriculture climate human health industry tourism soil water air environ agriculture climate human health industry tourism soil water air ambiente agricultura tiempo salud humano industria turismo tierra agua aero InfoSleuth Ontology GEMET text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Data Standards Structured Metadata Catalog of Data Sources (CDS) Environmental Data Registry (EDR) text data 3268 0825 1348 5038 2708 0000 2178 123 345 445 670 248 591 308 ambiente agricultura tiempo salud humano industria turismo tierra agua aero 123 345 445 670 248 591 308 3268 0825 1348 5038 Others . . .

  21. Queries Using Resource Agents World Wide Web 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 EEA RA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 DOE Intelligent Systems RA Metadata Registry Middle Ware DoD 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 TerminologyThesaurus Themes text text text data data datas RA ambiente agricultura tiempo salud humano industria turismo tierra agua aero environ agriculture climate human health industry tourism soil water air environ agriculture climate human health industry tourism soil water air RA InfoSleuth Ontology GEMET text data environ agriculture climate human health industry tourism soil water air EPA 123 345 445 670 248 591 308 123 345 445 670 248 591 308 3268 0825 1348 5038 2708 0000 2178 3268 0825 1348 5038 2708 0000 2178 Data Standards Structured Metadata Catalog of Data Sources (CDS) Environmental Data Registry (EDR) Resource Agents (RAs)

  22. CZ Czech Republic** LO Slovakia** ANSI Industry EPA CZ Czechoslovakia* Country changes ISO Country Change * FIPS PUB 10-3 ** FIPS PUB 10-4 Example of data changes world-wide.

  23. ANSI Industry EPA Scientific Name Vernacular Name Taxonomic Serial Number New species New classification ISO Biological terms Change Example of data changes world-wide.

  24. ANSI Industry EPA Systematic Name Synonym CAS Number New chemical ISO Chemicals Change Example of data changes world-wide.

  25. Environmental Data Registry ANSI Industry EPA Catalog of Data Sources Standard Data Intelligent Transportation System ISO Defense Data Dictionary Sources Health Care Finance Administration ISO/IEC 11179 Metadata Registry Standard Change As data changes world-wide, metadata changes can be recorded and effectively communicated between metadata registries.

  26. = fish Terminology fish

  27. Elements of Terminology any of several game fishes of the genus Salmo, related to the salmon... Concept Sign Object trout Salmo trutta brown trout truite

  28. Terminology any of several game fishes of the genus Salmo, related to the salmon... Concept Terms Context trout Salmo trutta truite common name scientific name French name UIN=6349

  29. Search Engine Concept Terms Context Documents Data Thesaurus Brown trout Salmo trutta truite common name scientific name French name UIN=6349 1 2 3 4 5 6 7 8 fish trout Search Example: FishTrout Salmo trutta Brown Trout

  30. Systems:STORETEnvirofacts . . . Federal Register Regulations Reports Web-enabled FormsEDI Messages Name: trout species Definition: The names of species of trout. Values: brook trout -- Salvelinus fontinalisbrown trout -- Salmo truttacutthroat trout-- Oncorhynchus clarkii ... DataInterchange Documents Publishing DBMSQuery DataElements DataElements Concept Terms Context Brown trout Salmo trutta truite common name scientific name French name UIN=6349

  31. DoD EPA DOE EDEN EEA Intelligent Information Services (IIS): Local Mapping Concept Terms Context Ontology Brown trout Salmo trutta truite common name scientific name French name UIN=6349 Query Agent Broker Mediator Resource Agent Central Mapping Example: fish trout brown trout

  32. Concept Terms Context Brown trout Salmo trutta truite common name scientific name French name UIN=6349 Data Elements Facilitated Sessions: Government Federal State/Local Private Enterprise Academia Thesauri General European Multilingual EnvironmentalThesaurus (GEMET) Data Sources

  33. Deployment Technologies DBMS/EDI/ Documents a category of vertebrate, cold-blooded craniate animals with permanent gills... Search Engine IIS Environmental Data Registry DataElements Thesaurus Ontology

  34. EDR ANSI Industry EPA ISO Change As data changes world-wide, metadata changes can be recorded and effectively communicated between metadata registries. Catalog of Data Sources Standard Data Intelligent Transportation System Defense Data Dictionary Sources Health Care Finance Administration ISO/IEC 11179 Metadata Registry Standard

  35. Extensible Markup Language (XML) Simplified SGML(Standard Generalized Markup Language, ISO 1986) Next generation HTML Semantic structure of document or data Extensible, industry-specific tag sets Display determined by style sheets(CSS, XSL) What is XML? (Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)

  36. XML Example <?xml version =“1.0”?> Markup <book> Character Data <author> <name>Richard Light</name> <email>rlight@somewhere.com</email> </author> <title>PresentingXML</title> </book> (Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)

  37. Overcomes shortcomings of HTML Allows processing of Web documents by sophisticated document processing software Overcomes shortcomings of SGML Allows media-independent electronic publishing Interoperates with HTML and SGML Provides vendor-neutral data exchange XML Goals & Philosophy (Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)

  38. Increasing industry interest and acceptance Parsers in multiple computer languages JAVA, C++, Perl, Python, etc. Additional industry-specific tag sets Full Web browser support Growing set of authoring/processing tools Where is XML Going? (Source: John McCarthy, Frank Olken, and Roy Tennant, April 1998)

  39. DBMS / EDI / Documents Search Engine IIS Environmental Data Registry Role of XML XML XML DataElements XML XML Thesaurus Ontology

  40. EDR ANSI Industry EPA ISO Change As data changes world-wide, metadata changes can be effectively communicated using XML between metadata registries. XML Catalog of Data Sources XML Standard Data Intelligent Transportation System XML Defense Data Dictionary Sources XML Health Care Finance Administration XML ISO/IEC 11179 Metadata Registry Standard

  41. Memorandum of Agreement - EPA, EEA, DOD, DOE Joint Action Document Tasks, Deliverables and Milestones for InfoSleuth Project Phase One demonstration successful GEMET Agreement Progress

  42. Joint Articles with the EEA Common environmental terminology GEMET Structured descriptions of data and text EDR & CDS Terminology collaboration with selected states Cooperative Efforts

  43. Technology Demonstrations GEMET for cataloging and searching Search engine for text and data EDR and CDS development and integration Global Information Locator Service MCC InfoSleuth EPA, DOD, DOE, EEA EPA and states Cooperative Efforts

  44. Collaborate on terminology Thesaurus, topic trees, ontology Collaborate on metadata - Well-formed data elements Collaborate on data/text description Connect EDR to CDS through Global Information Locator Service Collaborate on metadata registries (e.g., EDR) Next Steps

More Related