cdx and the exchange network n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
CDX and the Exchange Network PowerPoint Presentation
Download Presentation
CDX and the Exchange Network

Loading in 2 Seconds...

play fullscreen
1 / 42

CDX and the Exchange Network - PowerPoint PPT Presentation


  • 92 Views
  • Uploaded on

CDX and the Exchange Network. www.epa.gov/cdx. Connie Dwyer Environmental Protection Agency March 6, 2007. Topics. Background and Status Interoperability Specifications and Guidance Exchange Network Design Guidance SOA Service Ongoing and Future Work Questions. Background and Status.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'CDX and the Exchange Network' - ariane


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
cdx and the exchange network

CDX and the Exchange Network

www.epa.gov/cdx

Connie Dwyer

Environmental Protection Agency

March 6, 2007

topics
Topics
  • Background and Status
  • Interoperability
  • Specifications and Guidance
  • Exchange Network Design Guidance
  • SOA Service
  • Ongoing and Future Work
  • Questions
cdx and the exchange network1
CDX and the Exchange Network
  • The Exchange Network (Network)
    • promotes secure, standards-based information sharing and electronic data exchanges
  • The Central Data Exchange (CDX)
    • is the EPA exchange point (node) on the Exchange Network
    • provides common support services for the exchange of environmental data (shared services)
what is the exchange network
What is the Exchange Network?

An Internet and standards-based method for

exchanging environmental information between partners

  • Key Components
  • Data Standards
  • Nodes
  • XML Schema/Registry
  • Trading Partner Agreements
  • Grant Program
exchange network
Exchange Network
  • Objectives
    • Promote better environmental decisions through improved data quality and data access
    • Provide a common method for automating, publishing and exchanging data among states, tribes, and EPA
    • Promote efficient business processes and standard technologies to reduce operational costs
cdx exchange network soa
CDX / Exchange Network SOA
  • Based on a Service Oriented Architecture
    • Security Services
    • Discovery Services (UDDI)
    • Data Service
      • Publishing
      • Exchange
      • Transformation
    • Quality Assurance Services
  • Reduces Cost with Shared Services
  • Uses a Well-Tested Specification for Interoperability
  • Minimizes the Burden on Consumers
    • Universal Clients
    • Software Developer Kits
    • Open Source Implementations
slide8

Program Silo 1

Registries

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

Program Silo 2

Registries

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Analysis and Access Systems

Program Information Consumers

Program Silo 3

Registries

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Analysis and Access Systems

Program Information Consumers

Program Silo 4

Registries

Program Data Repositories & Data Warehouses

Policy Makers

Industry

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

Program Silo 5

Unmanageable

Complexity

>150 data flows

1000’s of reports

Dozens formats/ models

Registries

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

States

Program Silo 6

Registries

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Analysis and Access Systems

Program Information Consumers

Legislators

Program Silo 9

Registries

Local Govt

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

Program Silo 7

Registries

Program Silo 10

Registries

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

Front End Data Collection Systems

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Program Information Consumers

Program Silo 8

Universities

Registries

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Analysis and Access Systems

Program Information Consumers

Citizens

Program Silo 19

Registries

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

Tribes

Program Silo 15

Program Silo 14

Program Silo 18

Program Silo 13

Program Silo 12

Program Silo 16

Program Silo 17

Registries

Registries

Registries

Registries

Registries

Registries

Registries

Program Data Repositories & Data Warehouses

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Program Data Repositories & Data Warehouses

Program Data Repositories & Data Warehouses

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Analysis and Access Systems

Front End Data Collection Systems

Front End Data Collection Systems

Front End Data Collection Systems

Front End Data Collection Systems

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Analysis and Access Systems

Analysis and Access Systems

Analysis and Access Systems

Front End Data Collection Systems

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Program Information Consumers

Program Information Consumers

Program Information Consumers

Program Information Consumers

Program Information Consumers

Program Information Consumers

Program Information Consumers

Program Silo 11

Registries

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Analysis and Access Systems

Program Information Consumers

Program Silo 20

Registries

Program Data Repositories & Data Warehouses

Analysis and Access Systems

Front End Data Collection Systems

Program Information Consumers

Program Silo 50+

Registries

Program Data Repositories & Data Warehouses

Front End Data Collection Systems

Analysis and Access Systems

Program Information Consumers

Problem Solved by CDX / the Exchange Network

status of state nodes january 2007

In Development

Operational

Not Yet Started

Status of State Nodes - January 2007

WA

MT

ME

VT

ND

OR

OR

MN

NH

NH

ID

WI

SD

NY

MA

AK

MI

WY

RI

CT

IA

PA

PA

NE

NJ

NV

OH

IN

IL

UT

DE

CO

MD

WV

WV

CA

VA

KS

DC

MO

KY

NC

TN

OK

AZ

NM

NM

NM

SC

AR

HI

GA

AL

MS

MS

TX

LA

FL

FL

types of data network exchanges
State-to-EPA

Facility Data to FRS

Drinking Water Data to SDWIS

Haz Waste Data to RCRAInfo

Air Emissions Data to NEI

Air Quality Data to AQS

EPA-to-State

TRI Data Submissions

Substance and Chemical Data

Facility Data from FRS

Air Quality Data - Coming Soon

Types of Data Network Exchanges

State-to-State

  • Water Quality Data
  • Hazardous Waste Transporters
  • Air Quality Data – Coming Soon
  • Homeland Security Data
  • Intrastate
  • Environmental Data to Health Departments
  • Drinking Water Labs to States
  • Homeland Security/Law Enforcement Data
  • County Water Data
slide11

CDX & Exchange Network Partners

Internet

General Public

State Partners

California

Air Resource

Board

Indiana

EMITS

Industry Partners

Water Utilities

&

Power Plants

Chemical

Producers

Automobile

Manufacturers

EPA Program Office Partner Systems

Oil

Refineries

Tribal Partners

TRI

RMP

SRS

FRS

RCRAInfo

EnviroFlash AIRNow

AQS

BMS/ACRES

Eastern Band of Cherokees

St. Regis Mohawk

NEI

ODS

RADNESHAPS

ICTS

Yurok

NOI

eIUR

IGMS

SDWIS

LT2

Wind River

VERIFY

OTAQ

WQX/STORET

TSCA

RADNET

EAB

PCS

Pay.gov

Grants.gov

EPA Regional Partners

Central Data Exchange

Web Forms

Web Services

eGov Initiative Partners

Region 4 - CAFO

Data Quality

Services

Security Services

E-Authentication

Federation

Region 5 - GeoExchange

Help Desk &

Operations

Support

Hosted &

Distributed

Integration

Services

network governance

Help Desk

Registry

Etc.

Network Governance

Exchange Network Leadership Council (ENLC)

Policy/ Strategic Planning

Executive

Coordinator

Network Operations Board (NOB)

Operations Oversight

Network Partnership and

Network Policy and

Network Technical Group (NTG)*

Network Technical Group (NTG)*

Standards Teams*

Standards Teams*

Resources Group (NPRG)*

Resources Group (NPRG)*

Day to Day Operational and

Day to Day Operational and

Standards Design and

Standards Design and

Day to Day Policy and

Day to Day Policy and

Technical Support

Technical Support

Development

Development

Resource Activities

Resource Activities

Help Desk

Help Desk

Registry

Registry

Etc.

Etc.

*Example Sub

*Example Sub

-

-

Groups

Groups

interoperability levels
Interoperability Levels

XML Schemas - Data Interoperability

SOAP – Message Interoperability

WSDL – Web Service Interoperability

DIME(MTOM) – Attachment Interoperability

interoperability components
Interoperability Components
  • Data Standards
  • XML Design Rules and Conventions
  • XML Schema Review Process
  • W3C Web Service Standards
  • Network Specifications
  • Reference Implementations
  • Interoperability Testing
  • Interoperability Test Tools
  • QA Services
service interoperability guidelines
Service Interoperability Guidelines
  • Promote interoperability through the use of Open Standards
  • Incorporate Web Service Standards with Maximum Acceptance and Strongest Tool Support

*Services are currently hosted / interoperate on every major application platform

cdx exchange network technology
CDX / Exchange Network Technology
  • SOAP v1.1 (1.2): Simple Object Access Protocol
  • WSDL v1.1: Web Services Description Language
  • UDDI v3: Universal Description, Discovery and Integration
  • W3C XML-Encryption
  • W3C XML-Signature
  • SAML v1.1: Security Assertion Markup Language
  • WS-Security v1.0
  • XKMS v2.0: XML Key Management Specification
  • DIME – Direct Internet Message Encapsulation
  • (MTOM) – Message Transmission Optimization Mechanism
  • BPEL 1.1 – Business Process Execution Language
  • Exchange Network Protocol and Specification
design specifications
Design Specifications
  • Network Node Functional Specification describes
    • Actions performed by the node
    • How node functions are invoked
    • Expected node output
  • Network Node Exchange Protocol defines
    • Types of valid messages a node should receive
    • The format for sending messages among nodes
  • These specifications ensure interoperability across platforms by clearly defining the process and expected behaviors
design specifications guidance
Design Specifications / Guidance
  • Network Authentication and Authorization Specification
  • Network Security Guidelines and Recommendations
  • Flow Configuration Documents – Business rules for conducting dataflow using network nodes
  • DET/XML Schema Guidelines
  • See WWW.EXCHANGENETWORK.NET
exchange network guidance
Exchange Network Guidance
  • DATA EXCHANGE DESIGN BEST PRACTICES
    • Best Practices for Schema Design
    • Best Practices for Handling Large Transactions
    • Best Practices for Managing State
    • Best Practices for Data Services
    • Best Practices for Data Validation
  • DATA EXCHANGE MODELS
    • The Data Synchronization Model
    • The Data Publishing Model
    • Patterns in Authentication and Authorization
    • Patterns in Requesting Data
    • Patterns in Submitting Data
    • Other Data Exchange Scenarios
xml guidance
XML Guidance
  • The Core Reference Model contains major groupings of environmental data and their relationships in order to assist the development of Data Exchange Templates (such as XML schema), data standard development, and the creation of Shared Schema Components.
  • Shared Schema Components (SSC) - sharable schema components based on approved EDSC data standards and detailed guidance to XML schema developers on how they can incorporate the SSC into their XML schema.
how are services being used
How Are Services Being Used?
  • Authenticate a User
  • Authorize an Activity
  • PKI Management
  • Quality Assurance
  • Data Transformation
  • Submit Information to a Partner
  • Status Notification
  • Find a Web Service
  • Publish Information
  • Query Information
network authentication and authorization security services
Network Authentication and Authorization Security Services
  • PKI related services – support CBI activities
    • XML Key Management Services (XKMS) Public Key Management
      • Allows users to locate, publish, and validate public keys
    • Network Certificate Authority
      • Issues and manages certificates used for secure socket layer (SSL) transactions over the EN
    • Certificate Validation
      • Provides general signature/encryption validation
      • Provides certificate revocation checking against eAuthentication Federation
        • Custom API interface to MitreTek Certificate Arbitration Module (CAM)
discovery services
Discovery Services
  • Universal Description, Discovery and Integration (UDDI) registry service for cataloging and publishing Agency services
  • UDDI registry service manages information on:
      • Service providers
      • Service implementations
      • Service metadata
  • Advertise services
  • Discover services
  • Interfaces
      • Browser
      • Web services

https://uddi.epacdxnode.net/uddi/bsc/web

quality assurance services
Quality Assurance Services

Web Service-based XML document validation

  • XML Schema Validation
  • Extended business rules validation

Uses Schematron technology

Empower Data Stewards to Manage Data Quality

lessons learned
Lessons Learned
  • Develop an XML Management Approach Early
  • Use W3C Standards Where Possible
  • Use a Coarse Grained Service Model
  • Provide Tools to Simplify Adoption
  • Deliver Shared Services for Common Functions
make it faster and easier
Make It Faster and Easier!
  • Node 2.0
  • Node Client
  • Network Browser
  • Discovery Services
  • Dynamic Publisher
network node 2 0 specification
Network Node 2.0 Specification
  • Integrating the latest technologies.
    • MTOM Message Transmission Optimization Protocol
    • Relevant WS specifications
  • Parallel support for existing and new specification for a smooth transition.
  • Creating a complete turn key solution on major platforms - .NET and JAVA-Open Source
slide35

Node Client 2006 – Wizard driven access to All Network Services

XKMS

XML Signature and Encryption

slide38

Discovery Services What can I do with it?

  • Embed within an application
  • Surf with a browser
  • Use in a PDA/Smart Phone
slide39

Simplified Data Service Publishing

Empower Data Stewards to Publish their Data

keys to success
Keys to Success
  • Standards
  • Specifications
  • Shared Services
  • Exchange Agreements
  • Exchange Templates
  • Governance
  • Communications and Outreach
  • Strong Partnerships
for more information
For More Information

Connie Dwyer

EPA

Office of Environmental Information

(202) 566-1691

Dwyer.connie@epa.gov

www.exchangenetwork.net

www.epa.gov/cdx