system wide information management swim
Skip this Video
Download Presentation
System Wide Information Management (SWIM)

Loading in 2 Seconds...

play fullscreen
1 / 31

System Wide Information Management (SWIM) - PowerPoint PPT Presentation

  • Uploaded on

System Wide Information Management (SWIM). Service-Oriented Architecture (SOA) Testing. Agenda. Traditional Testing Migration to SOA Conceptual SOA Traditional vs. SOA Testing SOA Testing Solutions Anticipated Challenges. Characteristics of Traditional Testing.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'System Wide Information Management (SWIM)' - josef

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
system wide information management swim

System Wide Information Management (SWIM)

Service-Oriented Architecture (SOA) Testing

  • Traditional Testing
  • Migration to SOA
  • Conceptual SOA
  • Traditional vs. SOA Testing
  • SOA Testing Solutions
  • Anticipated Challenges
characteristics of traditional testing
Characteristics of Traditional Testing
  • In most cases, non-agile but well established proven process
  • Single-system focused: not dependant on other systems within your business domain
  • Tightly coupled
  • Well-defined interfaces specified in the Interface Control Document (ICD)and Initial Requirements Document (IRD)
  • Limited security constraints, if any
  • Test program is based on the common Verification & Validation (V&V) test model
  • Test team only needs to be technically savvy on the system under test, and not the entire business domain
  • Test Tool Strategy is needed because systems are usually furnished with custom tools
  • Test requirements only apply to the system/subsystem and interfaces
stand alone server architecture
Stand Alone Server Architecture
  • Applications share data and functions on an isolated single machine, no loose coupling
  • Each application communicates with others in a point-to-point, one off interface design
  • Difficult to upgrade or replace
client server architecture
Client Server Architecture
  • Server applications share data and functions on a single machine, no loose coupling
  • Each server based application communicates with others in a point-to-point, one-off interface design
  • Supports multiple users
distributed server architecture
Distributed Server Architecture
  • Server applications share data and functions across multiple server machines, possible loose coupling
  • Each server based application communicates with others in a point-to-point, intranet, or internet design
  • Supports multiple users and supplies composite data
web services server architecture
Web Services Server Architecture
  • Server applications share data and functions across multiple server machines, possible loose coupling
  • External data and/or function provided externally
  • Each server based application communicates with others in a point-to-point, intranet, or internet design
  • Supports multiple users, supplies composite data
  • Data collections and function hosted by internal and external servers loosely coupled
  • Collections often communicate using a single interface
  • Reuse and upgrades are less challenging
  • Multiple remote users

Test Complexity







From Oasis (,

SOA is defined as –

“An architectural style whose goal is to achieve loose coupling among interacting software agents/services.”

SOA enables business flexibility in an interoperable, technology-agnostic manner. It consists of a composite set of business-aligned services that support a flexible and dynamically re-configurable end-to-end business processes realization using interface-based service description.

SOA is a commonly chosen implementation architecture process for today's largely distributed businesses or systems.

some benefits of soa are
Some Benefits of SOA are:
  • Reducing integration expense: uses open standards, not expensive proprietary middleware
  • Increasing asset reuse: legacy systems can be easily wrapped as services and exposed
  • Increasing business agility: services and systems may be rapidly developed, tested, and delivered
  • Reduction of business risk
  • Loosely coupled: a modified service does not affect other service or client
  • Interoperable: platform-neutral
components that make up soa
Components that make up SOA
  • Service provider
  • Service consumer
  • Service registry
  • Governance Lead
  • Administrator

SOA services are intended to be reusable and can be shared within the entire business domain

soa characteristics
SOA Characteristics
  • SOA transport protocols:
    • Hypertext Transfer Protocol (HTTP)
    • HTTP Secure (HTTPS)
    • Java Message Service (JMS)
  • Messaging:
    • Extensible Markup Language (XML)
    • Web Services (WS)-Addressing
    • SOAP
  • Interface:
    • Web Service Description Language (WSDL)
  • Quality of Service (QoS):
    • Security
    • Reliable messaging
    • AuthN / AuthZ
    • Policies
    • Etc.
  • Governance:
    • National Airspace System (NAS) Service Registry/Repository (NSRR)
common soa testing challenges
Common SOA Testing Challenges
  • No visibility below the User Interface to isolate errors
  • Data driven business logic is service embedded
  • Inaccessible external services
  • Inability to test components that do not have an available User Interface
  • Need for continuous validation of application functionality
  • Inability to test composite solutions due to limited access or availability of dependent services and data needed for testing
  • Inadequate or incomplete testing, resulting in costly problem identification and debugging once released into production
common soa testing challenges cont
Common SOA Testing Challenges (cont.)
  • Poor collaboration between development and Quality Assurance (QA), with minimal to no reuse of test assets between unit, functional, regression and performance testing
  • Security testing needs to intensify as threat grows
  • Test team structure will require alignment to business domains (processes) and not to technologies to ensure that agility and speed on SOA testing do not compromise overall service quality
  • Organizations will have to develop and maintain “Test Assets” for key services to guarantee performance and security throughout the entire test coverage cycles
traditional testing vs soa testing
Traditional Testing vs. SOA Testing


  • Both Traditional and SOA methodologies can utilize the success proven V-Model
  • The V-Model enforces testing discipline throughout the project life cycle
  • Both can utilize the top down or bottom up test approach
soa testing solutions
SOA Testing Solutions
  • Service Level Testing (SLT) emphasis
  • Security Testing and the project lifecycle
  • SOA and NAS experts leverage
  • Test Tool Strategy implementation
slt emphasis
SLT Emphasis
  • SLT Emphasis
    • Test emphasis at the SLT level over Governance testing, service-component level testing, integration-level testing, process/orchestration-level testing, system-level testing, and Security testing
  • Formal Code Peer reviews
    • Ensures standards and compliance are met
    • Identifies potential interoperability, performance, and security defects and weaknesses
  • Continuous Functional, Performance and Security tests against the Services
    • Requires the use of test tools and/or test harnesses
  • Quality Entrance and Exit Criteria for SLT
    • Ensures service usability
security testing and the project lifecycle
Security Testing and the Project Lifecycle
  • Security requirements should be established
  • Security risk assessments should be performed during the technical design phases
  • Technical deliverables should be validated in accordance with the groups security standards
  • Security tests should be performed at the service level and not just the delivered integrated system level
  • Security audits should be performed and reported on periodically
soa and nas experts leverage
SOA and NAS Experts Leverage
  • Subject Matter Experts / Domain Experts
    • NAS expertise
    • SOA domain expertise
    • Software development expertise
  • Certified Resources
    • Certified individuals
    • Certified tools
  • Software Support
    • Commercial Off-The-Shelf (COTS) support contracts
    • Open Source community and committers
  • Knowledge Sharing
    • Content repositories (SWIM Wiki, Knowledge Services Network (KSN))
    • Working groups
test tool strategy implementation
Test Tool Strategy Implementation
  • SOA Test Tools
    • iTKO LISA, soapUI
  • XML Tools
    • Altova XMLSpy, XML Copy Editor
  • Integrated Development Environments (IDEs)
    • FUSE IDE for Camel, Eclipse IDE, NetBeans IDE, IntelliJ IDEA
  • Web Consoles and Browsers
    • Web consoles for ActiveMQ, Camel, Oracle AS, Glassfish, etc.
    • Fuse HQ, Lightweight Directory Access Protocol (LDAP) browsers, management and monitoring tools
business and financial metrics
Business and Financial Metrics
  • Efficiencies associated with service reuse
  • Integration time savings
  • Related opportunity costs
  • Cost savings/avoidance
  • Reduction in project and maintenance cost

SOA ROI ($) = Cost Savings/Efficiencies Achieved - All SOA-Related Investments

SOA ROI (%) = SOA ROI ($) All SOA-Related Investments

Source: Leo Shuster, who is responsible for National City Bank's SOA

soa performance metrics
SOA Performance Metrics
  • Overall ROI can be projected by per service ROI’s
  • Overall ROI can be projected by per service revenue
  • Monitor service growth rate/reuse to ensure reuse maximization
  • Design to deploy business agility
  • Mean time to service change agility measurement
  • Reliability mean time to failure
  • Service vitality and revenue tracked for 12 months
anticipated future challenges
Anticipated Future Challenges
  • Services Metadata
    • Employing Governance in regards to managing and providing information on how services interact
  • Level of Security
    • Protection against theft of sensitive data and application infrastructure vulnerabilities
  • Test Coverage
    • Continuous services testing by producers and consumers to ensure expected functionality
  • Scalability
    • Specialized support for persistence, failover, and load balancing
  • XML Message Size
    • Additional bandwidth and resources for parsing/processing
  • Increase in Connections
    • Connection management for server burden relief
    • Shared services hosting to avoid latency from additional hops
  • Traditional Testing has its place
  • Migrate to SOA where appropriate
  • SOA brings benefits such as loose coupling, code/services reuse, and remote users
  • SOA test products are numerous, mature and vary for many different use cases
  • SOA challenges have been identified with many modeled solutions available to pursue
keys to a successful soa solution
Keys to a Successful SOA Solution

Definition of SOA

Find Business Partners

Aim for Critical Mass