Semantic Web @ BBN Application to the Digital Whitewater Challenge

1. Semantic Web @ BBNApplication to the Digital Whitewater Challenge Mike Dean mdean@bbn.com John Hebeler jhebeler@bbn.com

2. Outline • BBN Introduction • The Digital Whitewater Challenge • Applications • Future Directions

3. BBN Technologies Overview • An advanced technology research and development firm, specializing in Information, Computer, & Physical Sciences • Known for technical excellence and challenging conventions to provide new and fundamentally better solutions to complex technical problems • Providing effective, real-world solutions and satisfying our customers and have been key to our success for over 60 years • Our staff consists of ~800 professionals • 2/3 with advanced degrees • We maintain principal offices in Cambridge, MA and the Washington, DC area

4. 1960s 1st Time Sharing Demonstration LOGO Programming Language ARPANET-First Multi-node Packet Switched Network 1970s 1st Person-to-Person Network Email @ Sign for Email Addresses Acoustic analysis of JFK Assassination Tapes Analysis of Nixon Watergate Tapes First Symmetric Multi-processor First TCP for UNIX KL-ONE Knowledge Representation System 1980s 1st Electronic Mail Defense Data Network National Science Foundation Network (NSFNET) Natural Language Computer Interface Intelligent Agents SimNet Collaboration Planning Technology Cronus Distributed Computing Environment 1990s Secure email for DoD Multi-Gigabit Router DARPA Information Assurance Broadband Wireless Technology Genetic Algorithm Scheduling Tools Collaborative Planning for Desert Storm ATM Switch 40K Word Speech Recognition System Logistics Anchor Desk deployed for Bosnia Safekeyper Certificate Management Certification Authority Workstation (CAW) 2000s Call Director Natural Language Routing Semantic Web – OWL, SWRL, OWL-S Asio tools forNet-Centric Data Sharing and Enterprise Web Services Microthunder Urban Environment Surveillance System Cognitive Agent Architecture - Cougaar Boomerang Acoustic Shooter Detection System Quantum Cryptographic Network 1950s Acoustic Design for UN General Assembly Hall AI Pattern Recognition Program History of Innovation

5. Semantic Web @ BBN • Research • DARPA Agent Markup Language (DAML) • Geospatial • Prediction • Machine Learning • Tools • Parliament • Snoggle • Asio ScoutTM • Collaboration • semwebcentral.org • Peer-reviewed papers, conference sponsorship, and books... • Working groups • Applications • Broad range of government and commercial applications from research explorations to production deployment InnovationLoop

6. The Digital Whitewater Challenge • Volume • ~ 8 exabytes/month • AT&T alone – 18 petabytes/day • youtube alone is now more than all Internet traffic in 2000 • Variety • Modes: 40% video • Formats: IM, Email, Blogs, XML, • Places: MySpace, Facebook, Second Life, Darkweb... • Trillion unique URLs • Fractal – Laptop, Enterprise, WWW • Velocity • 38 minutes to find one document • 10 second lead worth millions/lives • BUT... • Is it true? • Is it useful? • Can you find it in time?

7. Semantic Web Application Lifecycle • Model Creation • Ontology Development • Mapping • Sense Making • Steady State • Identify Outliers • Model Adaptation

8. Data Integration • Many of our applications focus on some aspect of data integration • Diverse databases, web services • Combining structured and unstructured information (RDF encoding of natural language processing output) • Translation between ontologies using SWRL plays a key role in many of our solutions • Presentations at SemTech 2007 and 2008

9. SOAP/ REST WS RDBMS AsioTM 1 Query: SPARQL Snoggle 6 Query Result Set Query Decomposition 2 Semantic Query Decomposition (SQD) Backwards Rule Chaining 5 Generation ofSub Queries 3 Automapper Semantic Bridge Database Semantic Bridge Web Service Semantic Bridge SPARQL Endpoint 4 Data Access Parliament

10. Entity Disambiguation • Co-reference resolution among multiple incomplete data sets • Which of 500 references to John Smith refer to the same person? • Scalable use of owl:sameAs and owl:differentFrom • Automated or semi-automated

11. Geospatial Semantics • Geospatial Semantic Web R&D program at NGA • Geospatial ontologies (including trade study) • Geospatial indexing of knowledge bases • Semantic annotation of georegistered imagery • Active participation in • Spatial Ontology Community of Practice (SOCoP) • Terra Cognita workshop series • US Geospatial Intelligence Foundation (USGIF)

12. Parliament • Memory-mapped embedded triple store • Descended from DAML DB • Used in most BBN projects • Soon to be released as open source • http://parliament.projects.semwebcentral.org

13. Dynamic Data Visualization Complex Data Visualization and Analysis • Challenge:Improve our ability to identify patterns, relationships, and exceptions in large, complex data sets • Solution:Capitalize on the innate ability of people to discern motion to highlight patterns, relationships, and exceptions • Results:Enables users to identify and uncover important clues and patterns buried in complex, multi-dimensional data • Applications:Intelligence, epidemiology, public safety,medical imaging, fraud detection

14. Semantic Web Sensor Network Gazetteer Imagery Database Archive Sensor IM Knowledge Streams Users Community of Interest 1 Data Sources • Processing elements • Consume and produce subgraphs • Multiple functions may be combined aggregation context filter augmentation inference User 1 Community of Interest 2 • Persistent pipelines • Streams of statements comprising object subgraphs • URI naming allows drill-down • Provenance, timestamps User 2 distribution correlation persistent queries translation alerts CEP NLP RSS User 3 Distribution And Processing Elements

15. http://silk.projects.semwebcentral.org “Semantic Rules Take the Next Big Step in Power” Catch the SemTech-2009 talk Thurs. 6/18 9:45-10:45ampresentedby Benjamin Grosof, Vulcan Inc. • A new, highly ambitious effort by Vulcan Inc., which also develops Semantic MediaWiki+ and venture invests in sem tech. Multi-institutional. • Addresses fundamental requirements for scaling Semantic Web to widely-authored Very Large KBs in business and science that answer questions, proactively supply info, and reason powerfully. • A knowledge representation (KR) system: reasoner, language, UI, interchange. • Radically extends the KR power of W3C OWL, SPARQL, and RIF – and of SQL • Defaults and robust conflict handling – cope with knowledge quality and context • Higher-order and flexible meta-reasoning – elevate meta-data to meta-knowledge • Actions and events, cf. production rules and process models – activate knowledge • Use cases in business policies, ontology mapping, e-commerce, biomed. • Redefining the KR playing field for semantic web, business rules, and rule-based process management. • How You can be Involved: • In ~ fall 2009: try out SILK software; comment on SILK language design • Visit the SILK webpage, subscribe to (rare) announcements, cooperate in other ways

16. For More Information • bbn.com • asio.bbn.com • parliament.projects.semwebcentral.org • iswc2009.semanticweb.org