Capture disparities highlighted by provenance datasets
Download
1 / 10

Capture Disparities Highlighted by Provenance Datasets - PowerPoint PPT Presentation


  • 105 Views
  • Uploaded on

Capture Disparities Highlighted by Provenance Datasets. G. Blake Coe + , R. Christopher Doty * , M. David Allen + , Adriane P. Chapman + + ( gcoe , dmallen , achapman )@ mitre.org * chris.doty@library.gatech.edu. Capture. When a single system is used, provenance is Complete

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Capture Disparities Highlighted by Provenance Datasets' - sakura


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Capture disparities highlighted by provenance datasets

Capture Disparities Highlighted by Provenance Datasets

G. Blake Coe+, R. Christopher Doty*, M. David Allen+, Adriane P. Chapman+

+(gcoe, dmallen, achapman)@mitre.org

*chris.doty@library.gatech.edu


Capture
Capture

  • When a single system is used, provenance is

    • Complete

    • Obtained by one capture point

    • Options of granularity

    • High quality

      • E.g. can see payload in addition to envelope


Real world capture is complicated

PLUS

Real World Capture is Complicated

PASS

Taverna

Coordination points for automatic provenance capture


The results of real world capture are complicated
The Results of Real World Capture Are Complicated

  • There may be multiple, independent observations of the same thing

    • sending system observes transmission of M; receiving system Y observes the receipt of M.

  • Data or processes may be observed via different technical channels

    • program generates a file M on disk; months later, user receives email with attachment M

  • Disconnection and duplication occurs


What do we need when capture is messy
What do we need when Capture is Messy?

  • Ability to identify when multiple, independent observations of the same thing occurs

    • And what to do with that information

  • Ability to go “up and down” in the provenance abstraction

    • E.g. work over all of the low-level OS provenance, or just the application-generated provenance, etc.

  • Ability to function over incomplete provenance graphs

  • Impossible to work on these issues when the only provenance datasets are generated via single or heterogeneous systems


The datasets provided
The Datasets Provided

  • Actually 3 Datasets!

    • Complete

    • App-Based

    • User Monitor

  • Show the differences in provenance record when different capture agents are used

  • In PROV-XX

App-Based

User Monitor

Complete

  • Related across datasets

    • E.g. the first G1Complete is the same set of actions as G1App-Based is the same as G1UserMonitor


Complete
Complete

  • “Uber User View” a.k.a. “what Actually happened.

  • Based on a use case observed within the Georgia Tech Library system

Save links

App: Word,

SharePoint

User: Alice

Web Data

Browse

App: Firefox

User: Alice

Web Data

Web Data

Notes.txt

Web Data

Web Data

Web Data

Email from Prof

Email from Mom

Create Summary

App: Word, SharePoint

User: Alice

View

App: Outlook

User: Alice

Email from Prof

View

App: Outlook

User: Bob

Review

App: Word

SharePoint

User: Bob

Summary.doc

Publish

App: SharePoint

User: Cathy

AboutInstitution

Summary.doc’


App based
App-Based

  • Capture points in

    • SharePoint

    • Firefox

  • Notice not all processes observable!

Web Data

Browse

App: Firefox

User: Alice

Save links

App: Word

SharePoint

User: Alice

Web Data

Web Data

Notes.txt

Web Data

Web Data

Web Data

Create Summary

App: Word, SharePoint

User: Alice

Review

App: Word

SharePoint

User: Bob

Summary.doc

Publish

App: SharePoint

User: Cathy

AboutInstitution

Summary.doc’


User monitor

Save links

App: Word,

SharePoint

User: Alice

Web Data

Browse

App: Firefox

User: Alice

Web Data

Web Data

Notes.txt

Web Data

User Monitor

Web Data

Web Data

Email from Prof

Email from Mom

Create Summary

App: Word, SharePoint

User: Alice

View

App: Outlook

User: Alice

Email from Prof

View

App: Outlook

User: Bob

Review

App: Word

SharePoint

User: Bob

Summary.doc

  • Capture Point in SpectorSoft

    • User Monitoring Software

  • Notice that all applications are seen, but edges lacking

Publish

App: SharePoint

User: Cathy

AboutInstitution

Summary.doc’


Conclusions
Conclusions

  • Providing a set of related datasets and workload queries to facilitate research on provenance capture and system interoperability

  • PLUS, and some capture agents, can be found at https://github.com/plus-provenance/plus

  • Datasets can be found at ProvBenchhttps://github.com/provbench