1 / 5

AJDL job and dataset persistency

AJDL job and dataset persistency. GANGA workshop. David Adams BNL April 21, 2004. AJDL persistency Job XML Dataset XML. Contents. AJDL persistency. AJDL objects are stored in repositories XML description indexed by ID Unique ID is 2 32-bit ints

elita
Download Presentation

AJDL job and dataset persistency

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. AJDL job and dataset persistency GANGA workshop David Adams BNL April 21, 2004

  2. AJDL persistency Job XML Dataset XML Contents AJDL persistency GANGA workshop

  3. AJDL persistency • AJDL objects are stored in repositories • XML description indexed by ID • Unique ID is 2 32-bit ints • May also have metadata in selection catalog • ID plus metadata values • High level service interface for all the above • Usual class (C++, python, …) interface • May have other implementations • Files, MySQL table, … • Following slides show XML for job and dataset AJDL persistency GANGA workshop

  4. Job XML (existing) • Job • xml_version = 0.90 • fulltype = XyzJob • id = 123-456 • status = INVALID | FAILED | INITIALIZING | RUNNING | DONE | KILLED • create_time = 1000223455 • start_time = 1000223456 • update_time = 1000223457 • stop_time = 1000223457 • submit_host = subnode.org • run_host = runnode.org • job_directory = /home/junk/jobs/123-456 • processed_event_count = 10000 • processed_result_event_count = 10000 • error = 0 • Application … • Task … • XyzInDataset … • XyzOutDataset … (optional) AJDL persistency GANGA workshop

  5. Dataset XML (proposed) • EventDataset • xml_version = 1.10 • fulltype = XyzEventDataset • id = 123-456 • parent = 123-455 • is_virtual = false • event_count = 2049 • EventIdList (optional) • EventIdRange • run = 123 • first = 2401 • last = 2468 • EventId • run = 123 • event = 2470 • ... • ContentIdList • label = ESD • ContentId • name = Myclass:mykey • ... • DatasetIdList (optional) • DatasetId • id = 123-456 • ... • LogicalFileList (optional) • LogicalFile • state = READONLY • name = myfile.dat • FileCatalog … • FileId … AJDL persistency GANGA workshop

More Related