1 / 27

Application status

Application status. F.Carminati 11 December 2001. Application integration + Test plan 1 person / application. Integration assessment 1 person / application. Party!. Software integration. WP8. 8. 15. 29. 26. 3. 22. 5. 12. 19. 10. 17. WP9. Doc review WP1 M.Reale WP2 J.Templon

dewey
Download Presentation

Application status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Application status F.Carminati 11 December 2001

  2. Application integration + Test plan1 person / application Integration assessment1 person / application Party! Software integration WP8 8 15 29 26 3 22 5 12 19 10 17 WP9 Doc review WP1 M.Reale WP2 J.Templon WP3 I.Augustin WP4 A.De Salvo WP5 JJ.Blaising Message to WP9 & WP10 WP10 WP8 staffVO set up Basic testing (?) Start writing 8.2 TWG + WP8-10 General MeetingValidation plans presented Validation plan timeline – new October 30 2001 Architect WP meeting

  3. Application integration + Test plan1 person / application Integration assessment1 person / application Party! Software integration WP8 8 15 29 26 3 22 5 12 19 10 17 WP9 Doc review WP1 M.Reale WP2 J.Templon WP3 I.Augustin WP4 A.De Salvo WP5 JJ.Blaising WP10 WP8 staffVO set up Basic testing (?) Start writing 8.2 TWG + WP8-10 General MeetingValidation plans presented Validation plan timeline – now Architect WP meeting

  4. What next? • The integration is now finished • All the actors should be praised • However the integration process took 300% more time than planned • May be this was physiological in such a large project • But it should not happen again • We should not let it dis-integrate again • Single WPs must integrate regularly their new versions in the TB • We need development and production environment • They do not need to be released at once • This has to be a continuous process Architect WP meeting

  5. Application validation • 8.2 will contain all we can do from today to Christmas • It is very important that now we have the access as soon as possible • This week one person/application • Next week the validation groups • For the review we may have one more month of testing to report • But WP6 must stand by supporting the users • We may hint this in 8.2 • We can still do a reasonable job, with a bit of luck Architect WP meeting

  6. What we want March 9 2001 Specific application layer ALICE ATLAS CMS LHCb WP9 WP 10 VO common application layer WP8-9-10 TWG HEP Earth Obs. Biology DataGRID middlewarePPDG, GriPhyn, DataGRID DataGRID ATF GLOBUS team Bag of Services (GLOBUS) OS & Net services Architect WP meeting

  7. It will be easier for them to arrive at Or even better If we manage to define VO common application layer WP8-9-10 TWG HEP Earth Obs. Biology VO common application layer VO common application layer HEP HEP Earth Obs. Earth Obs. Biology Biology WP8-9-10 TWG WP8-9-10 TWG Common core use case Common core use case WP1 WP1 WP1 WP2 WP2 WP2 WP3 WP3 WP3 WP4 WP4 WP4 WP5 WP5 WP5 WP1 WP2 WP3 WP4 WP5 DataGRID middleware DataGRID middleware DataGRID middleware DataGRID middleware What we have Specific application layer ALICE ATLAS CMS LHCb WP9 WP 10 GLOBUS team Bag of Services (GLOBUS) OS & Net services Architect WP meeting

  8. A modest proposal • Identify one / two experts from each application • Have them meet regularly for some limited amount of time to produce a proposal • Ideally a couple of months • Meet in person or via videoconf • Discuss this proposal at the next architect – WP meeting • Have the different applications accept this proposal as their GRID baseline Architect WP meeting

  9. Why this is fundamental? • The LCGP (Lhc Computing Grid Project) will require us to work on common projects • The HICB (intergrid coordination board) expects proposal from the experiments • It would be MUCHsmarter to provide a single core use case • Instead of competing one with the other • The different GRID projects risk to diverge • A common core use case could help them to develop coherent solutions • Or ideally complementary elements Architect WP meeting

  10. Experiment activities • There is a quite large expertise in the experiments about GRID • Experiments are already using GRID tools in production • It is important that this experience is put to work for DataGRID providing qualified feedback Architect WP meeting

  11. CMS Architect WP meeting

  12. CMS Production Sites, Data transfers GDMP widely used Condor-G used at few sites HIP Caltech Bristol/RAL IN2P3 FNAL Moscow Min.Bias Objy/DB Wisconsin UCSD CERN .fz files Objy/DB UFL RC archiving data INFN RC publishing data Direct access to INFN Objy Federations through AMS Architect WP meeting by V. Lefebure

  13. Regional Center Request decomposition (Job scripts) “Produce 100000 events dataset mu_MB2mu_pt4” Production Manager distributes tasks to Regional Centers RC farm JOBS Production Interface RC BOSS DB Farm storage Data location through Production DB Production DB Request monitoring (Job scripts) Request Summary file Job scripts – BOSS integration Architect WP meeting

  14. CMS - MOP Architect WP meeting

  15. Distributed DB TAG Analysis Architect WP meeting

  16. ATLAS Architect WP meeting

  17. USAtlas Tool Development Condor (G) GRAPPA GRAM GSI Monitoring MDS/ GIIS/GRIS GridFTP Replica Cat Magda Replica Mgr PacMan Packaging Architect WP meeting

  18. Collection of logical files to replicate Location Location Site Site Location Location Spider Location Location Mass StoreSite Location Location Disk Site Source to cache stagein Location Host 1 Location Location Cache MySQL Synch via DB scp, gsiftp Source to dest transfer Site Host 2 Location Location Location Spider Register replicas Replication task Catalog updates Magda Architecture Diagramwww.usatlas.bnl.gov/magda/info Architect WP meeting

  19. Grappalexus.physics.indiana.edu/~griphyn/grappa/ Architect WP meeting

  20. ATLAS run time environment & monitoring atlasgrid.bu.edu/atlasgrid/atlas/atlas_cache/cache.html www.mcs.anl.gov/~jms/pg-monitoring heppc1.uta.edu/kaushik/computing/grid-status/index.html Architect WP meeting

  21. LHCb Architect WP meeting

  22. Globus use in LHCb • Globus-job-submit (tested, works in production) to: • Testbed 0 • Csflnx01.rl.ac.uk (RAL) • Ccali.in2p3.fr (IN2P3) • Don’t use Globus RSL, give options on Globus-job-submit command line • Some instability in service • Need Globus client s/w on LXPLUS • Globus-rcp tested, not reliable enough • Globus-FTP tests underway NIKHEF-SARA Architect WP meeting

  23. ALICE Architect WP meeting

  24. ALICE GRID August Production Architect WP meeting

  25. ALICE GRID • File Catalogue as a global file system on top of a RDB • TAG Catalogue, as extension • Secure Authentication • Interface to Globus under development • Central Queue Manager ("pull" vs "push" model) • Monitoring infrastructure The CORE GRID functionality • http://alien.cern.ch Architect WP meeting

  26. Selection Parameters TagDB CPU Procedure PROOF DB1 RDB CPU Proc.C DB2 Proc.C DB3 CPU Proc.C DB4 CPU Proc.C DB5 CPU Proc.C DB6 CPU DataGrid & ROOT Local Remote Bring the KB to the PB and not the PB to the KB Architect WP meeting

  27. Conclusion • Time is very tight for validation before the review • The release process will be of fundamental importance for the further development of the project • We have to follow it closely • Some work needs to be done to integrate and streamline products and procedures • But for this you need real users! • Some work needs to be done on the user side to provide a more usable/useful picture to developers • A huge potential is there, up to us to exploit it correctly! Architect WP meeting

More Related