1 / 50

LCG Generator

LCG Generator. P. Bartalini (University of Florida). F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev, F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. Vologdin. MC4LHC. Generator Services P.Bartalini. WP. WP.

william-garza
Download Presentation

LCG Generator

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CHEP 2004 LCG Generator P. Bartalini (University of Florida) F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev, F. Moortgat, H. Naves, A. Ribon, A. Sherstnev, I. Seluzhenkov, V. Uzhinsky, A. Vologdin

  2. MC4LHC Generator Services P.Bartalini WP WP LCG Simulation Project Organization Experiment Validation Geant4 Project FLUKA Project Simulation Project G.Cosmo Framework V. Pokorski Geant4 J.Apostolakis FLUKA Integration A.Ferrari Physics Validation F.Gianotti/A.Ribon Shower Param WP WP WP WP WP WP WP WP WP WP WP WP WP P.Bartalini – CHEP 2004 - September 27 2004

  3. LCG Generator GOAL: to guarantee the generator support for LHC WPA:GENERATOR SERVICES LIBRARY (GENSER) WPB: TUNING AND VALIDATION WPC: SHARED EVENT FILES: PRODUCTION & DATA BASE WPD: EVENT FORMATS AND EVENT INTERFACES Florida (Coordination) CERN (Event Interfaces) LCG-Russia (Library & Data Base) LCG-Spain (Production) Collaboration with independent projects: LCG-UK (Validation, New MCs) Contact persons/Collaborators in MC Projects and LHC Experiments Started May 2003 Long Term Project Workshop on MC’s for the LHC (MC4LHC) CERN, July 7 - August 2 2003 GENSER Review CERN, March 25 2004 P.Bartalini – CHEP 2004 - September 27 2004

  4. Between Two Different Worlds • Small Theoretical groups • Huge fortran packages still in development • Need help with the new OO packages • Need to share user support duties LCG Generator • Large Experimental Collaborations • Complex OO Simulation Frameworks • Need easy access to many generators, responsive user support, bug fixes etc. P.Bartalini – CHEP 2004 - September 27 2004

  5. WPA. The LCG Generator Library (GENSER) GOAL: to replace the obsolete CERN Library  Mandate: Collaborate with MC authors to prepare LCG Compliant Code • HERWIG (P.Richardson), PYTHIA (T.Sjöstrand), HIJING (X.N. Wang), ISAJET (F.E. Paige), LHAPDF (M.Whalley), ALPGEN (M.Mangano), COMPHEP (A.Sherstnev), EVTGENLHC (P. Robbe), GLAUBER (V.Uzhinsky), FROZEN (PHOTOS, PDFLIB), ORIGINAL CODE (Validation, Data Base, Production) • Future: DPMJET, MC@NLO, GRACE, MADGRAPH, NEXUS, PHOJET, SFM, TAUOLA, HERWIG++, PYTHIA 7, SHERPA, etc.  Clients: Addressed to LHC experimentalists and theorists both at CERN and in external laboratories. (Other users welcome!) • Tested by all the LHC experiments • Quarterly Release Scheme • Librarian (MSU, ITEP, Troitsk, Protvino, CERN) ~ 1 FTE • One person based at CERN another one rotating with ~ quarterly shifts ATLAS PRODUCTION RELIES ON GENSER !!! P.Bartalini – CHEP 2004 - September 27 2004

  6. WPA. GENSER: Policy and Structure • Releases decoupled from large library releases • Quarterly official releases, quick bug fixes and special versions • Most of the MC package versions released by the authors are installed • Old versions have to be maintained as long as they are used • Manage to provide all the requested LCG supported platforms Documentation:http://lcgapp.cern.ch/project/simu/generatorSavannah Portal:http://savannah.cern.ch/projects/simu/ AFS:/afs/cern.ch/sw/lcg/app/releases/GENSER • CVS repository, AFS, Compact Tarball distribution, LCG Tools • SCRAM release and building tool for librarian and end-users • Binary distribution also provided • Test/Validation software (provided by authors, end-users and librarians) • Installed in the «Example» and «Test» modules • Code development for WPA, WPB, WPC, WPD P.Bartalini – CHEP 2004 - September 27 2004

  7. WPA. MC Packages: Inside or Outside GENSER ? • Three possibilities: 1) To develop the MC package in GENSER: MCDB, EVTGENLHC • EVTGENLHC derives from EVTGEN: http://agenda.cern.ch/fullAgenda.php?ida=a035838 • Provided (Adapted) by LHCb  Contact person P.Robbe • LHCb has full access to the package in the GENSER repository • Other contributors have a limited access (development of new decay models, decay files etc.) 2) To fully export the MC generator code in GENSER defining the corresponding sub-package: MOST OF THE INSTALLED MCs 3) To install the MC generator as external software packages in the LCG environment and to store in GENSER just tests suites and other related code COMPHEP, EVTGEN Just a technical issue! For each MC package an ad-hoc solution is found taking into account the user requirements P.Bartalini – CHEP 2004 - September 27 2004

  8. WPA. GENSER Repository Structure GENSER_0_2_0 | |--- config/ |--- doc/ |--- include/ |--- logs/ |--- release.notes |--- rh73_gcc323/lib/ bin/ tests/ | ---include/ |--- src/herwig/data/ doc/ dummy/ examples/ includes/ src/ MC Package version provided as CVS Tag P.Bartalini – CHEP 2004 - September 27 2004

  9. GENSER_0_2_0: 11 Generators 2 PDF Packages 30 Versions WPA. GENSER_0_1_0: Mid Apr. 2004 (rh73_gcc32) GENSER_0_2_0: Mid Sep. 2004 (+ rh73_gcc323) GENSER_1_0_0: Mid Dec. 2004 (+ Scientific Linux) • PYTHIA: 6.205, 6.217, 6.220, 6.221, 6.222, 6.223, 6.224, 6.304, … • HERWIG: 6.500, 6.503, 6.504, 6.504b1, 6.505, … • JIMMY: 4.1, … • ISAJET: 7.67, 7.69, … • EvtGen:alpha-00-11-07 • EvtGenLHC: 1.0, … • AlpGen: 1.3.2, … • CompHEP: 4.4.0, … • LHAPDF: 1.1, 2.0, … • PDFLIB: 804 • PHOTOS: 202, 207 • Glauber Xs (Heavy Ions): 1.0, … • HIJING (Heavy Ions): 1.36, 1.37, 1.383, 1.383b, … • Packages in the waiting list, with particular emphasis on SHERPA P.Bartalini – CHEP 2004 - September 27 2004

  10. WPB. Monte Carlo Validation and Tuning GOAL: to cross-check MCs and compare with data • Basic Sanity Checks • Reference distributions (multiplicities, PT Spectra etc.) • Standalone Studies • Work on GENSER subpackages (Librarian, Beta Testers in Experiments) • ALPGEN Validation (Perugia)  Essential to verify ALPGEN in GENSER • HIJING Validation (JINR, Dubna)  Encouraged to contribute to JetWeb • Validation Framework • JetWeb: in production • LCG-UK (U.C.London) • http://jetweb.hep.ucl.ac.uk/ [Comp. Phys. Comm. vol 153/2 164-178 (2003)] Database of Data, MC & Comparisons Web interface, Job submission Will switch soon to GENSER ? P.Bartalini – CHEP 2004 - September 27 2004

  11. WPC: Production of Shared Event Files GOAL: to produce certified generator level events • Use them for benchmarks, comparisons & combinations in LHC W.G. • Improve the quality of shared samples with respect to LEP W.G. era !!! Will Be Officially Adopted By CMS • Production framework • Proposal June 2004 • Design Available. Prototype Stage • Active institutions: CERN, Santander, Oviedo • Production centre • Configuration & Book-keeping • ~ 1 FTE from LCG Russia (MSU, ITEP, JINR) • MCDB: a version Deployed! Tested At Fermilab Tested By CMS P.Bartalini – CHEP 2004 - September 27 2004

  12. WPC. Monte Carlo Data Base (MCDB) • Motivations • To Provide Configuration, Book-keeping, Documentation, Storage for the Shared Event Files • To keep track of the full generation chain, Exploiting the Competences of Monte Carlo Experts and Monte Carlo Authors • CMS MCDB http://cmsdoc.cern.ch/cms/generators/mcdb/ • Only parton level files; AFS storage; No Searchable; No SQL • LCG MCDB [hep-ph/0404241] • Same authors + Additional human resources and technical support • Core software supported by LCG Software Project Infrastructure • MySQL; POOL; CASTOR (RFIO); CGI; Perl; Apache • Web Interface, Dedicated Web Server http://mcdb.cern.ch • a version supports only Mozilla Browser P.Bartalini – CHEP 2004 - September 27 2004

  13. WPC. MCDB: SQL Structure and Access Policy SQL Table Structure End-User • Read articles, comments, news • Download event files Author • Post articles • Upload event files • Post news and answer the comments Moderator • Manage users profiles • Moderate articles and comments Administrator • Control the system • Technical database management Application Package Interface • Automated articles posting/retrieving and samples upload/download P.Bartalini – CHEP 2004 - September 27 2004

  14. WPC. MCDB Web Interface Screen-shot http://mcdb.cern.ch Only Mozilla Browser Supported (for the time being) P.Bartalini – CHEP 2004 - September 27 2004

  15. WPD. Event Formats and Event Interfaces GOAL: standardize interfaces, support the new OO MCs • The modularisation • Basic idea in ThePEG, PYTHIA 7, HERWIG++, SHERPA • From April 2004 LCG Generator participates to the development of ThePEG  We started with improving the doxygen documentation (A.Ribon) Activity coordinated with Phenogrid (N.Glover et al.)  Relevant for the Herwig++ development • The MC truth Interface • HEPML proposal (XML - Les Houches Agreement I compliant) Meta-data format facilitating automated documentation • HEPMC Under the responsibility of CLHEP (still some problems with translators) P.Bartalini – CHEP 2004 - September 27 2004

  16. WPD. HEPML Proposal (COMPHEP Collaboration) • All data in event file are divided in two parts • Header -describe the general information • Author, the file itself (creation date etc.), supported specifications, collider description etc. • Generator specific info, cuts, physical parameters etc. • Info for parser (format of event records etc.) • Event Records - variable data of events written in some compact format to one string (particle momenta, color chains etc.) • Header is stored in a txt file with XML Syntax • Event Records are (zip) compressed and attached to the Header file [S.Sherstnev] P.Bartalini – CHEP 2004 - September 27 2004

  17. WPD. XML in HEP A.Kryukov Skobeltsyn Institute of Nuclear Physics (kryukov@theory.sinp.msu.ru) On behalf of CompHEP Collaboration Presented to LCG-Generator http://agenda.cern.ch/fullAgenda.php?ida=a035826 • Why XML ? • Describe the document structure • Extensible language • WEB ready • Well defined open standard • Available tools to treat of XML P.Bartalini – CHEP 2004 - September 27 2004

  18. LCG Generator Future Plans • MILESTONES • Q4/2004-WPA- GENSER: release version (ref. MC RTAG report) • Q1/2005-WPA- SHERPA (F.Krauss et al.) fully integrated in GENSER • Q2/2005-WPC- Generator level production framework: beta version • Q3/2005-WPD- First test of ThePEG and EvtGenLHC integration in Herwig++ (and Possible insertion of Herwig++ in GENSER) • Q3/2005-WPC- Production centre integrated in the grid-middleware • Q4/2005-WPC- Generator level production framework: release version • Q1/2006-WPC- MCDB Integration with Generator level production framework, experiment specific APIs and management of large files • WPB milestones to be verified with other independent projects Enphasis on the collaboration with Object Oriented MC projects P.Bartalini – CHEP 2004 - September 27 2004

  19. Organisational Issues WEB page http://lcgapp.cern.ch/project/simu/generator  Links to relevant documentation, CVS repository, release.notes etc. CDS Agenda Home>Projects>LHC Computing Grid>Physics Generators  Minutes of meetings, slides of presentations Meetings:  Last Thursday of the month at 5 PM in CERN-32-1-A24 & VRVS (Last and Next meetings anticipated to SEP 23 and OCT 21 respectively)  Next meeting will be devoted to the Management of GENSER Releases Applications area mailing list: project-lcg-simu@cern.ch P.Bartalini – CHEP 2004 - September 27 2004

  20. Backup General P.Bartalini – CHEP 2004 - September 27 2004

  21. 13:45 Introduction (Bartalini, P.) 13:50 LHAPDF v2 (Whalley, M.) 14:20 GENSER, the generator library (Alexander, S.) 14:50 GENSER validation (Ambroglini, F.) 15:05 User experience with GENSER (Hinchliffe, I.) 15:25 The LCG generator library (Discussion) (all) 16:25 ---Coffee--- 16:40 A framework for generator level production&validation (Bartalini, P.) 16:55 The MCDB project (Dudko, L.) 17:10 MCDB Implementation (Vologdin, A.) 17:25 The HEPCODE project (Stirling, W.J.) 17:35 Event formats & Monte Carlo data base. (Discussion) (all) Agenda of LCG Generator Review (March 2004) P.Bartalini – CHEP 2004 - September 27 2004

  22. WPC. Simple Generator Level Production Framework • Progress on the simple generator level production framework were achieved during the quarter. • A Prototype is being developed by H.Naves and J.Cuevas (Santander). • It reads generator cards, produces events, performs basic event selection, and writes out using the HEPMC structure in POOL and in ROOT formats. P.Bartalini – CHEP 2004 - September 27 2004

  23. Backup MCDB P.Bartalini – CHEP 2004 - September 27 2004

  24. MCDB Introduction • Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertise • Different physics groups often are in need of the same MC samples • Public availability of the event files speeds up their validation • Central and public location where well-documented event files can be found would be very useful [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  25. CMS MCDB Problems • Stores parton level events only • The expected number of physics processes in the database is several hundred (data are stored on AFS so there is a space limitation) • Cannot serve sophisticated queries owing to it isn’t SQL based Advantages • Based on web technologies • Stores detailed documentation for each set of event samples • Storing data on AFS let make its easy of access • Provide rapid communication between users and experts [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  26. Main Features of LCG MCDB The most important reason to develop LCG MCDB is to expel the restrictions of CMS MCDB • An SQL-based database • Wide search abilities • Possibility to keep the events at particle level as well as at partonic level • Direct programming interface from LCG collaboration software • Inheritance of all the advantages of the predecessor - CMS MCDB [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  27. MCDB: General Conceptions and Terms • Event file (sample) – the file containing particle or partonic events • Article – a document describing the set of samples • Event data – the events themselves, all the data are stored into event files • Event metadata – information which describes all events in a sample in general (beam description, physics parameters, applied cuts, etc.) [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  28. MCDB Interfaces • Search form • Article management (creating, changing, removing) • Downloading sample files • User management (registration, editing profiles, removing) • Editing metadata on physical models and parameters • Moderating articles and user comments on them • Application programming interface to allow program-based article creation • Comment the articles [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  29. Access Ways to LCG MCDB End-User • Read articles, comments, news • Download event files Author • Post articles and upload event files • Post news and answer the comments Moderator • Manage users profiles • Moderate articles and comments Administrator • Control the system • Technical database management Application software • Automatic articles posting and samples upload [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  30. The Most Common Operations with MCDB Users in general • Browses articles via the tree view of physics categories • Searches by author, title, keywords, physical processes, parameters values, etc. • Downloads desired sample after agreement on MCDB License Articles’ authors • Uploading event files • Completing article with the information that wasn’t not included in the description of an event file [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  31. MCDB: Software Selection • SQL DBMS: MySQL • Script system: Perl • Web-server: Apache2 • Web-interface: CGI+Perl • CASTOR: RFIO package • All the products are supported as standard software in LCG [A.Sherstnev] P.Bartalini – CHEP 2004 - September 27 2004

  32. SQL tables in MCDB • Authors • Articles • Categories • Generators and their parameters • Models and parameters names • Model parameters’ values • Processes, initial and final states • Applied cuts • Event files, graph files and a few other tables [S.Belov] P.Bartalini – CHEP 2004 - September 27 2004

  33. MCDB: Current Status • SQL tables structure: done • Internal Perl modules (access to the MCDB SQL tables, parse configuration file, many others): partly done • User area: • Web site: first prototype done (mcdb.cern.ch) • Web catalog script: done • Author area • Web interface for creation of articles: done • Uploading of files to HDD: done, to CASTOR: in progress • Web interface for editing of articles: in progress • Administrative area: • User management interface: done • Article management interface: in progress [A.Sherstnev] P.Bartalini – CHEP 2004 - September 27 2004

  34. MCDB: Short Term Plans • Documentation • Internal programming interface with CASTOR • Web-interface for editing of articles • First real tests • Web access control: internal login/password, GRID certificates • Internal access control: to provide author’s privacy • Web-server tuning • Providing of compatibility with different browsers (IE, Netscape, Opera) • HEPML: developing of XML tag set • Main milestone: first working prototype in December [A.Sherstnev] P.Bartalini – CHEP 2004 - September 27 2004

  35. MCDB: Mid Term Plans • Search engine in MCDB SQL database • Moderator interface (to manage articles and related objects, user comments, Web catolog) • Internal parser for HEPML • Security system • Logging system • System of collection of statistics • MCDB Integration APIs [A.Sherstnev] P.Bartalini – CHEP 2004 - September 27 2004

  36. Backup XML in HEP A.Kryukov Skobeltsyn Institute of Nuclear Physics (kryukov@theory.sinp.msu.ru) On behalf of CompHEP Collaboration Presented to LCG-Generator http://agenda.cern.ch/fullAgenda.php?ida=a035826 P.Bartalini – CHEP 2004 - September 27 2004

  37. Outlook • Why XML ? • Describe the document structure • Extensible language • WEB ready • Well defined open standard • Available tools to treat of XML [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  38. Outlook (continue) • Experimental events and/or events simulation (illustration) • Detector models • HEP models • Partonic event structure • Hadronized events • Digitized events • Conclusion [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  39. Why XML ? • XML describe the document structure. • Most information in HEP can be and must be presented as a tree structure or in more general case acyclic graph • XML is extensible language • XML has no fixed set of targets and attributes. User can introduce own targets and attributes. [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  40. Why XML (continue) ? • WEB ready • XML document can be distribute through Internet • XML document can be displayed in different way depends on the user request (XSLT, XSD) • Most modern Web-browsers (Mozilla, IE) can display XML documents by default. • Well defined open standard • Recomended by W3C • Supported by IBM, Sun, Microsoft, Linux/UN*X community [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  41. Why XML (continue) ? • Available tools to treat of XML • SAX - Java • Expat – C/C++ • Perl • Python • Other … • SW developer can re-use these tools for applications [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  42. Experimental events and/or simulated events Detector or it models Event DB HEP models 5’ 6 1 4 7 2 3 5 Reconstruction(ORCA) Phys. analysis ME Gen(CompHEP) Hadronization(Pythia) Simulation(Geant) [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  43. 1. HEP models <model> <name>QED</name> <parameters> <parametername=“alpha” type=“float” value=“0.00729927”> Alpha QED (1/137) </ parameter> </parameters> <particles> <particleid=“e” mass=“0.511” type=“fermion”> Electron </particle> </particles> </model> (See more details in A.Demichev, A.Kryukov, A.Rodionov, hep-ph/0203102. See also http://theory.sinp.msu.ru/FeynXML) [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  44. 2. ME events: partonic level <Machine> The LHC project <Beamid="1" energy="7.00000E+03"> <Particlename="proton" KF="2212" mass="9.38000E-01"/> <Strfunname='CTEQ' version='5l'> <PDFLIBinfoid="46" gr="4"/> </Beam> </Machine> <Task> <Process ID="1"> u, D -> n, e, E, b, B </Process> <GeneralInfo> <CrosSection value="1.11227E-03" error="1.90987E-03" Nevent="100"/> <Generator name="CompHEP" version="4.2.0"/> </GeneralInfo> </Task> …(Below partonic events. NOT in XML format!)… [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  45. 3. Simulated events: particle level (illustration) <header> <experimentname=“CMS” date=“20070101”/> <beamtype=“pp” energy=“14000”/> <!– etc.  </header> (Below Pythia-like events. NOT in XML format!) [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  46. 4. Detector models (illustration) <detector> <nameid=“CMS” version=“2.33”> Compact Muon Solenoid </name> <basic_elementid=1 URI=“http://xxx.cern.ch/cms/belement1” /> <basic_elementid=1 URI=“http://xxx.cern.ch/cms/belement2” /> <unitname=“shift” dim=“mm”/> <unitname=“rotate” dim=“grad”/> <elementdeploy_from=1 shift=“x,y,z” rotate=“a,b,g” number=“100”/> <elementdeploy_from=2 shift=“0.0.0” rotate=“10.0.0” material=“Si”/> <elementdeploy_from=2 shift=“x,y,z” rotate=“0.0.0” material=“Cu”/> <!– etc.  </detector> [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  47. Next points … • Simulated/experimental events • Reconstructed events • Visualization, Web browsing • What else? [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  48. Conclusions (pro) • XML is very useful for presentation of structured data • Models, Events • Easy for realization on Java, C/C++, Perl, … • Give a lot of possibilities for publication results through the WEB. • Unify interfaces of application software • XML DB id native format of data base for XML presented data. [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  49. Conclusions (contra) • Poor structured information • Huge amount of information with strong defined and fixed structure • ME generated events, Pythia events and others [A.Kryukov] P.Bartalini – CHEP 2004 - September 27 2004

  50. Main conclusion: XML has great advantage in HEP application Thank you for attention! P.Bartalini – CHEP 2004 - September 27 2004

More Related