1 / 11

ATLAS TIER3 in Valencia

ATLAS TIER3 in Valencia. Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia). Tier 3 prototype at IFIC. Desktop Or Laptop (I). Atlas Collaboration Tier2 resources (Spanish T2) (II). ATLAS Tier3 resources ( Institute ) (II).

lhoglund
Download Presentation

ATLAS TIER3 in Valencia

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)

  2. Tier 3 prototype at IFIC Desktop Or Laptop (I) Atlas Collaboration Tier2 resources (Spanish T2) (II) ATLAS Tier3 resources (Institute) (II) Special requirements – PC farm to perform interactive analysis (III) Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  3. Individual Desktop or Laptop • Access to ATLAS software via AFS (Athena, root, atlantis, etc..) • /afs/ific.uv.es/project/atlas/software/releases • This is not easy, we have used the installation kit but this is not working for development or nightly releases • Local checks, to develop analysis code before submitting larger jobs to the Tier1-2 via Grid • Use the ATLAS Grid resources (UI) • /afs/ific.uv.es/sw/LCG-share/sl3/etc/profile.d/grid_env.sh • DQ2 installed at IFIC AFS • /afs/ific.uv.es/sw/LCG-share/sl3/etc/profile.d/grid_env.sh • Users could search data and copy them to the local SE. • Ganga client installed • /afs/ific.uv.es/project/atlas/software/ganga/install/etc/setup-atlas.sh • Users can send jobs to the Grid for their analysis or production L X P L U S Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  4. Phase (I) done • From any PC at IFIC with AFS (i.e. 12.0.6) • Requirements file at cmthome: #--------------------------------------------------------------------- set CMTSITE STANDALONE set SITEROOT /afs/ific.uv.es/project/atlas/software/releases macro ATLAS_DIST_AREA /afs/ific.uv.es/project/atlas/software/releases macro ATLAS_TEST_AREA ${HOME}/testarea apply_tag projectArea macro SITE_PROJECT_AREA ${SITEROOT} macro EXTERNAL_PROJECT_AREA ${SITEROOT} apply_tag setup apply_tag simpleTest use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) set CMTCONFIG i686-slc3-gcc323-opt set DBRELEASE_INSTALLED 3.1.1 #--------------------------------------------------------------------- • Release test: source /afs/ific.uv.es/project/atlas/software/releases/CMT/v1r19/mgr/setup.sh cd $HOME/cmthome/ cmt config /usr/kerberos/bin/kinit -4 sgonzale@CERN.CH source ~/cmthome/setup.sh -tag=12.0.6,32 cd $HOME/testarea/12.0.6/ cmt co -r UserAnalysis-00-09-10 PhysicsAnalysis/AnalysisCommon/UserAnalysis cd PhysicsAnalysis/AnalysisCommon/UserAnalysis/cmt source setup.sh gmake Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  5. Local SE STORM & Lustre GANGA Athena AOD Analysis ROOT/PROOF DPD or Ntuple Analysis • -Work with ATLAS software • Use of final analysis tools (i.e. root) • User disk space • Ways to submit our jobs to other grid sites • Tools to transfer data Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  6. Phase (II) resources coupled to Spanish ATLAS TIER2 (in progress) • Nominal: • ATLAS Collaboration resources: TB (SE) and CPU (WN) • Tier2 Extra resources: • WNs and SEs used only by Tier3 users • Using different/share queues • To run local and private production • Production of MC samples of special interest for our institute • (AOD for further analysis) • To analyze AOD using GRID resources (AOD analysis on millions of events) • To store interesting data for analysis Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  7. Phase (III) a PC farm to perform interactive analysis outside Grid (it would be deployed) • Interactive analysis: DPD analysis (i.e. HightPTview, SAN, or AODroot ..) • Install PROOF in a PC farm: • Parallel ROOT facility. System for interactive analysis of very large sets of ROOT data files (see Sergey’s slides on 5th Oct) • Outside the Grid • 8-10 nodes • Fast Access to the data: Lustre and/or xrootd • Storm and Lustre under evaluation at IFIC • Xrootd (see Sergy’s slides) • Tier3 Grid and non-Grid resources are going to use the same SE Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  8. StoRM • Disk based SE • Under evaluation • Now using UnixfsSRM (dcache SRM version )for production in Tier2 • Lustre in production in our Tier2 • High performance file system • Standard file system, easy to use • Higher IO capacity due to the cluster file system • Used in supercomputer centers • Free version available • www.lustre.org • Hardware • 2 clients for GridFTP and SRM • 2 disk servers with 17 TB each one (34 TB in total) Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  9. Tests: RFIO without Castor Athena analysis 12.0.6 AOD's 4 MB/s CPU limited and Athena Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  10. The same test with DPD Both cases Lustre was used and data in the cache 1.8 MB/s with Root 340 MB/s with a simple “cat” 2 x Intel Xeon 3.06GHz 4 GBytes RAM 1 NIC Gigabit Ethernet HD: ST3200822AS (Using a 3Ware card: 8006-2LP) Santiago González de la Hoz, T3 Task Force 19-Oct-2007

  11. Summary • From her/his desktop/laptop individual physicist can get access to: • IFIC Tier2-Tier3 resources. • ATLAS software (Athena, Atlantis, etc..), DDM/dq2 and Ganga tools. • IFIC Tier3 resources will be split in two parts: • Some resources coupled to IFIC Tier2 (ATLAS Spanish T2) in a Grid environment • AOD analysis on millions of events geographically distributed. • A PC farm to perform interactive analysis outside Grid • To check and validate major analysis task before submitting them to large computer farms. • A PROOF farm will be installed to do interactive analysis. Santiago González de la Hoz, T3 Task Force 19-Oct-2007

More Related