SPGrid Status in Ferrara and beyond - PowerPoint PPT Presentation

Spgrid status in ferrara and beyond l.jpg
Download
1 / 12

  • 213 Views
  • Updated On :
  • Presentation posted in: Pets / Animals

SPGrid Status in Ferrara and beyond. Concezio Bozzi INFN Ferrara La Biodola, May 20th 2003. On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora Luppi – Paolo Veronesi People also involved in SPGrid: Tim Barrass, Wahid Bhimji, Peter Elmer, Dirk Hufnagel, Marc Kelly, Douglas Smith.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

Download Presentation

SPGrid Status in Ferrara and beyond

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Spgrid status in ferrara and beyond l.jpg

SPGrid Status in Ferrara and beyond

Concezio Bozzi

INFN Ferrara

La Biodola, May 20th 2003

On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora Luppi – Paolo Veronesi

People also involved in SPGrid: Tim Barrass, Wahid Bhimji, Peter Elmer, Dirk Hufnagel, Marc Kelly, Douglas Smith


Hardware status in ferrara l.jpg

Hardware status in Ferrara

  • EDG 1.4.11 is installed on RH6.2 and RH7.3 nodes

  • PBS queue specific for RedHat 7.3 nodes is defined

  • BaBar VO is authorized to access the INFN RBs in Bologna (cnaf009g.cnaf.infn.it)

  • Resources in Ferrara are visible from the IC RB as well (thanks to David Colling!)

  • RH7.3 resources are accessible by using in your JDL:

    Requirements=isMember(other.RunTimeEnvironment,"FERRARA")

    && other.QueueName == "wn73";

  • An SP5 federation is installed and available:

    babarbecue.fe.infn.it::/babar/databases/SP5/BKG/bbrprod/9195/BaBar.BOOT

    • Contains conditions + Dec2001 background collection

Concezio Bozzi - INFN Ferrara


Integration into edg l.jpg

Integration into EDG

  • Pack software in relocable rmps

  • Give a tag to software, will be published as RunTimeEnvironment and used in JDL files.

  • Send RPMs and tag to the EDG Integration Team, that will test the rpms on a micro-testbed. If everything OK, they will include them in a new EDG software release.

  • Each sitemanager will be notified of the new release, and will upgrade his testbed farm.

  • Accessory parts to install software via LCFGng are also needed, and are ready since some time (we showed them in Karlsruhe)

Concezio Bozzi - INFN Ferrara


Building an rpm for moose l.jpg

Building an rpm for Moose

  • An RPM to run Moose has been built and installed “by hand” on RH7.3 worker nodes:

    [root@grid7]# ls /opt/babar/

    12.4.0-Roo tcl8.0

  • Contents:

    [root@grid7]# ls /opt/babar/12.4.0-Roo/

    bin etc library shlib src

    bin: MooseApp (77MB)

    etc: site.sh (setup envvar like BFROOT, OO_FD_BOOT, LD_LIBRARY_PATH)

    library: a link to init.tcl (tcl error otherwise…)

    shlib: shared libraries (37MB)

    src: tcl files and flat files (16MB)Total RPM: 136MB

Babar release: 1.4GB

Concezio Bozzi - INFN Ferrara


Determining required parts l.jpg

Determining required parts

  • Naively, MooseApp + tcl file obtained with dump mechanism

  • For a number of reasons, we could not obtain the latter

  • Shared libraries are also needed

  • Anything else?

  • Use strace/ldd

  • The answer is:

    • 475 tcl files

    • 165 flat files

    • 42 shared libraries

Concezio Bozzi - INFN Ferrara


Running moose l.jpg

Running Moose

  • Moose was successfully run on RH7.3 worker nodes by using both the INFN-CNAF and IC Resource Brokers

  • JDL script:

    [bozzi@grid1 ~/testSPGrid]$ more Moose.jdl

    Executable = "Moose.csh";

    StdOutput = "Moose.out";

    StdError = "Moose.err";

    InputSandbox = {"Moose.csh", "MooseProductionOptions.tcl", "B0B0bar_generic.dec"};

    OutputSandbox = {"Moose.out", "Moose.err"};

    Requirements = IsMember(other.RunTimeEnvironment,"FERRARA") && other.QueueName == "wn73";

  • Assuming Options, .dec and .csh files are built by someone else

Concezio Bozzi - INFN Ferrara


Submission via genius l.jpg

Submission via Genius

  • Genius under evaluation by BaBar

  • Genius portal installed in Ferrara (including MyProxyserver)

  • Moose jobs submitted to Ferrara with Genius via IC RB:

Concezio Bozzi - INFN Ferrara


Next steps l.jpg

Next steps

  • Include RPM in EDG release (2.0 by end of the month?)

  • Upgrade from 12.4.0-Roo to 13.4.0-roo-X

  • This allows us to use virtually any CPU with EDG software installed.

    • Bottleneck: access conditions

    • Solution: at least a conditions DB per country/region/Babar site

  • Extend metodology to sites already running Babar software (Wahid Bhimji, Tim Barrass), or to sites using Globus+VDT (Dirk Hufnagel)

  • Start working on bookkeeping and production tools (Douglas Smith, Marc Kelly, Daniele Andreotti), integration with Grid portals like Genius (Daniele, Concezio)

Concezio Bozzi - INFN Ferrara


Backup l.jpg

Backup


Test rpm 1 3 l.jpg

Test rpm (1/3)

[root@print ~]# rpm -qpi Moose-0.1-1.i386.rpm

Name        : Moose               Relocations: /opt/babar Version     : 0.1                 Vendor: INFN - Ferrara Release     : 1             Build Date: Wed 05 Mar 2003 4:25:32 PM CET Install date: (not installed)      Build Host: print.fe.infn.it Group       : SPGrid/BaBar      Source RPM: Moose-0.1-1.src.rpm Size        : 2560             License: GNU General Public License (GPL)

Packager    : INFN - FerraraURL         : http://www.fe.infn.itSummary     : Moose Description : A simple Test RPM for BaBarSPGrid Default Installation creates: /opt/babar/bin/MooseAppFake Installation with --prefix <dirname> creates: <dirname>/bin/MooseAppFake

Concezio Bozzi - INFN Ferrara


Test rpm 2 3 l.jpg

Test rpm (2/3)

  • Made some changes to the EDG standard config files on the LCFGng server:

  • Added the WP8/BaBar/ repository

  • Created the BaBar-rpm.h containing the rpm-list for BaBar

  • software.

ls /opt/local/linux/6.2/RPMS/WP8/BaBar/

Makefile Moose-0.1-1.i386.rpm

more /opt/local/linux/6.2/rpmcfg/BaBar-rpm.h

/* BaBar SOFTWARE RPM LIST */

Moose-0.1-1

Concezio Bozzi - INFN Ferrara


Test rpm 3 3 l.jpg

Test rpm (3/3)

Added the following lines to WN-rpm and CE-rpm of LCFGng server config files, in order to install this rpm on the Computing Element and Worker Node:

/* BaBar software */

#include "BaBar-rpm.h"

Added to redhat62-cfg.h a BaBar line to set the related repository for automatic updating.

RPMDIR/WP8/BaBar:\

On the Worker Nodes and Computing Element:

rpm -qa |grep Moose

Moose-0.3-1

ls /opt/babar/bin/

MooseAppFake

Concezio Bozzi - INFN Ferrara


  • Login