spgrid status in ferrara and beyond
Download
Skip this Video
Download Presentation
SPGrid Status in Ferrara and beyond

Loading in 2 Seconds...

play fullscreen
1 / 12

SPGrid Status in Ferrara and beyond - PowerPoint PPT Presentation


  • 221 Views
  • Uploaded on

SPGrid Status in Ferrara and beyond. Concezio Bozzi INFN Ferrara La Biodola, May 20th 2003. On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora Luppi – Paolo Veronesi People also involved in SPGrid: Tim Barrass, Wahid Bhimji, Peter Elmer, Dirk Hufnagel, Marc Kelly, Douglas Smith.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'SPGrid Status in Ferrara and beyond' - medwin


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
spgrid status in ferrara and beyond

SPGrid Status in Ferrara and beyond

Concezio Bozzi

INFN Ferrara

La Biodola, May 20th 2003

On behalf of: Daniele Andreotti – Enrica Antonioli – Eleonora Luppi – Paolo Veronesi

People also involved in SPGrid: Tim Barrass, Wahid Bhimji, Peter Elmer, Dirk Hufnagel, Marc Kelly, Douglas Smith

hardware status in ferrara
Hardware status in Ferrara
  • EDG 1.4.11 is installed on RH6.2 and RH7.3 nodes
  • PBS queue specific for RedHat 7.3 nodes is defined
  • BaBar VO is authorized to access the INFN RBs in Bologna (cnaf009g.cnaf.infn.it)
  • Resources in Ferrara are visible from the IC RB as well (thanks to David Colling!)
  • RH7.3 resources are accessible by using in your JDL:

Requirements=isMember(other.RunTimeEnvironment,"FERRARA")

&& other.QueueName == "wn73";

  • An SP5 federation is installed and available:

babarbecue.fe.infn.it::/babar/databases/SP5/BKG/bbrprod/9195/BaBar.BOOT

    • Contains conditions + Dec2001 background collection

Concezio Bozzi - INFN Ferrara

integration into edg
Integration into EDG
  • Pack software in relocable rmps
  • Give a tag to software, will be published as RunTimeEnvironment and used in JDL files.
  • Send RPMs and tag to the EDG Integration Team, that will test the rpms on a micro-testbed. If everything OK, they will include them in a new EDG software release.
  • Each sitemanager will be notified of the new release, and will upgrade his testbed farm.
  • Accessory parts to install software via LCFGng are also needed, and are ready since some time (we showed them in Karlsruhe)

Concezio Bozzi - INFN Ferrara

building an rpm for moose
Building an rpm for Moose
  • An RPM to run Moose has been built and installed “by hand” on RH7.3 worker nodes:

[[email protected]]# ls /opt/babar/

12.4.0-Roo tcl8.0

  • Contents:

[[email protected]]# ls /opt/babar/12.4.0-Roo/

bin etc library shlib src

bin: MooseApp (77MB)

etc: site.sh (setup envvar like BFROOT, OO_FD_BOOT, LD_LIBRARY_PATH)

library: a link to init.tcl (tcl error otherwise…)

shlib: shared libraries (37MB)

src: tcl files and flat files (16MB) Total RPM: 136MB

Babar release: 1.4GB

Concezio Bozzi - INFN Ferrara

determining required parts
Determining required parts
  • Naively, MooseApp + tcl file obtained with dump mechanism
  • For a number of reasons, we could not obtain the latter
  • Shared libraries are also needed
  • Anything else?
  • Use strace/ldd
  • The answer is:
    • 475 tcl files
    • 165 flat files
    • 42 shared libraries

Concezio Bozzi - INFN Ferrara

running moose
Running Moose
  • Moose was successfully run on RH7.3 worker nodes by using both the INFN-CNAF and IC Resource Brokers
  • JDL script:

[[email protected] ~/testSPGrid]$ more Moose.jdl

Executable = "Moose.csh";

StdOutput = "Moose.out";

StdError = "Moose.err";

InputSandbox = {"Moose.csh", "MooseProductionOptions.tcl", "B0B0bar_generic.dec"};

OutputSandbox = {"Moose.out", "Moose.err"};

Requirements = IsMember(other.RunTimeEnvironment,"FERRARA") && other.QueueName == "wn73";

  • Assuming Options, .dec and .csh files are built by someone else

Concezio Bozzi - INFN Ferrara

submission via genius
Submission via Genius
  • Genius under evaluation by BaBar
  • Genius portal installed in Ferrara (including MyProxyserver)
  • Moose jobs submitted to Ferrara with Genius via IC RB:

Concezio Bozzi - INFN Ferrara

next steps
Next steps
  • Include RPM in EDG release (2.0 by end of the month?)
  • Upgrade from 12.4.0-Roo to 13.4.0-roo-X
  • This allows us to use virtually any CPU with EDG software installed.
    • Bottleneck: access conditions
    • Solution: at least a conditions DB per country/region/Babar site
  • Extend metodology to sites already running Babar software (Wahid Bhimji, Tim Barrass), or to sites using Globus+VDT (Dirk Hufnagel)
  • Start working on bookkeeping and production tools (Douglas Smith, Marc Kelly, Daniele Andreotti), integration with Grid portals like Genius (Daniele, Concezio)

Concezio Bozzi - INFN Ferrara

test rpm 1 3
Test rpm (1/3)

[[email protected] ~]# rpm -qpi Moose-0.1-1.i386.rpm

Name        : Moose               Relocations: /opt/babar Version     : 0.1                 Vendor: INFN - Ferrara Release     : 1             Build Date: Wed 05 Mar 2003 4:25:32 PM CET Install date: (not installed)      Build Host: print.fe.infn.it Group       : SPGrid/BaBar      Source RPM: Moose-0.1-1.src.rpm Size        : 2560             License: GNU General Public License (GPL)

Packager    : INFN - FerraraURL         : http://www.fe.infn.itSummary     : Moose Description : A simple Test RPM for BaBarSPGrid Default Installation creates: /opt/babar/bin/MooseAppFake Installation with --prefix <dirname> creates: <dirname>/bin/MooseAppFake

Concezio Bozzi - INFN Ferrara

test rpm 2 3
Test rpm (2/3)
  • Made some changes to the EDG standard config files on the LCFGng server:
  • Added the WP8/BaBar/ repository
  • Created the BaBar-rpm.h containing the rpm-list for BaBar
  • software.

ls /opt/local/linux/6.2/RPMS/WP8/BaBar/

Makefile Moose-0.1-1.i386.rpm

more /opt/local/linux/6.2/rpmcfg/BaBar-rpm.h

/* BaBar SOFTWARE RPM LIST */

Moose-0.1-1

Concezio Bozzi - INFN Ferrara

test rpm 3 3
Test rpm (3/3)

Added the following lines to WN-rpm and CE-rpm of LCFGng server config files, in order to install this rpm on the Computing Element and Worker Node:

/* BaBar software */

#include "BaBar-rpm.h"

Added to redhat62-cfg.h a BaBar line to set the related repository for automatic updating.

RPMDIR/WP8/BaBar:\

On the Worker Nodes and Computing Element:

rpm -qa |grep Moose

Moose-0.3-1

ls /opt/babar/bin/

MooseAppFake

Concezio Bozzi - INFN Ferrara

ad