Download
1 / 13
130 likes | 403 Views
PROOF/XROOTD Quick Installation Guide. Neng XU University of Wisconsin-Madison. X D. About this instruction. This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly.
E N D
PROOF/XROOTD Quick Installation Guide Neng XU University of Wisconsin-Madison X D
About this instruction • This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly. • Following up each step and you should be able to get it work. If not, the main problem may be the Firewall. • There is no explanation of configuration files. To understand more, please check: http://root.cern.ch/twiki/bin/view/ROOT/ProofInstallation • If you have further questions, this forum can help you:http://root.cern.ch/phpBB2/ • The text in those grey boxes are the commands you need to run.
STEP One:Define the system structure: • Xrootd Redirector(PROOF Master)Recommend hardware: Dual Core 2.0GHz, 2GB RAM, 80GB Hard driver. • Data Servers(PROOF Slaves)Recommend hardware: 4xCore 2.4GHz, 8GB RAM, 80GB system hard driver, 500GB data disk or RAID. pcuw101 pcuwsun01 pcuwsun02
STEP Two:Software preparation. • Get ROOT binary package on EVERY machine:If you have 32bit SLC4:> su> cd /opt > wget ftp://root.cern.ch/root/root_v5.18.00.Linux.slc4.gcc3.4.tar.gz > tar zxvf root_v5.18.00.Linux.slc4.gcc3.4.tar.gzIf you have 64bit SLC4:> su> cd /opt > wget ftp://root.cern.ch/root/root_v5.18.00.Linux.slc4_amd64.gcc3.4.tar.gz > tar root_v5.18.00.Linux.slc4_amd64.gcc3.4.tar.gz • Add user “xrootd” on EVERY machine:> su> /usr/sbin/adduser xrootd> mkdir /var/log/xrootd> chown xrootd /var/log/xrootd pcuw101 pcuwsun01 pcuwsun02
STEP Three:Mount your data disks • Mount your data disk on Data servers.(In this sample, the data disk (/dev/sdb1) always mount on /xrootd directory.)> su> mkdir /xrootd> chown xrootd /xrootd> mount /dev/sdb1 /xrootd> df /xrootd pcuw101 pcuwsun01 pcuwsun02
STEP Four:Main configuration files. • They are SAME on ALL the nodes. • The main configure files are: • /etc/xrootd.cf • /etc/proof.conf • The start scripts are: • /etc/init.d/xrootd • /etc/init.d/olbd pcuw101 pcuwsun01 pcuwsun02
/etc/xrootd.cf Change “pcuw101” to your own Xrootd Redirector’s hostname. xrootd.fslib /opt/root/lib/libXrdOfs.so xrd.port 1094 olb.port 3121 if exec olbd xrd.sched mint 10 maxt 100 avlt 20 fi xrootd.export /xrootd/ if pcuw101.cern.ch ofs.redirect remote ofs.forward all else ofs.redirect target fi oss.path /xrootd/ r/w olb.path rw /xrootd/ if pcuw101.cern.ch olb.role manager else olb.role server fi olb.subscribe pcuw101.cern.ch 3121 odc.manager pcuw101.cern.ch 3121 olb.delay startup 30 olb.space 20g 1g if exec xrootd xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so fi xpd.rootsys /opt/root xpd.workdir /xrootd/ xpd.intwait 20 xpd.resource static /etc/proof.conf xpd.role worker xpd.role master if pcuw101.cern.ch xpd.allow pcuw101.cern.ch xpd.poolurl root://pcuw101.cern.ch xpd.namespace /home/xrootd/proofpool pcuw101 pcuwsun01 pcuwsun02
/etc/proof.conf Change “pcuw101” to your own Xrootd Redirector’s hostname. master pcuw101.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd Change “pcuwsun01” and “pcuwsun02” to your own Xrootd data servers’ hostname. /etc/init.d/xrootd/etc/init.d/olbd > su > cd /etc/init.d > wget http://wisconsin.cern.ch/~nengxu/xrootd_install/xrootd > wget http://wisconsin.cern.ch/~nengxu/xrootd_install/olbd > chmod 755 xrootd > chmod 755 olbd pcuw101 pcuwsun01 pcuwsun02
STEP Five:START the whole pool!! • Go to each machine and do: > su > cd /etc/init.d > xrootd start > olbd start pcuw101 pcuwsun01 pcuwsun02
STEP Six:File transfer test: • Follow STEP 2 to install ROOT on your desktop or laptop. • After installation, you can start the test. > source /opt/root/bin/thisroot.sh > xrdcp anyfile.txt root://pcuw101.cern.ch//xrootd/test/anyfile.txt [xrootd] Total 36.03 MB |====================| 100.00 % [49.6 MB/s] > xrdcp root://pcuw101.cern.ch//xrootd/test/anyfile.txt anyfile_back.txt [xrootd] Total 36.03 MB |====================| 100.00 % [49.6 MB/s] pcuw101 your laptop pcuwsun01 pcuwsun02
STEP Seven:PROOF function test • source /opt/root/bin/thisroot.sh • mkdir ~/proof_test • cd ~/proof_test • wget http://wisconsin.cern.ch/~nengxu/xrootd_install/PROOF_test.tgz • tar zxvf PROOF_test.tgz • cd PROOF_test • xrdcp proof_test._00001.root root://your_redirector//xrootd/test/proof_test/proof_test._00001.root • xrdcp proof_test._00002.root root://your_redirector//xrootd/test/proof_test/proof_test._00002.root • Modify run.C, changeTProof::Open("nengxu@pcuw101.cern.ch") to TProof::Open(“yourname@your_redirector") • Modify makechain.C, change chain->Add("root://pcuw101.cern.ch//xrootd/test/proof_test/"+filename) to chain->Add("root://your_redirector//xrootd/test/proof_test/"+filename)
STEP Seven:PROOF function test • Start running the PROOF job: • Then, you should be able to see these windows. > source /opt/root/bin/thisroot.sh > root –l [root] .x run.C Starting master: opening connection ... Starting master: OK Opening connections to workers: 1 out of 8 (10 %) PROOF set to parallel mode (8 workers)
