ETICS All Hands meeting Bologna, October 23-25, 2006

1. Keynotes [ “Wine” discussions ] Marian ZUREK for ETICS ETICS All Hands meeting Bologna, October 23-25, 2006

2. What we do with … • DB schema update • CVS cleaning • ETICS server deployment • Backup policies • Security for passwords • Scalability • Testbeds integration • ETICS CA • NMI • Virtualisation • Condor pool management Bologna -- All Hands Meeting

3. DB schema update • DB schema needs update • Estimation of the time-scale for the new schema deployment • WA: 1 week • WS: 2 weeks • CLI: 2 weeks • No backwards compatibility possible - so export/import script must be prepared • Not possible before PM12 • Minor changes will be applied, DB validator developed Bologna -- All Hands Meeting

4. CVS cleaning • Cosmetic changes to adhere to the Java code structuring recommendations • Guillermo will quickly perform the necessary modifications (needs the CVS file system access rights) Bologna -- All Hands Meeting

5. Python inheritance usage • e.g. Store Object parsing • Suggestion: coding style could improve the developers productivity (“.”-prompt). Bologna -- All Hands Meeting

6. ETICS Server(s) deployment • We are providing service • Procedures • Starting from the WP2 deliverable • Install OS, Condor, NMI, Tomcat, j2sdk, MySQL, WebAppl, CAs, etc. • Deploy on the etics-test/preproduction • Start everything -- will this work? • Make production • Testing the procedures • Access policies • Who does what, why you need an exceptional root access • Access on the ssh public key (please give a name to your key) Bologna -- All Hands Meeting

7. ETICS Server(s) deployment • The complete flow of the clean installation will be defined using the Twiki pages • Marian will initiate the process and the gaps will be filled in for all the deployed packages • The final goal is to fully script the etics-server deployment • The identified packages (not everything is packaged yet): WS, WA, ETICS Admnistration tool (BackOffice), cron-jobs. • Testing: • Some tests exist for the WS. • Check-list/todo should be defined for the WA. • As the starting point the tutorial material could be used. • Stress testing with the multi-threaded client application (Marc-Elian). • Access policy • Matteo and Marian deploy the new ETICS packages on the production server Bologna -- All Hands Meeting

8. Disaster recovery • To avoid surprises we backup everything (exception of /afs, /tmp, /mnt/) on the file system level • Database dump • Needs correction(s) • Possibly should be dynamic (script updated together with schema, located in the CVS) • The real disaster recovery scenario needs to be performed Bologna -- All Hands Meeting

9. Security for passwords We have a good number of clear text passwords • stored in the CVS? • hard-coded in the config files • Defined in cron-job scripts • present in HOWTO files • The passwords should be periodically changed Bologna -- All Hands Meeting

10. Scalability • The etics.cern.ch gets loaded • java processes eating up most of the resources (possible to optimise?) • Load balancing / redundant servers needed • Database on the dedicated node • Migration to Oracle (not open source anymore?) • No problems as of today - study needed for the future • AJAX technology usage for the repositoryBrowser Bologna -- All Hands Meeting

11. Testbeds integration • How we find the e.g. AIX WN to run the compilation. • CondorC • Flocking • Database migration • WebAppl @ INFN, UoW-Madison and “conscious” submission • … • Action on Marian and Andy Bologna -- All Hands Meeting

12. CAs • Do we really need ETICS CA? • Why not to send people to register with CERN CA, INFN CA, DOEGrids, …. • Only short living certificates for training events • Another service • We need to run ETICS CA for the non-Grid customers. Action on Matteo and Marian • CAs on the servers • Update procedure • Scripting • Testing • Procedure should be defined. Some scripts already exists. Bologna -- All Hands Meeting

13. NMI • Becky already started the NMI registration in etics.cern.ch • Build and publish • Test • Release • Plan to have it by 15th of Nov 2006. • NMI Web interface • Do we need any exposure of the NMI database • Active monitoring • Identification of most demanded platforms • Web interface already present within NMI Bologna -- All Hands Meeting

14. Condor • Building the Condor with ETICS is not a trivial tasks as there are many external dependencies, which are initialy patched and then build prior to the Condor building itself. Globus toolkit represents the great part of the external dependencies. • Peter will check the developers/Miron’s commitement to the exercise -- already ongoing Bologna -- All Hands Meeting

15. Virtualisation • VMWare should be looked at as the first virtualisation solution Bologna -- All Hands Meeting

16. Condor Pool Management • Variety of condor configurations • Standard • Private (e.g. “org.glite”) • With /afs • root-enabled • Virtual_WinXP • etc… • Immediate need for the nodes offering the afs access. No immediate needs for the other. Bologna -- All Hands Meeting

17. Monitoring • SLS (Service Level Status) @ CERN • Very first static script already implemented (see http://sls.cern.ch/sls/service.php?id=ETICS) • see already http://sls.cern.ch/sls/service.php?id=ETICS • Your feedback is needed (see my mail from 16th of Oct. 2006) • SLS @ INFN, UoW ? • Action on all to provide the “health” indicator • Understating the scope of the SLS (CERN-only or wider?). Action on Marian • Cron-jobs/Scheduler • Condor scheduler as the possible solution Bologna -- All Hands Meeting

18. TBDiscussed • Edit commands: how we can we improve them • What are the important issues to handle within each release • … Bologna -- All Hands Meeting