80 likes | 243 Views
Extensions for the ETICS client for Multi-Platform Support in NGIs Driven by User Requirements. Eamonn Kenny*, Brian Coghlan, Peter Lavin, John Walsh Conference: CGW’09 Date: Oct 12th. User Community in EGI/NGI Infrastructure. site. platform. SPARC. SL5. Site. Site. Ubuntu. site linked.
E N D
Extensions for the ETICS client for Multi-Platform Support in NGIs Driven by User Requirements Eamonn Kenny*, Brian Coghlan, Peter Lavin, John Walsh Conference: CGW’09 Date: Oct 12th
User Community in EGI/NGI Infrastructure site platform SPARC SL5 Site Site Ubuntu site linked NGI NGI EGI/NGI linked Site/NGI provision User requirements NGI sites AIX Communications Debian EGI SLES SL5 SL5 Site NGI NGI Site Darwin Site YDL SL5
Open Source ETICS Structure ETICS server ETICS clients SPARC SL5 Site Site Ubuntu NGI NGI Site/NGI provision User requirements NGI sites AIX Communications EMI/UMD Debian SLES SL5 SL5 Site NGI NGI Site Darwin Site YDL SL5
Extensions for Multi-Platform Support XML Build System Wrapper • XML based build descriptions for multi-platform support • An automated GNU patchgeneration based on fixes to ETICS components, timestamped and stored for future patching. • Python based module, used as an interpreter for XML build descriptions, an intermediate patching system applied between checkout and builds, and table/report generation. Extra Utilities • Automated timestamped checkouts of ETICS configurations to be patched from the ETICS command-line interface. • Automatic RPM/deb to tarball generators in a form ready for integration into ETICS. • Python scripts used to create wiki tables showing differences between multiple build result files. Reporting • Automatic sync and storage of XML/HTML in a directory structure allowing automatic HTML table generation. • A Hypergraph generator using the ETICS XML results set
Extended client directory structure etics update web-server Main: xml-etics-build ETICS client Command line Xml parsing patches <project> workspace Tarball creator bin timestamp auto- checkout Main extension ETICS DM DM-modules project-rules build-rules patches RPM/deb generator lib/lib64 Hyper- graphs auto- commit repository HTMLgen patches Project/ component LEGEND xml vendor patches python bash
XML Based Build Structure build-rules.xml project-rules.xml WN-modules-3.2.0.xml WN-3.2.0.xml User runs commands like: $ ./xml-etics-build2 --dryrun --targets=“patch,build,publish” org.glite-workspace/WN-3.2.0.xml
Build Results & Achievements • Building on CentOS 5.x/4.x (x86/x86_64), Debian 4.0/5.0 (x86_64), Mac OS X 10.5 (x86), Play Station 3 (PowerPC), openSUSE 11.1 (x86_64) • Local builds are way ahead of CERN for Debian 5.0 x86_64/x86 although all patches auto-generated with timestamps are applied locally and defined in CERN savannah bug tracking system. • Debian 5.0/4.0 x86_64 gLite-UI/WN and openSUSE 11.1 x86_64 glite-WN are ready for test. gLite-WN without DM is running on PS3 for local users drug screening software.
Conclusions • TCD has been effectively using this software for 3-4 years now. • The software is much more well developed since presented in CGW’07. • The software is relatively easy to manage and provides a good framework for anyone using ETICS locally. • The patches generated at the local sites MUST be fed back by NGI’s to EGI. • Going forward, open source development/porting of grid middleware should be encouraged!