Grid activities in JINR & Meta-cluster of distributed computing “Dubna-Grid”

1. Grid activities in JINR&Meta-cluster of distributed computing “Dubna-Grid” Korenkov Vladimir JINR, Dubna

2. In 2006 the Joint Institute for Nuclear Research (JINR) - an international intergovernmental scientific research organization - celebrated its 50-th anniversary.

3. Armenia Azerbaijan Belarus Bulgaria Cuba Czech Republic Georgia Kazakhstan Democratic People’s Republic of Korea Moldova Mongolia Poland Romania Russia Slovak Republic Ukraine Uzbekistan Vietnam JINR Member States

4. JINR is a large multidisciplinary scientific centre incorporating: • basic research in frontier particle, nuclear and condensed matter physics, • development and application of high technologies, and • university education in the relevant fields of knowledge.

5. AUSTRIA BELGIUM CERN CROATIA DENMARK FINLAND FRANCE GREECE IRELAND NETHERLANDS NORWAY PORTUGAL SLOVENIA International Cooperation AMERICA REPUBLICS OF BRAZIL CANADA CLAF CUBA UNITED STATES BRAZIL CANADA FORMER USSR DUBNA UNITED STATES EUROPE ASIA CHINA BULGARIA DEMOCRATIC PEOPLE'S REPUBLIC CZECH REPUBLIC OF KOREA INDIA ISRAEL GERMANY JAPAN MONGOLIA HUNGARY AFRICA SOUTH KOREA TURKEY EGYPT ITALY VIETNAM SOUTH AFRICA AUSTRALIA SPAIN AND SWEDEN OCEANIA SWITZERLAND UNITED KINGDOM YUGOSLAVIA AUSTRALIA JINR’s partners are about 700 institutions located in 60 countries

6. CERN and JINR joint exhibitions: 1997: University of Oslo (Norway) 1998: UNESCO, Paris 1999: UN Office in Geneva 2000: European Parliament in Brussels 2001: Russian State Duma, Moscow 2002: Ministry of Education and Sciences, Bucharest, Romania 2003: Yerevan University, Armenia Diplomatic Academy, Moscow 2005: University of Thessaloniki, Greece Science Bringing Nations Together Geneva Brussels Thessaloniki Bucharest Moscow

8. Local Area Network Backbone At present the JINR LAN comprises more6000computers and nodes (Gigabit Ethernet)

9. JINRin the LCG/EGEE Project • support and development LCG/EGEE infrastructure; • participation in LCG middleware testing/evaluation, • participation in Data and Service Challenges, • CASTOR and dCache usage/development; • grid monitoring and accounting system development; • EGEE-RDIG portal support and development, • MCDB development; • HEP application; • User & Administrator Training and Education • support of JINR member states in the LCG/EGE activities.

10. RDIGmonitoring&accountinghttp://rocmon.jinr.ru:8080

11. Architecture

12. www.egee-rdig.ru

13. DUBNA-GRID Meta-cluster of distributed computing “Dubna-Grid” The “Dubna-Grid” Project is aimed at the creation of a distributed environment of meta-computing on the basis of vacant computing resources of “office” computers. Implementation of the project “Dubna-Grid” will allow: • to create a unified computing environment of the city of Dubna (meta-cluster) on the basis of the resources of scientific and educational institutions, in particular, JINR subdivisions, University “Dubna”, secondary schools and other organizations concerned; • to create a segment of the international Grid-infrastructure, operating in frames of various Grid systems (LGG, NorduGrid and OSG). To perform research of control, security and stability within the Grid environment. • to provide execution of large-scale computing tasks of JINR and other enterprises of Dubna scientific – industrial complex and other organizations concerned; • to distribute experience of creation of the city segment of the Grid-infrastructure for creation of similar systems in other Russian cities.

14. Main stages of realization • development of technologies on realization of a separate administration of office computers and nodes of the Grid infrastructure on the basis of software shells of virtual machines • creation of a meta-cluster prototype integrating resources of various organizations • development of mass installation technologies and spreading software to all accessible nodes of the city infrastructure • installation of various Grid systems at the meta-cluster nodes and accordance of these resources to the users of other Grid projects such as LCG, NorduGrid, EGEE, OSG. • training of specialists in the field of Grid technologies. Holding seminars, giving lectures and demonstrations.

15. Network resources of the Project City Informational-Educational Computer Network “Dubna” JINR Backbone

16. Construction of the system • The Meta-cluster can be interpreted as a cluster, but the computing resources are distributed over different places. Basically meta-clusters are constructed from resources which are specially provided for it, but the “Dubna-Grid” meta-cluster uses vacant computer resourcesof office computers in parallel with their main purpose. • Dubna-Grid Meta-cluster includes a managed server, a bridge and computational nodes. Computational nodes represent Virtual PCs emulated by virtual machine technology (VMware). • By means of VMware we have two computers instead of one, there are no differences between real and virtual PCs, they both have its own memory, IP address, processor and etc, but physically they both use the same resources. Two machines share one processor, memory, Ethernet card and all of PC devices. As all nodes in the cluster represent the virtual PCs, we have absolutely a homogenous environment for building the infrastructure.

17. Construction of the system In order to create the computing meta-cluster the following approaches were used: • time-shared equipment with common access to the resources; • common network infrastructure for real and virtual resources and own additional network infrastructure for virtual resources • virtual clustering of the equipment. The following software tools and technologies were used: • software support for virtual machines maintenance (VMware), • virtual network (VLAN), • virtual access to the software and data (AFS), • building and loading OS images to the Virtual PCs of the meta-cluster (Warewulf package). On the central server the following software is installed: • Scientific Linux CERN OS; • a package for support of cluster architecture Warewulf; • Ganglia monitoring system; • OpenAFS, • the batch system Torque with Maui scheduler.

18. Logical scheme of the “Dubna-Grid” meta-cluster

19. Conclusion • A distributed meta-computing environment of Dubna city based on vacant computing resources (computational, storage) of office computers of scientific and educational institutions has been created. • Mass installation technologies and spreading software to all accessible nodes of the city infrastructure have been developed • Virtual meta-clusters have been integrated with JINR batch system • Monitoring system of the meta-cluster has been developed • First real tasks have been run, including simulation of ttbar  4m in ATLAS detector

20. Grid infrastructure in University Centre of JINR • Grid infrastructure is a set of virtual machines (VMs) running on physical ones (hosts) • Virtualisation was made using User Mode Linux • current number of VMs is 36 (6 VMs on each of 6 hosts) • all virtual resources are grouped into independent testbeds which in turn can be used for different aims: system administrators and users training in grid field, debugging and testing custom grid services in desirable grid environment • Course for system administrators using Nordugrid ARC middleware, LCG and gLite was successfully conducted on that infrastructure

21. The two major Grid conference in Russia (Grid2004 and Grid2006), hosted by Joint Institute for Nuclear Research in Dubna, has been hailed a success: - more than 200 participants; - about 100 reports.http://lit.jinr.ru/grid2004/ http://grid2006.jinr.ru