1 / 24

NEGST Workshop, May 28-29, 2007

NEGST Workshop, May 28-29, 2007. Current Status of the NAREGI Project. Kenichi Miura, Ph.D. Information Systems Architecture Research Division Centr for Grid Research and Development National Institute of Informatics.

aaron-higgins
Download Presentation

NEGST Workshop, May 28-29, 2007

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NEGST Workshop, May 28-29, 2007 Current Status of the NAREGI Project Kenichi Miura, Ph.D. Information Systems Architecture Research Division Centr for Grid Research and Development National Institute of Informatics

  2. 1.National Research Grid Initiatve (NAREGI)2. Cyber Science Infrastructure (CSI) Outline

  3. National Research Grid Initiative (NAREGI) Project:Overview • Originally started as an R&D project funded by MEXT • (FY2003-FY2007) • 2 B Yen(~17M$) budget in FY2003 • Collaboration of National Labs. Universities and Industry • in the R&D activities (IT and Nano-science Apps.) • Project redirected as a part of the Next Generation • Supercomputer Development Project MEXT:Ministry of Education, Culture, Sports,Science and Technology

  4. National Research Grid Initiative (NAREGI) Project:Goals To develop a Grid Software System (R&D in Grid Middleware and Upper Layer) as the prototype of future Grid Infrastructure in scientific research in Japan (2)To provide a Testbed to prove that the High-end Grid Computing Environment (100+Tflop/s expected by 2007) can be practically utilized in the Nano-science Applications over the Super SINET. (3) To Participate in International collaboration/Interoperability (U.S., Europe, Asian Pacific)  GIN (4) To Contribute to Standardization Activities, e.g., OGF

  5. Project Leader: Dr. K.Miura Grid Middleware Integration and Operation Group Grid Middleware And Upper Layer R&D Dir.: Dr. F.Hirata Organization of NAREGI Ministry of Education, Culture, Sports, Science and industry（MEXT) Oparation And Collaboration Collaboration Center for Grid Research and Development (National Institute of Informatics) Cyber Science Infrastructure（CSI) Industrial Association for Promotion of Supercomputing Technology Deployment Coordination and Operation Committee Computing and Communication Centers (7 National Universities) etc. Grid Technology Research Center (AIST), JAEA Joint R&D TiTech, Kyushu-U, Osaka-U, Kyushu-Tech., Fujitsu, Hitachi, NEC SuperSINET Unitization Collaboration Computational Nano Center (Inst. Molecular science) ITBL Joint Research Collaboration Joint Research R&D on Grand Challenge Problems for Grid Applications （ISSP, Tohoku-U, AIST, Inst. Chem. Research, KEK etc.)

  6. Grid-Enabled Nano-Applications Grid Visualization Grid PSE Grid Programming -Grid RPC -Grid MPI Data Grid Grid Workflow Distributed Information Service Super Scheduler （Globus,Condor,UNICOREOGSA) Packaging Grid VM High-Performance & Secure Grid Networking SuperSINET Computing Resources NII Research Organizations IMS etc NAREGI Software Stack

  7. VO-APL1 SS IS VO-RO1 SS IS GridVM GridVM GridVM GridVM IS IS IS IS IS IS GridVM GridVM VO and Resources in Beta 2 Decoupling VOs and Resource Providers (Centers) RO3 Client Client Client VO-APL2 ResearchOrg (RO)1 VOMS VOMS SS IS RO2 VOs & Users VO-RO2 VOMS VOMS IS SS Resource Providers IS IS • Policy • VO-R01 • Policy • VO-R01 • VO-APL1 • VO-APL2 • Policy • VO-R02 • Policy • VO-R01 • VO-APL1 • Policy • VO-R01 • VO-APL1 • VO-APL2 • Policy • VO-R02 • VO-APL2 a.RO2 b.RO2 n.RO2 A.RO1 B.RO1 N.RO1 Grid Center@RO1 Grid Center@RO2

  8. Collaboration in Data Grid Area • High Energy Physics（GIN) - KEK - EGEE • Astronomy - National Astronomical Observatory (Virtual Observatory) • Bio-informatics - BioGrid Project

  9. Highlights of NAREGI b release (2005-6) The first incarnation In the world (@a) • Resource and Execution Management • GT4/WSRF based OGSA-EMS incarnation Job Management, Brokering, Reservation based co-allocation, Monitoring, Accounting • Network traffic measurement and control • Security • Production-quality CA • VOMS/MyProxy based identity/security/monitoring/accounting • Data Grid • WSRF based grid-wide data sharing with Gfarm • Grid Ready Programming Libraries • Standards compliant GridMPI (MPI-2) and GridRPC • Bridge tools for different type applications in a concurrent job • User Tools • Web based Portal • Workflow tool w/NAREGI-WFML • WS based application contents and deployment service • Large-Scale Interactive Grid Visualization NAREGI is operating production level CA in APGrid PMA Grid wide seamless data access High performance communication Support data form exchange A reference implementation of OGSA-ACS

  10. FY２００３ FY２００４ FY２００５ FY２００６ FY２００７ Development and Integration of αVer. Middleware Roadmap of NAREGI Grid Middleware ＯＧＳＡ/WSRF-based R&D Framework ＵＮＩＣＯＲＥ-based R&D Framework Utilization of NAREGI-Wide Area Testbed Utilization of NAREGI NII-IMS Testbed Prototyping NAREGI Middleware Components Apply Component Technologies to Nano Apps and Evaluation βVer. Release Version 1．0 Release Evaluation of αVer. In NII-IMS Testbed Deployment of βVersion Evaluation of βVersion By IMS and other Collaborating Institutes Development and Integration of βVer. Middleware Evaluation on NAREGI Wide-area Testbed αVer. (Internal) Development of OGSA-based Middleware Verification & Evaluation Of Ver. 1 Midpoint Evaluation

  11. NAREGI Version 1 Operability, Robustness, Maintenability • To be developed in FY2007 • More flexible scheduling methods - Reservation-based scheduling - Coexistence with locally scheduled jobs - Support of Non-reservation-based scheduling - Support of “Bulk submission” for parameter search type jobs • Improvement in maintainability - More systematic logging using Information Service (IS) • Easier installation procedure - apt-rpm - VM

  12. SINET (44 nodes) 1 Gbps Kitami Institute of Technology Super SINET (35 nodes) 10 Gbps U.S.A： 10 Gbps×1 2.4 Gbps×1 Singapore： 622 Mbps×1 Hong Kong： 622 Mbps×1 International Line Hokkaido University Hirosaki University Collaboration with other global network Niigata University Tohoku University Gunma University Japan Advanced Institute of Science and Technology High-energy Accelerator Research Organization Saitama University Toyama Univ. Kanazawa Univ. Univ. of Electro-Communications Univ. of Ttskuba Shinshu Univ. Yamanashi Univ. Fukui Univ. National Astronomical Observatory of Japan National Institute for Fusion Science Tokyo Univ. Agriculture And Technology Waseda Univ. Tottori Univ. Univ. of Tokyo Kyoto Univ. Hiroshima Univ. NIINational Institute of Informatics Chiba University Shizuoka Univ. Nagoya Univ. Tokyo Institute of Technology Osaka Univ. Kobe Univ. Okayama Univ. National Institute Of Natural Science Institute of Statistical Mathematics Kyushu Institute of Technology Kansai Univ. Doshisha Univ. Yokohama NationalUniv. Yamaguchi Univ. Keio Univ. Kagawa Univ. Japan Aerospace Exploration Agency Institute of Space and Astronautical Science Japan Agency for Marine-Earth Science Technology Kyushu Univ. Univ. of Tokushima Ehime Univ. Nagasaki Univ. Oita Univ. Kumamoto Univ. National Univ. Public Univ. Private Univ. Junior College Technical College Inter-univ. institute Others Total Kagoshima Univ. Univ. of the Ryukyu 82 48 266 78 42 14 184 713 Japanese Academic（Science） Information Network（ SINET/SuperSINET  SINET3） Circuit Speed • “lifeline” for educaional and research activities in Japan • Indispensable for advanced research cooperation • Continuous development towards the establishment of the full-fledged CSI Participation SINET Institutions（as of February 2006）

  13. ISSP Small Test App Clusters Kyoto Univ. Small Test App Clusters Tohoku Univ. Small Test App Clusters ＫＥＫ Small Test App Clusters AIST Small Test App Clusters NAREGIPhase 1 Testbed ～3000 CPUs ～17 Tflops TiTech Campus Grid Osaka Univ. BioGrid AIST SuperCluster Kyushu Univ. Small Test App Clusters Super-SINET (10Gbps MPLS) Computational Nano-science Center(IMS) ～10 Tflops Center for GRID R&D (NII) ～5 Tflops

  14. Future Direction of NAREGI Grid Middleware Toward Petascale Computing Environment for Scientific Research Center for Grid Research and Development （National Institute of Informatics) Cyber Science Infrastructure（CSI） Science Grid Environment Productization of Generalpurpose Grid Middleware for Scientific Computing Grid Middleware Resource Management in the Grid Environment Grid Middleware for Large Computer Centers Grid Programming Environment Personnel Training (IT and Application Engineers) Grid Application Environment Evaluation of Grid System　ｗith Nano Applications Data Grid Environment Contribution to International Scientific Community and Standardization High-Performance & Secure Grid Networking Grid-Enabled Nano Applications Computational Methods for Nanoscience using the Lastest Grid Technology Research Areas Requirement from the Industry with regard to Science Grid for Industrial Applications Large-scale Computation Vitalization of Industry High Throughput Computation Solicited Research Proposals from the Industry to Evaluate Applications Progress in the Latest Research and Development (Nano, Biotechnology) New Methodology for Computational Science Computational Nano-science Center Use In Industry (New Intellectual Product Development) Industrial Committee for Super Computing Promotion （Institute for Molecular Science）

  15. Current Schedule FY 2006 2007 2008 2009 2010 2011 2012 Operation Start Operation ★ Full Operation ★ R&D OS/Tools/GRID middleware Design & Production Evaluation System Software S o Next Generation Nano-Science Simulation, Design & Production f Evaluation t w a Grand Challenge r Next Generation Life Science Simulation, Design & Production Application Software Evaluation e Basic Design Detail Design Production Enhancement Hardware Design Production Enhancement File Systems and others Investigation Design Construction Geographical investigation, Construction

  16. National Research Grid Initiatve (NAREGI)2. Cyber Science Infrastructure (CSI) Outline

  17. A new information infrastructure is needed in order to boost today’s advanced scientific research. Integrated information resources and system Supercomputer and high-performance computing Software Databases and digital contents such as e-journals “Human” and research processes themselves U.S.A： Cyber-Infrastructure (CI) Europe： EU e-Infrastructure (EGEE,DEISA,….) Break-through in research methodology is required in various fields such as nano-Science/technology, bioinformatics/life sciences,… the key to industry/academia cooperation: from ‘Science’ to ‘Intellectual Production’ Cyber Science Infrastructure: background Advanced information infrastructure for research will be the key in international cooperation and competitiveness in future science and engineering areas A new comprehensive framework of information infrastructure in Japan Cyber Science Infrastructure

  18. Cyber-Science Infrastructure for R & D SuperSINET and Beyond: Lambda-based Academic Networking Backbone Hokkaido-U ★ ● ★ Tohoku-U Kyoto-U ☆ ★ ★ ★ Tokyo-U Kyushu-U ★ ＮＩＩ Nagoya-U ★ Osaka-U （Titech, Waseda-U, KEK, etc.) Cyber-Science Infrastructure （CSI) NII-REO (Repository of Electronic Journals and Online Publications NAREGI Outputs GeNii (Global Environment for Networked Intellectual Information) Virtual Labs Live Collaborations Deployment of NAREGI Middleware UPKI: National Research PKI Infrastructure International Infrastructural Collaboration Industry/Societal Feedback Restructuring Univ. IT Research ResourcesExtensive On-Line Publications of Results

  19. SINET3Network Topology(FY2007 - ) 10Gbps  40Gbps

  20. NAREGI Site Middleware CA Research ナノ分野 実証・評価 分子研 Dev.（　　） ナノ分野 実証・評価 分子研 βver. V1.0 V2.0 Nano Proof of al.Concept Eval. IMS • International • Collaboration • - EGEE • - UNIGRIDS • Teragrid • GGF etc. Operaontional Collaborati Cyber Science Infrastructure toward Petascale Computing (planned 2006-2011) NII Collaborative Operation Center R&D Collaboration Cyber-Science Infrastructure（ＣＳＩ） （IT Infra. for Academic Research and Education) Nano Proof, Eval. IMS Joint Project （Bio） Osaka-U R&D Collaboration Joint Project AIST Feedback R&D Collaboration Delivery Delivery Operation/ Maintenance （UPKI,CA） Contents Operation/ Maintenance （Middleware） Networking Delivery Feedback Delivyer Peta-scale System VO Feedback Core Site Project-oriented VO Project- Oriented VO Customization Operation/Maintenance Industrial Projects Univ./National Supercomputing VO Domain Specific VOs Domain Specific VOs IMS,AIST,KEK,NAO,etc. Networking Infrastructure (Super-SINET/SINET3） Note: names of VO are tentative）

  21. Cyber Science Infrastructure

  22. Expansion Plan of NAREGI Grid Petascale Computing Environment National Supercomputer Grid (Tokyo,Kyoto,Nagoya…) Domain-specific Research Organizations (IMS,KEK,NAOJ….) NAREGI Grid Middleware Interoperability （GIN,EGEE,Teragrid etc.) Laboratory-level PC Clusters Departmental Computing Resources Domain-specific Research Communities

  23. Summary • The 3rd Science and Technology Basic Plan started in April 2006. • The Next Generation Supercomputer Project (FY2006-2012, ~1B$) is one of the high priority projects, aimed at the peta-scale computation in the key application areas. • NAREGI Grid middleware will enable seamless federation of heterogeneous computational resources. • Computations in Nano-science/technology applications over Grid is to be promoted, including participation from industry. • NAREGI will provide the access and computational infrastructure for the Next Generation Supercomputer System. • NAREGI Grid Middleware is to be adopted as one of the important components in the new Japanese Cyber Science Infrastructure Framework.

  24. Thank you! http://www.naregi.org

More Related