1 / 24

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1 . Satoshi Matsuoka Professor, Global Scientific Information and Computing Center, Deputy Director, NAREGI Project Tokyo Institute of Technology / NII. Nanotech Grid Apps. (Biotech Grid Apps). (Other Apps). “NanoGrid” IMS ~10TF.

mindy
Download Presentation

GT4 as an Implementation Kernel for NAREGI Grid MW beta 1

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GT4 as an Implementation Kernel for NAREGI Grid MW beta 1 Satoshi Matsuoka Professor, Global Scientific Information and Computing Center, Deputy Director, NAREGI Project Tokyo Institute of Technology / NII

  2. NanotechGrid Apps (Biotech Grid Apps) (OtherApps) “NanoGrid”IMS ~10TF (BioGridRIKEN) Other Inst. National ResearchGrid Middleware R&D National AAA Infr. Grid Middleware R&D Grid R&D Infrastr.15 TF => 100TF SuperSINET National Research Grid Infrastructure (NAREGI) 2003-2007 • Petascale Grid Infrastructure R&D for Future Deployment • $45 mil (US) + $16 mil x 5 (2003-2007) = $125 mil total • PL: Ken Miura (FujitsuNII) • Sekiguchi(AIST), Matsuoka(Titech), Shimojo(Osaka-U), Aoyagi (Kyushu-U)… • Participation by multiple (>= 3) vendors, Fujitsu, NEC, Hitachi, NTT, etc. • NOT AN ACADEMIC PROJECT, ~100FTEs • Follow and contribute to GGF Standardization, esp. OGSA NEC Focused “Grand Challenge” Grid Apps Areas Osaka-U Titech AIST Fujitsu IMS Hitachi U-Kyushu

  3. FY2003 FY2004 FY2005 FY2006 FY2007 Development and Integration of αrelease NAREGI Middleware Roadmap UNICORE/Globus/Condor-based R&D Framework Globus4/OGSA/WSRF-based R&D Framework Utilization of NAREGI-Wide Area Testbed Utilization of NAREGI NII-IMS Testbed Version 1.0 Release Prototyping NAREGI Middleware Components Apply Component Technologies to Nano Apps and Evaluation Development and deployment of β1, 2, 3,… Evaluation of α release in NII-IMS Testbed β1 Release (public)OGSA/WSRF/GT4GGF17 Evaluation of βRelease By IMS and other Collaborating Institutes αRelease (internal)OGSA(subset)/Unicore+GT2/3/3.9 Development and Integration of βrelease Evaluation on NAREGI Wide-area Testbed Development of OGSA-based MWbeta 1, 2, Verification & Evaluation Of Ver. 1 Midpoint Evaluation

  4. NII Research Organizations IMS etc NAREGI Software Stack (Alpha 2005) Grid-Enabled Nano-Applications Grid PSE Grid Visualization Grid Programing -Grid RPC -Grid MPI Grid Workflow Distributed Information Service Packaging Super Scheduler （UNICORE4, GT2/3/3.9, CondorOGSA) Grid VM High-Performance & Secure Grid Networking SuperSINET Computing Resources

  5. NAREGI Software Stack (beta 1 2006) Grid-Enabled Nano-Applications (WP6) Grid PSE Grid Visualization Grid Programming (WP2) -Grid RPC -Grid MPI WP3 Grid Workflow (WFML (Unicore+ WF)) Distributed Information Service(CIM) Data (WP4) Super Scheduler WP1 Packaging （WSRF (GT4+Fujitsu WP1) + GT4 and other services) Grid VM (WP1) Grid Security and High-Performance Grid Networking(WP5) SuperSINET NII Research Organizations IMS Major University Computing Centers Computing Resources and Virtual Organizations

  6. Highlights of NAREGI Beta (May 2006, GGF17/GridWorld) • Professionally developed and tested • “Full” OGSA-EMS incarnation • Full C-based WSRF engine (Java -> Globus 4) • OGSA-EMS/RSS WSRF components • Full WS-Agreement brokering and co-allocation • GGF JSDL1.0-based job submission, authorization, etc. • Support for more OSes (AIX, Solaris, etc.) and BQs • Sophisticated VO support for identity/security/monitoring/accounting (extensions of VOMS/MyProxy, WS-* adoption) • WS- Application Deployment Support via GGF-ACS • Comprehensive Data management w/Grid-wide FS • Complex workflow (NAREGI-WFML) for various coupled simulations • Overall stability/speed/functional improvements • To be interoperable with EGEE, TeraGrid, etc. (beta2)

  7. GGF Standards and Pseudo-standard Activities set/employed by NAREGI GGF “OGSA CIM profile” GGF AuthZ GGF DAIS GGF GFS (Grid Filesystems) GGF Grid CP (GGF CAOPs) GGF GridFTP GGF GridRPC API (as Ninf-G2/G4) GGF JSDL GGF OGSA-BES GGF OGSA-Byte-IO GGF OGSA-DAI GGF OGSA-EMS GGF OGSA-RSS GGF RUS GGF SRM (planned for beta 2) GGF UR GGF WS-I RUS GGF ACS GGF CDDLM Other Industry Standards Employed by NAREGI ANSI/ISO SQL DMTF CIM IETF OCSP/XKMS MPI 2.0 OASIS SAML2.0 OASIS WS-Agreement OASIS WS-BPEL OASIS WSRF2.0 OASIS XACML De Facto Standards / Commonly Used Software Platforms Employed by NAREGI Ganglia GFarm 1.1 Globus 4 GRAM Globus 4 GSI Globus 4 WSRF (Also Fujitsu WSRF for C binding) IMPI (as GridMPI) Linux (RH8/9 etc.), Solaris (8/9/10), AIX, … MyProxy OpenMPI Tomcat (and associated WS/XML standards) Unicore WF (as NAREGI WFML) VOMS List of NAREGI “Standards”(beta 1 and beyond)

  8. Role of GT4 in NAREGI Grid MW stack beta 1 GT4 as Implementation Kernel • As underlying WSRF engine for OGSA and other WS components • Various Globus services used throughout to implement OGSA and other GGF “standard” components and functionalities in all WPs • GSI, WS-GRAM, GridFTP, RFT • OGSA-DAI, MyProxy • In a way, NAREGI MW “glues” GT4 services and some GGF OGSA “standards”

  9. JSDL JSDL JSDL JSDL JSDL JSDL JSDL JSDL JSDL JSDL JSDL JSDL NAREGI beta 1 SSS ArchitectureAn extendedOGSA-EMS Incarnation Abbreviation SS: Super Scheduler JSDL: Job Submission Description Document JM: Job Manager EPS: Execution Planning Service CSG: Candidate Set Generator RS: Reservation Service IS: Information Service SC: Service Container AGG-SC: Aggregate SC GVM-SC: GridVM SC FTS-SC: File Transfer Service SC BES: Basic Execution Service I/F CES: Co-allocation Execution Service I/F (BES+) CIM: Common Information Model GNIS: Grid Network Information Service NAREGI-WP3 WorkFlowTool, PSE, GVS NAREGI- WFML Submit Cancel Status Delete JSDL NAREGI JM(SS)Java I/F module CreateActivity(FromBPEL) GetActivityStatus RequestActivityStateChanges Submit Status Delete Cancel WFML2BPEL BPEL2WFST JM-Client BPEL (include JSDL) S Invoke EPS CES SS Invoke SC NAREGI JM (BPEL Engine) SelectResource FromJSDL CreateActivity(FromJSDL) GetActivityStatus RequestActivityStateChanges JSDL MakeReservation CancelReservation R S EPS CES GenerateCandidate Set AGG-SC /RS MakeReservation CancelReservation GetGroups-OfNodes JSDL JSDL CSG R S JSDL Generate SQL Query From JSDL R S CES R S JSDL CES CES JSDL JSDL JSDL Fork/Exec FTS-SC SC(GVM-SC) Fork/Exec Fork/Exec SC(GVM-SC) is-query globusrun-ws globusrun-ws GRAM4 specific Fork/Exec OGSA-DAI GRAM4 specific GFarmserver SC GridVM SC GridVM uber-ftp WS-GRAM GNIS WS-GRAM CIM IS globus-url-copy DB PostgreSQL PBS, LoadLeveler PBS, LoadLeveler Co-allocation FileTransfer

  10. WSRF Interoperability • Most of NAREGI-SS is implemented as C WSRF component on NAREGI WSRF ToolKit (NWK), which complies to the latest WSRF spec • Other NAREGI WSRF components are typically Java and runs on top of GT4 WSRF, which complies to the previous candidate spec • Fortunately, NWK and GT4 WSRFs interoperate quite well, with very minor workarounds (!)

  11. NAREGI Info Service (beta) Architecture ・ CIMOM Service classifies info according to CIM based schema. ・ The info is aggregated and accumulated in RDBs hierarchically. ・ Client library utilizes OGSA-DAI client toolkit. ・ Accounting info is accessed through RUS. Information Service Node User Admin. Viewer CIM Providers Aggregator Service Data Service Java-API OS Client (Resource Broker etc.) Processor Light- weight CIMOM Service Client Library Grid VM File System Job Queue RDB Performance Resource Usage Service Ganglia ● 　● Chargeable Service (GridVM etc.) ACL Node A Node B Node C Parallel Query … RUS::insertURs … Hierarchical filtered aggregation Client (publisher) Cell Domain Information Service Cell Domain Information Service

  12. NAREGI IS: Standards Employed in the Architecture User Admin. Viewer Information Service Node Information Service Node Client (OGSA- RSS etc.) Distributed Information Service GT4.0.1 Tomcat 5.0.28 Aggregator Service Java-API OGSA-DAI WSRF2.1 Client library CIM Providers CIM spec. CIM/XML APP OGSA-DAI Client toolkit OS APP Processor WS-I RUS RDB Light- weight CIMOM Service Grid VM File System CIM Schema 2.10 /w extension Job Queue Performance ACL Ganglia GridVM (Chargeable Service) ● 　● Node A Node B Node C RUS::insertURs ... Distributed Query … … Hierarchical filtered aggregation GGF/ UR Client (OGSA- BES etc.) GGF/ UR Cell Domain Information Service Cell Domain Information Service

  13. NAREGI GridVM (beta) Architecture • Virtual execution environment on each site • Virtualization of heterogeneous resources • Resource and job management services with unified I/F Super Scheduler Information Service Advance reservation, Monitoring, Control Resource Info. GRAM4 WSRF I/F GRAM4 WSRF I/F GridVM Scheduler GridVM Scheduler Local Scheduler Local Scheduler GridVM Engine GridVM Engine GridMPI Accounting Sandbox Job Execution site Policy site Policy AIX/LoadLeveler Linux/PBSPro

  14. NAREGI GridVM: Standards Employed in the Architecture Super Scheduler Information Service GT4 GRAM-integration and WSRF-based extension services CIM-based resource info. provider Job submission based on JSDL and NAREGI extensions GRAM4 WSRF I/F GRAM4 WSRF I/F GridVM Scheduler GridVM Scheduler Local Scheduler Local Scheduler GridVM Engine GridVM Engine GridMPI UR/RUS-based job accounting site Policy site Policy xacml-like access control policy

  15. GT4 GRAM-GridVM Integration • Integrated as an extension module to GT4 GRAM • Aim to make the both functionalities available SS Site globusrun RSL+JSDL’ GridVMJobFactory Extension Service GridVMJob Basic job management ＋ Authentication, Authorization SUDO GRAM services GRAM Adapter GridVM scheduler Delegate Transfer request Scheduler Event Generator Delegation Local scheduler RFT File Transfer GridVM Engine

  16. Large scale computing across supercomputers on the Grid Utilization of remote supercomputers ② Notify results Internet user ① Call remote procedures Call remote libraries Ninf-G: A Reference Implementation of the GGF GridRPC API • What is GridRPC? • Programming model using RPCs on a Grid • Provide easy and simple programming interface • The GridRPC API is published as a proposed recommendation (GFD-R.P 52) • What is Ninf-G? • A reference implementation of the standard GridRPC API • Built on the Globus Toolkit • Now in NMI Release 8 (first non-US software in NMI) • Easy three steps to make your program Grid aware • Write IDL file that specifies interface of your library • Compile it with an IDL compiler called ng_gen • Modify your client program to use GridRPC API

  17. Connect back Invoke Executable Architecture of Ninf-G Client side Server side IDL file Numerical Library Client IDL Compiler Generate Globus-IO Interface Request Interface Reply WS/Pre-WS GRAM NAREGI-SS Remote Library Executable MDS2/4 Interface Information LDIF File retrieve

  18. WorkflowService ApplicationContentsService CFDVisualizationService DeploymentService MolecularVisualizationService ParallelVisualizationService (ACS) • compile • deploy • un-deploy CFDVisualizer MolecularViewer ApplicationRepository ParallelVisualizer Grid Application Environment（WP3） NAREGI Portal Bio VO Portal GUI Portal GUI Nano VO Grid PSE Grid Workflow Grid Visualization Deployment UI Register UI Workflow GUI Visualization GUI Gateway Services NAREGI- WFML File/ExecutionManager JM I/F module BPEL+JSDL Core Grid Services FileTransfer (RFT) UnderlyingGrid Services Workflow Engine &Super Scheduler DistributedInformation Service VOMSMyProxy GridFile System ・・・ ・・・ WSRF

  19. NAREGI Data Grid beta1 Architecture (WP4) Grid Workflow Job 1 Job 2 Job n Data Grid Components Data 1 Data 2 Data n Import data into workflow Data Access Management Place & register data on the Grid Job 1 Job 2 Metadata Management Assign metadata to data Grid-wide Data Sharing Service Meta- data Meta- data Job n Meta- data Data Resource Management Data 1 Data 2 Data n Store data into distributed file nodes Grid-wide File System

  20. NAREGI WP4: Standards Employed in the Architecture Workflow (NAREGI WFML =>BPEL+JSDL) Data Access Management Job 1 Job n Import data into workflow Tomcat 5.0.28 Data 1 Data n Place data on the Grid Super Scheduler (SS) (OGSA-RSS) Globus Toolkit 4.0.1 Data Staging OGSA-RSSFTS SC Metadata Construction GGF-SRM (beta2) Computational Nodes GridFTP Data Resource Management OGSA-DAI WSRF2.0 Job 2 Job n Job 1 OGSA-DAI WSRF2.0 PostgreSQL 8.0 Data 1 Data 2 Data n PostgreSQL 8.0 Data Specific Metadata DB Data Resource Information DB Filesystem Nodes Gfarm 1.2 PL4(Grid FS)

  21. NAREGI WP4 Standards • GGF Standards we help set within a WG • Grid FileSystems WG (discussion about functionality and usecase scenario) • GGF and related Standards we employ • OGSA-DAI • OGSA-RSS • GridFTP • WSRF 2.0 • JSDL • SRM (planned for beta 2) • Other industry standards we employ • BPEL • Other de-facto “standards” we employ • Globus 4 • Tomcat (and associated WS/XML standards)

  22. MyProxy Proxy Certificate with VO Super Scheduler SS client User Certificate Private Key Client Environment Proxy Certificate with VO Information Service Portal WFT Proxy Certificate with VO Resources Info incl. VO PSE GVM NAREGI-beta1 Security Architecture(WP5) Subset of WebTrust Programs for CA GRID CP (GGF CAOPs) VO、Certificate Management Service Resource Info. (Incl. VO info) CP/CPS Audit Criteria VOMS query (requirements +VO info) resources in the VO NAREGI CA ProxyCertificate with VO voms-myproxy-init Put ProxyCertificate with VO Get VOMS Attribute CA Service Certificate Management Server Proxy Certificate withVO globusrun-ws GridVM services (incl. GSI) Request/Get Certificate ssh + voms-myproxy-init VO Info、Execution Info, Resource Info Resource GridVM local Info. incl. VO log-in Signed Job Description

  23. Mediator A Mediator B Mediator A Mediator A Mediator B NAREGI Application Mediator (WP6) for Coupled Applications Workflow NAREGI WFT Mediator Components co-allocated jobs Support data exchange between coupled simulation Simulation A Simulation A Simulation A Mediator Mediator Mediator Job n Job 1 Data transfer management Simulation B Simulation A Simulation A Information Service ・Synchronized file transfer Super Scheduler SQL ・Multiple protocol GridFTP/MPI GridVM GridVM GridVM SBC* -XML ・Global Job ID ・Allocated nodes ・Transfer Protocol etc. API Data transformation management API Sim.B Sim.A Data1 ・Semantic transform- ation libraries for different simulations OGSA-DAI WSRF2.0 Data3 Sim.A Data2 JNI Sim.B ・Coupled accelerator Sim.A Globus Toolkit 4.0.1 GridFTP GridFTP ＭＰＩ *SBC: Storage-based communication ＭＰＩ ＭＰＩ

  24. Summary and Future • NAREGI beta 1 will be publicly released at GGF17@Tokyo, May 2006 • GT4 has served as robust, scalable, and reliable implementation kernels for OGSA and other GGF standards services • Plan to work with the GT team to enhance OGSA features, exploit advanced functionalities (already budgeted for FY06) • Enhance ES-GRAM, in particular default JSDL integration, reservation/co-scheduling • CIM/GLUE interoperable information Model and MDS4 • Workspace Service and GridVM • Etc…

More Related