1 / 19

Recent Efforts on the Asia-Pacific Grid (ApGrid)

Recent Efforts on the Asia-Pacific Grid (ApGrid). SEKIGUCHI, Satoshi Electrotechnical Laboratory (ETL), AIST(TACC), MITI Sekiguchi@etl.go.jp Satoshi Matsuoka Tokyo Inst. Technology/JST Matsu@is.titech.ac.jp. Several slides are courtesy of Grid people. What is ApGrid?.

dutch
Download Presentation

Recent Efforts on the Asia-Pacific Grid (ApGrid)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Recent Efforts on the Asia-Pacific Grid(ApGrid) SEKIGUCHI, Satoshi Electrotechnical Laboratory (ETL), AIST(TACC), MITI Sekiguchi@etl.go.jp Satoshi Matsuoka Tokyo Inst. Technology/JST Matsu@is.titech.ac.jp Several slides are courtesy of Grid people

  2. What is ApGrid? • A meeting point for all Asia-Pacific HPCN researchers..doing grid-related work • Communication channel to the Global Grid Forum, and other grid communities • Pool for finding international project partners • Not a single source funded “project”! • Unlike EuroGrid, eGrid, IPG, etc.

  3. ACSys North America (STARTAP)  Europe Latin America APAN: http://apan.net Japan Europe TransPAC (100 Mbps) South Korea China Hong Kong Thailand Philippines Malaysia Singapore Australia-Japan Link (1.5Mbps Frame Relay) Indonesia Exchange Point Access Point Current Status Planned Australia

  4. ACSys APAN Projects • Distributed computing • ACSys, ANU, CSIRO, Osaka U, NUS, ISI, Argonne Lab, Indiana U,... • Digital libraries • GEMINI project: ACSys, SingaREN, I2-DSI, KAIST, MAFFRC • Earth Observation: CSIRO, Agencies (NASDA, ESA, NASA….) • Data mining • ACSys; Illinois University (Terabyte challenge) • Virtual environments / Telerobotics • ACSys, ETL/RWCP, U Chicago, Indiana • Distance education • Association of Pacific-Rim Research Universities (APRU) • Internet technologies • testbeds for MBONE, IPv6, Cache, RSVP/DS/QoS

  5. National Backbones for Japaese Academia TACC RWCP nGrid/eGrid Partners 135Mbps 1.5Mbps APAN Tokyo STAR TAP Chicago 135Mbps TransPAC 155Mbps IMnet vBNS 100Mbps Waseda 384Kbps WIDE 10Mbps 1.5Mbps Frame Relay TIT Australia 10Mbps SINET TACC: Tsukuba Advanced Computing Center Osaka: Osaka University RWCP: Real World Computing Partnership TIT: Tokyo Institute of Technology Waseda: Waseda University 155Mbps Osaka 100Mbps

  6. KEK-ETL collaboration 1000km 5km StarTAP (100Mbps) （ループ長　約２７㎞） KEK CERN (dedicated 2Mbps?) Tsukuba U Today 135Mbps Planned 2.4Gbps Tokyo AIST/ETL

  7. ApGRID: motivations (1) • Establish a regional wide testbed for global computing (Grid and/or Meta) • Disseminating research activities • Providing an easy-access environment for researchers, students, vendors, etc. • Improving interoperability of existing tools • Testbed for software development and trial to have evaluation of usability and to archive performance numbers • Finding demonstrative applications

  8. ApGRID: motivations (2) • Create a competitive/collaborative community to the iGRID and the eGRID for: • Making international collaborations • Supporting and collaborating with network people, ex. APAN, IM-net, etc. • Attempt to negotiate for standardization with real experience (in Global Gridforum.) • Also, domestic (intra-country) service • Nation-wide • Several “non-cooperative” network communities  • Seeking governmental and/or industrial funding • Campus-wide • Find Volunteers within our friends

  9. Japan AIST/TACC/ETL National Institute of Advanced Industrial Science and Technology Tokyo Institute of Technology Waseda U, Osaka-u, Nara Advanced Institute of S & T KEK (DataGrid) Australia ANU, Monash U United States PNNL, SDSC Korea (KORDIC, ) Singapore (NUS) Malaysia Thailand ROC, Hong Kong, Taiwan Other APAN members APGrid Locations/Potential Partners

  10. ApGrid: Services (1) • Grid computing service • Deploy major grid software packages ready to use • Ninf v.2.0 • Globus, Netsolve, NWS, Nimrod, Condor Legion,etc. • MPICH/G(2), PACX-MPI, Harness, etc • System resources • US220R x 2CPU x 4 from ETL • ORIGIN 2000/16CPU, J90/16CPU, CS6400/64 • SR8000/8node, WH-II 8node • Clusters (Pentium, Alpha), etc in many places

  11. data results query request Ninf Overview Other Global Computing Systems, e.g., NetSolve via Adapters Ninf DB Server Meta Server Internet Ninf Computational Server Ninf Library (Ninf Executable) Meta Server Meta Server Ninf Library (Ninf Executable) Ninf Library (Ninf Executable) Ninf Client Ninf Client Library : Ninf_call(“linpack”, ..); : Ninf RPC protocol Program

  12. Ninf Overview (cont’d.) • Ninf server + Ninf RPC protocol transparent execution of Ninf library program on computational server • Ninf database server direct query on accurate constant database • Ninf Client Interface easy-to-use programming interface • Ninf Metaserver scheduling of computation, asynchronous and automatic parallel computation,

  13. Interface Request Interface Info. Argument Result Ninf RPC Protocol • Exchange interface information at run-time • No need to generate client stub routines (cf. SunRPC) • No need to modify a client program when server’s libraries are updated. Client Program Ninf library program Client Library Stub Program Interface Info Interface Info Interface Info Ninf Server

  14. Simplified architecture than the Ninf Metaserver Limit the # of known Servers Load balancing with L4 switch technology Central administration of servers and DB Transaction support Resource access and Load balancing w/VIP Different VIP per package e.g. linpack.apgrid.org Grouping of libraries via VIP VIP expands the URL to address of appropriate server Ninf 2.0/Netsolve etc ASP-Like ApGrid Ninf Service

  15. lapack.ApGrid.org murata.ApGrid.org lapack.eGrid.org Simplified architecture than the Metaserver ・Limit the # of Servers ・Load balancing with L4 switch technology ・Central administration of servers and DB ・Transactions 3-DNS Res DB (“lapack”,”dgesv”, .., ..) 150.29.219.128(VIP) BIG/IP package routine Selector/scheduler BIG/IP Selector/scheduler hpcc.gr.jp 192.50.75.0/24 Different VIP per package e.g. linpack.apgrid.org Grouping of libraries via VIP VIP expands the URL to address of appropriate server Ninf 2.0/netsolve etc ninf.org 150.29.218.0/23

  16. ApGrid: Services (2) • Grid information service • Maintain name servers and databases • ASP-like portal service • Handling users, micro economics • Grid security support service (Plan) • PKI: Public Key Infrastructure • Certificate Authority

  17. ApGrid Application examples • Remote/Tele-operation • Lifescience/Bioinformatics • High Energy Physics domain (data grid) • SDP • Climate and environmental studies • Fundamental material characteristics • Remote collaboration • etc

  18. ApGrid: Current Status • Just kicked off, and some of the resources are ready, but still we need: • Hiring people to maintain and to install the regular services initially • Considering to have meeting in mid. March, 2001 • Contributing to the GGF • Enrolling more partners • Reserved: apgrid.org, Web site will be open shortly • Find international partners • Creating much stronger relation with APAN activities

  19. Summary • Some success stories • Collaboration with Application Scientists • International Collaborations • Osaka-U/UCSD (Globus) • NetSolve/Ninf Collaboration • WGCC2000, Grid Forum, metacomputing WS • Government funded several projects • the Asia-Pacific Grid (ApGrid) • TACC is ready for providing computing resources • National, Regional testbed • International Collaborations Efforts a MUST!

More Related