C dac s hpc programme
This presentation is the property of its rightful owner.
Sponsored Links
1 / 42

C-DAC’s HPC Programme PowerPoint PPT Presentation


  • 120 Views
  • Uploaded on
  • Presentation posted in: General

C-DAC’s HPC Programme. Vinodh Kumar Markapuram Centre for Development of Advanced Computing Pune, India www.cdac.in. ATIP 1 st Workshop on HPC in India @ SC-09. Contents. About C-DAC HPC in C-DAC PARAM over the Years C-DAC’s HPC Programme Technology Development System Area Networks

Download Presentation

C-DAC’s HPC Programme

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


C dac s hpc programme

C-DAC’s HPC Programme

Vinodh Kumar Markapuram

Centre for Development of Advanced ComputingPune, India

www.cdac.in

Workshop on HPC in India

ATIP 1st Workshop on HPC in India @ SC-09


Contents

Contents

  • About C-DAC

  • HPC in C-DAC

  • PARAM over the Years

  • C-DAC’s HPC Programme

    • Technology Development

      • System Area Networks

      • Reconfigurable Computing Technologies

      • System Software

      • Benchmarking and Testing

    • Applications and Solutions

      • HPC Applications

      • HPC Solutions & Services

      • Education & Training

ATIP 1st Workshop on HPC in India @ SC-09


About c dac

About C-DAC

  • Established under MCIT, Government of India

  • ~ 20 years old

  • Government funded, but autonomous

  • 10 centers across India

  • C-DAC is in several areas in computing:

    • Language Technology & Applied AI

    • Training

    • e-Governance

    • Embedded Technologies, Power Electronics

    • HPC

  • ~ 1500 employees, ~ 150 in HPC & Grid Computing

ATIP 1st Workshop on HPC in India @ SC-09


Hpc in c dac

HPC in C-DAC

  • Distributed activities across Pune and Bangalore centers

  • PARAM series of parallel supercomputers

    • PARAMnet

    • RCS

  • Applications Development Group involved in developing, porting apps to PARAM

  • Over 60 installations of PARAM in India and abroad

ATIP 1st Workshop on HPC in India @ SC-09


Param over the years

PARAM over the years

Peak Perf.

50 TF

PARAM Yuva(54 TF ClusterPARAMnet-3)

1 TF

PARAM Padma(2 TF ClusterPARAMnet-II)

100 GF

PARAM 10000(100 GF ClusterPARAMnet-I)

10 GF

PARAM 9000 (2 GF MPP)

1 GF

PARAM 8000 (100 MF MPP)

1991

1995

1998

2002

2008

ATIP 1st Workshop on HPC in India @ SC-09


C dac s hpc programme1

C-DAC’s HPC Programme

  • Technology Development

  • Applications and Solutions

ATIP 1st Workshop on HPC in India @ SC-09


Technology development

Technology Development

  • System Area Network Technologies

  • Reconfigurable Computing Technologies

  • System Software

  • Benchmarking & Testing

ATIP 1st Workshop on HPC in India @ SC-09


San technologies

SAN Technologies

  • Starting from PARAMNet-I (400 Mbps) to to PARAMNet-3 (10 Gbps) and beyond

  • Communication Co-processor (CCP) Generations

    • Offload host communication to intelligent hardware

    • Use Industry Standard Interfaces to allow for message passing (e.g. MPI) and Legacy (e.g. TCP/IP) support

  • Packet Switching Hardware

    • N-port switching hardware designs to augment CCP based NICs

    • Design of large crossbar hardware and packet routing engine

  • Communication software stack

ATIP 1st Workshop on HPC in India @ SC-09


Reconfigurable computing

Reconfigurable Computing

  • C-DAC has spearheaded RC in India

    • Accelerated Solutions for

      • Bioinformatics

      • Radio Astronomy

      • Fracture mechanics

      • Scientific & engineering routines

      • Crypto analysisAnd Many More…

  • Design & Development of

    • RC HW, HW Libraries (Avatars)

    • System Software & Drivers (Linux, Windows)

10X-200X … Acceleration

Since 2000

ATIP 1st Workshop on HPC in India @ SC-09


Rc in param yuva

RC in PARAM-Yuva

  • Application: Smith-Waterman Sequence Search

49 hrs32.5 min

1 RC card comparable to 87 cores

Time-

34 min

16 RC

16 Cores

16 Machines: HP DL580G5 Quad core Quad socket Xeon 2.93 GHz

ATIP 1st Workshop on HPC in India @ SC-09


Rc performance

RC Performance

  • RC for Accelerating Sequence search

Bioinformatics Sequence search taking 528 days using pure software solution was completed in just 12 daysby C-DAC’s RC !

[what one of our customer has to say…]

“C-DAC’s Reconfigurable Hardware Accelerator has helped us to achieve high scalability and reliability in our Microarray probe, Primer design business...

Thanks C-DAC for being a great partner in our endeavour to become world number one in genomic outsourcing.”

Anuradha Acharya

CEO

ATIP 1st Workshop on HPC in India @ SC-09


C dac s rc road ahead

C-DAC’s RC: Road Ahead

  • RC for Accelerating Multidisciplinary applications

    • Accelerated solutions for computationally challenging and emerging Applications through Industrial/research contacts and co-operations

    • Exploration of building RC, using hybrid components

  • Possible Areas of Collaboration

    • Hardware Library development

      • Algorithmic level

      • Application level

    • System software

    • Framework for Rapid development of RC enabled Applications (a user centric approach)

ATIP 1st Workshop on HPC in India @ SC-09


Important publications

Important Publications

  • [1] Sajish C, Yogindra Abhyankar, Shailesh Ghotgalker and K. A. VenkateshFloating point Matrix multiplication on a Reconfigurable Computing System, Proceedings of the High Performance Computing and Application (HPCA 2004), August 2004, China.

  • [2] Yogindra Abhyankar, Sajish C, Shailesh Ghotgalker, Yogesh Agarwal and Pallavi KulkarniReconfigurable Computing System Initiatives at Centre for Development of Advanced Computing, Proceedings of the International conference on Reconfigurable Computing and FPGAs (Reconfig04), September 2004, Colima, Mexico.

  • [3] Yogesh Agarwal, Yogindra Abhyankar, Shailesh Ghotgalker, M.S. Shah, A.P. Kumbhar and B. DattaguruSolving Fracture Mechanics Problems Using Reconfigurable Computing, Proceedings of the International conference on Reconfigurable Computing and FPGAs (Reconfig04), September 2004, Colima, Mexico.

  • [4] Yogindra Abhyankar, Sajish C, Pallavi Kulkarni and C.R. SubrahmanyaDesign of a FPGA Based Data Acquisition System for Radio Astronomy Applications, Proceedings of the 16th IEEE International conference on Microelectronics (ICM 2004), December 2004, Tunis, Tunisia.

  • [5] A.P. Kumbhar, M.S. Shah,Yogindra Abhyankar, Sajish C, Vikas Bharadwaj, B. Yogesh Agarwal, Shailesh Ghotgalker DattaguruFracture Analysis Using Reconfigurable Computing, 8th Int. Conf. on High-Performance Computing in Asia-Pacific Region (HPC Asia 2005), Beijing, China.

  • [6] Yogindra Abhyankar, Sajish C, Yogesh Agarwal, C.R. Subrahmanya and Peeyush PrasadHigh Performance Power Spectrum Analysis Using a FPGA based Reconfigurable Computing Platform, Proceedings of the International conference on Reconfigurable Computing and FPGAs (ReConFig06), September 2006, San Luis Potosi, Mexico.

ATIP 1st Workshop on HPC in India @ SC-09


Hpc system software

HPC System Software

ATIP 1st Workshop on HPC in India @ SC-09


Hpc system software1

HPC System Software

  • System software (device driver, kernel modules, specialized libraries, program development environments etc.) for HPC Interconnects and Reconfigurable Systems

  • Light weight protocols based on VIA/ uDAPL

  • Parallel File Systems

  • Grid File Systems for HPC applications

  • Performance engineering

  • System Software development on Linux, AIX, Windows and Solaris

ATIP 1st Workshop on HPC in India @ SC-09


Hpc testing methodologies benchmarks

HPC - Testing Methodologies, Benchmarks

  • Design Develop, Execute Test plan for large scale C-DAC HPC & Grid Computing Infrastructure”

    • Developed test suites can be downloaded from C-DAC web-site

  • Conduct technology training programme(s) on emerging areas of parallel processing technologies

    • Technology training programme(s) in the form of national level technology workshops can be downloaded from C-DAC web site

ATIP 1st Workshop on HPC in India @ SC-09


Par am family of s calable h ybrid a daptive clusters

PARAM family of Scalable Hybrid Adaptive Clusters

Client

Client

Client

Client

  • Multi node Hybrid Adaptive Cluster

  • Efficient Mapping of Algorithms on suitable Architectures; Fast Access to large data sets

  • Economics – Easy Migration & Adoption

LAN

Mixed Hardware & Software

GPU Accelerators

SAN

Fabric

Multi Cores Intel /AMD

FPGA

Ex : HDF (Hierarchical Data Format)

IBM Cell BroadBand Engine

Storage

HPC Tools and Programming Environments (NVIDIA CUDA, Intel TBB, FPGA, IBM CBE

OpenCL, AMD-FireStream)

In Memory DataBases

(Ex. BerKeley DB))

Programming Environment - Compilers, Debugging, New Programming Paraidgms

ATIP 1st Workshop on HPC in India @ SC-09


Gitems v 1 0

GITeMS v1.0

Synthetic Test Suites and Secure Prog. Environment; Complete Application Based Test Suites or Data Intensive Benchmarks

Level 5

Part-III

Portal Features: Information Services; Job Management Features; Security Services

Part-II

Level 4

Part-I

Level 3

Grid Probes; Grid Middleware Overhead Measurement Suites – Stability Aspects

Part-I

Enabling Applications for Grid Computing using Globus Toolkit

Level 2

Level 1

Globus Services & Grid Integration on Prog. Env.

Part-I

Representation of test suites (Level, 1, Level 2,Level 3, Level 4, Level 5 )

ATIP 1st Workshop on HPC in India @ SC-09


Test suites open source s w

Test Suites & Open-source S/W

  • GITeMS v1.0: GARUDA Integrated Testing Methodology-Suites

  • SPAGMOS v1.0: Software on Probes for Assessment of Grid Middleware Overheads

  • INPEAG-v1.0: INtegrated Perl Script to Enable Applications for Grid computing with Globus)

  • GEAGUL-C v1.0: Grid Software-Enabling Applications for Grid Computing Using GLobus and C-Language

  • GOPAEAG-v1.0: Globus and Object Oriented Programming Approach to Enable Applications for Grid Computing.

  • JAGEAG-v1.0: JAva CoG Kit and Globus to Enable Applications for Grid Computing

  • PerlCEAG-v1.0: Perl CoG Kit to Enable Applications for Grid Computing

  • PyCEAG-v1.0: PythonCoG Kit to Enable Applications for Grid Computing

ATIP 1st Workshop on HPC in India @ SC-09


Scope for collaborations

Scope for Collaborations

  • Hybrid Computing

    • Affordable – Multiple NIC Cards & Multiple GPU Cards Software

    • Mixed Programming - Local / Remote GPU/ FPGA/ Multi-core / Cell CBE

    • Storage HDF /Berkeley Data Bases/Virtualisation/Memory Allocators for large scale computations

  • Technology Workshops

    • C-DAC’s Technology Training & Workshops – GRIPSI-2007, ProMCore 2008, PEEP-2008, OPECG-2009 (Multi-Core Programming; GPU Computing; Hybrid Computing, Grid Computing)

  • Grid Computing Testing – Using Globus 4.X Technologies

    • Integration of C-DAC’s Grid Computing test Suites with Globus 4.X Technologies

ATIP 1st Workshop on HPC in India @ SC-09


Applications and solutions

Applications and Solutions

  • HPC Applications

  • HPC Solutions & Services

  • Education & Training

ATIP 1st Workshop on HPC in India @ SC-09


Applications at a glance

Applications at a Glance

ATIP 1st Workshop on HPC in India @ SC-09


Applications at a glance1

Applications at a Glance

ATIP 1st Workshop on HPC in India @ SC-09


Computational structural mechanics

Computational Structural Mechanics

  • Core areas of Work

    • Earthquake Engineering

    • Composite Materials

    • Smart materials

  • Recent Projects

    • Optimization of Laminated Fiber Reinforced Composites (FEMCOMP)

    • Computer Aided Seismic Analysis & Design of Concrete Structures

    • Non-linear Earthquake Analysis of R/C Framed Buildings

    • Integrated Composites Structural Analysis (INTCOMP)

ATIP 1st Workshop on HPC in India @ SC-09


Csm road map

CSM Road Map

  • Smart Structures - Project with IIT-Guwahati

    • Optimum Design and Active Vibration Control of Smart FRP Structures on Parallel Platform , Sanctioned by DST.

  • Earthquake Engineering - Projects with SGSITS, Indore

    • Computer Aided Seismic Analysis And Design Of Concrete Structures: Integrating all the Static and Dynamic analysis code

  • Parallelization of IDARC code for Nonlinear analysis and Benchmarking the simulations.

  • Feasibility of project on Vulnerability assessment of Existing Stock of R/C Structures under Earthquake hazards

  • OpenSees

    • Grid and TF Applications and usage

  • INTCOMP – Project on FRP Composites

    • Free Vibration and Bucklinh analysis modules are planned to be incorporated in next version

ATIP 1st Workshop on HPC in India @ SC-09


Seismic data processing

Seismic Data Processing

  • Recent Projects

    • Seismic Full Waveform Elastic Inversion.

    • Seismic Traveltime Tomographic Inversion.

    • Pre-Stack Migration and Velocity Analysis.

    • Parallel Seismic Migration and Modeling Algorithm.

    • Earthquake Research Grid in India.

  • 35 Publications in National and International Conference and Journals.

  • Department of Science and Technology, Gov. India award for best project in 1998.

ATIP 1st Workshop on HPC in India @ SC-09


Seismic data processing1

Seismic Data Processing

  • Future Plans

    • To develop a parallel GA Engine for Seismic Inversion problems.

    • To develop GUI's for all the developed applications.

    • To attempt Ant Colony Optimization for Seismic optimizations problems.

    • To develop 2D Seismic Inversion using Elastic Modeling.

ATIP 1st Workshop on HPC in India @ SC-09


Seismic data publications

Seismic Data Publications

  • Multiple realisation of real-coded genetic algorithm: A tool for 2D traveltime tomographic inversion(SEG,2009)‏

  • Seismic Full Waveform Inversion and Modeling(SPG , 2008)

  • Imaging subsurface geology with seismic migration on a computing cluster(Current Science,2005)

  • Earthquake Engineering grid in India – A concept(IGU,2004)‏

  • AVA inversion using real-coded genetic algorithm(EAGE,2004)‏

  • Seismic Transmission and Electrical Resistivity Tomography for the delineation of mine galleries in the Raniganj Coalfield India(First Break,2004)  

  • Seismic Numerical Modeling On PARAM Padma(SPG,2004)‏

  • Aperture width selection criterion in Kirchhoff Migration (AEG,2000)

  • On improving performance of migration algorithms using MPI and MPI-IO(SEG,2000)‏

  • Marine Synthetic Seismograms using Elastics Wave Equation(SEG,2000)

  • Efficient Parallel I/O for Seismic Imaging in a Distributed Computing Environment(SPG,2000)

  • A PVM implementation of 2D acoustic wave modelling on PARAM 10000(International Journal of Applied Science and Computations,1999)

  • Implementation of wave equation based Imaging Techniques on PARAM 10000(IGU,1999)

ATIP 1st Workshop on HPC in India @ SC-09


Seismic data processing2

Seismic Data Processing

  • Potential US Collaborations:

    • Mrinal Sen, Department of Geophysics, University of Texas, Austin

    • Subhashish Mallick, University of Wyoming.

    • Chris Liner, Colorado School of Mines

ATIP 1st Workshop on HPC in India @ SC-09


Computational fluid dynamics

Computational Fluid Dynamics

  • Major Recent Projects:

    • Flow over a wind turbine airfoil and blade

    • Three Dimensional Flow in a single passage of Transonic Compressor Rotor

    • Conjugate heat transfer of compressor disc cavity of an aero engine

    • Performance optimization and control of emissions in IC engine

    • Performance Improvement of Shell & Tube Heat Exchanger

    • Development of a CFD model for cooling of eggs under forced convective conditions and experimental validation of CFD model

ATIP 1st Workshop on HPC in India @ SC-09


Computational fluid dynamics1

Computational Fluid Dynamics

  • Notable Achievements:

    • Published research papers in International Journals (10)

    • Presented research papers in National and International Conferences (20)

    • Conducted training and workshop on Computational Fluid Dynamics (5)

ATIP 1st Workshop on HPC in India @ SC-09


Computational fluid dynamics2

Computational Fluid Dynamics

  • “Recent Advances in HPC for Computational Fluid Dynamics”, Indo-Australian CFD Workshop, IIT Roorkee, April 12 – 14, 2007.

  • “Numerical Modeling for Air Pollutant Dispersion”, National Workshop on Modeling on Fluids- Macro to Nano Scale- IIT, Kharagpur, September 20-21, 2007.

  • “Fluid Flow Simulation using PARAM systems”, Seventh Asian CFD Conference (ACFD7), NAL, Bangalore, November 26 – 30, 2007.

  • Conjugate Heat Transfer Analysis of an Egg, COMSOL user conference, Boston, USA, 2007

  • Simulation Studies of Shell & Tube Heat Exchanger with Helical Baffle, International Journal of Heat Exchangers, 2008

ATIP 1st Workshop on HPC in India @ SC-09


Computational fluid dynamics3

Computational Fluid Dynamics

  • Future Plans

    • Solution of internal and external fluid flow/conjugate heat transfer problems, e.g., I.C. Engine, HVAC (Heating, ventilation, and air conditioning)

    • Simulation of the 3-D Flow in Multiple passages of a Transonic Compressor Rotor

ATIP 1st Workshop on HPC in India @ SC-09


Computational atmospheric sciences

Computational Atmospheric Sciences

  • Real time weather forecast

    • Short range weather forecast modeling using mesoscale models e.g WRF model.

  • Monsoon Modeling

    • Long range monsoon modeling using high resolution T170 modelDevelopment of regional coupled atmosphere-ocean modeling using WRF-ROMS.

  • Aerosol Modeling

    • Radiative forcing studies using Indian emissions in climate modelsDevelopment of Atmosphere-chemical transport modeling system - WRF-STEM.

  • Urban air quality modeling

    • Urban air quality modeling for Pune City using WRF-AERMOD coupled system

    • Air quality models inter comparison AERMOD, CALPUFF, ISC3

      • Urban air quality modeling of Indian cities using WRF-CMAQ system

      • Development of offline WRF-Chem model system.

ATIP 1st Workshop on HPC in India @ SC-09


Computational atmospheric sciences1

Computational Atmospheric Sciences

  • Collaborations

    • University of California, Riverside, USA.

    • NOAA/FSL , Colorado, USA.

    • University of Iowa, USA.

    • University of Lille, France .

  • Future Plans

    • Decision Support System for Urban Air quality Management.

    • Coupled regional atmosphere-ocean modeling for climate change studies.

    • Computational performance analysis of Atmosphere and Ocean systems.

    • Grid based ensemble modeling using mesoscale models.

ATIP 1st Workshop on HPC in India @ SC-09


Evolutionary computing materials modeling

Evolutionary Computing & Materials Modeling

  • Protein Structure Prediction

    • Sequential, data parallel, island and distributed genetic algorithms have been implemented on HPC systems.

  • Engineering Optimisation problems

    • IC Engine performance optimisation using micro genetic algorithms

    • Seismic inversion using island genetic algorithms

    • FRP structure optimisation using sequential and parallel genetic algorithms

    • Accelerated optimisation using Taguchi's method in conjunction with genetic algorithms, gene expression programming

  • Materials simulations

    • Cadmium selenide and zinc selenide clusters, their ground state and optical properties.

    • Wang-Landau Algorithm to simulate liquid crystals on HPC systems.

  • INDMOL - A suite of codes to study ab initio electronic structure of molecules using Hatree Fock and Moeller Plesset methods

  • INDPROP - A suite of codes to calculate the properties of the molecules based on the electronic structure

  • MTA - Molecular tailoring approach to optimise geometry of the molecules for handling large molecules using parallel approach

ATIP 1st Workshop on HPC in India @ SC-09


Evolutionary computing materials modeling1

Evolutionary Computing & Materials Modeling

  • Large scale nano cluster simulations of ZnSe

  • Multi-scale materials modeling

  • Multiple instance learning

  • Content based image retrieval

ATIP 1st Workshop on HPC in India @ SC-09


Services solutions in hpc

Services/ Solutions in HPC

  • Data Center Consultancy

  • Integration Services

  • Enterprise application services

  • Operations and Research support services

  • Grid deployment & management services

  • Enterprise application services

ATIP 1st Workshop on HPC in India @ SC-09


A partial list of our clients

A Partial List of Our Clients

  • CTSF, Government of India, India

  • NCMRWF, New Delhi, India

  • NCL, Pune, India

  • ONGC, India

  • NIO, Goa

  • TIFR, India

  • IITM, Pune India

  • PRL, Ahmedabad, India

  • IUCAA, Pune, India

  • Bharathidasan University, Trichy, India

  • NML, Jamshedpur, India

  • CCSHAU, HISAR, India

  • PARAM provided to all IITs in India

ATIP 1st Workshop on HPC in India @ SC-09


Foreign collaborations

Foreign Collaborations

  • Government of Ghana, Ghana

  • Russian Indian Centre For Advanced Computing Research (RICCR)

  • Center for Excellence in ICT, Govt. of Myanmar

  • Center for Excellence in ICT, Govt. of Vietnam

  • Center for Excellence in ICT, Govt. of Tanzania

  • Center for Excellence in ICT, Govt. of Armenia

  • Center for Excellence in ICT, Govt. of Belarus

ATIP 1st Workshop on HPC in India @ SC-09


Education training

Education & Training

  • C-DAC Advanced Computing Training School

  • Short term programmes in computing technology.

  • Workshops in specialized areas in computing

ATIP 1st Workshop on HPC in India @ SC-09


Thank you

Thank You!

www.cdac.in

ATIP 1st Workshop on HPC in India @ SC-09


  • Login