Hdf5 work
This presentation is the property of its rightful owner.
Sponsored Links
1 / 7

HDF5 Work PowerPoint PPT Presentation


  • 76 Views
  • Uploaded on
  • Presentation posted in: General

HDF5 Work. Environmental Hydrology Team Workshop Nov 2, 2000 HDF Team http://hdf.ncsa.uiuc.edu/HDF5. What is HDF5. HDF5 is a scientific file format Self-described Platform-independent http://hdf.ncsa.uiuc.edu/HDF5 HDF5’s Virtual File Layer(VFL) supports various file I/O methods

Download Presentation

HDF5 Work

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Hdf5 work

HDF5 Work

Environmental Hydrology Team Workshop

Nov 2, 2000

HDF Team

http://hdf.ncsa.uiuc.edu/HDF5


What is hdf5

What is HDF5

  • HDF5 is a scientific file format

    • Self-described

    • Platform-independent

    • http://hdf.ncsa.uiuc.edu/HDF5

  • HDF5’s Virtual File Layer(VFL) supports various file I/O methods

    • stdio, mpio, Globus-GASS, Data Grid, SRB, ...


Virtual files files needn t be files

Virtual files: files needn’t be files

  • HDF5 incorporates a virtual file layer (VFL)

    • Allows HDF5 to interface to disk, the network, memory, or a user-defined device

HDF5

VFL

I/O drivers

Std I/O

MPI I/O

Memory

Network

“Storage”

Memory

Network

Files


Types of parallel hdf5

Types of Parallel HDF5

  • MPI parallel

    • Build on top of MPI-IO

    • Limit by parallel filesystem and parallel I/O interface

  • Thread parallel

    • Beta version of thread-safe HDF5 based on Pthreads

  • OpenMP parallel

    • Works if called “correctly”


Hdf5 language api

HDF5 Language API

  • Sequential

    • C, F90, Java, C++

  • Parallel

    • MPI: C, F90

    • Pthread: C

    • OpenMP: C


Hdf5 supported platforms

HDF5 Supported Platforms

  • Sequential

    • IRIX, Solaris, HPUX, AIX, Linux, DEC, FreeBSD, x86

    • Wins98, NT 4.0, Wins2000

    • Cray PVP, T3E

  • Parallel

    • SGI O2K, IBM SP, Intel Red, T3E, DEC Cluster

    • MPICH/ROMIO


What about clusters

What about clusters?

  • NT cluster

    • mpich has a beta version of MPI-IO but has not been tried yet

  • Linux cluster

    • near future target

  • O2K cluster

    • no cross box MPI-IO

    • need to come up with “something”


  • Login