WP19 DESY Development Plan. Frank Schlünzen Jürgen Starek. Object stores - Motivation. Data catalogues (DC) and digital objects (DO) are loosely coupled ACL changes in DC are not propagated to DO ( and vice versa ) No messaging between DC and DO
WP19 DESY Development Plan
In order to supplement the existing in-house knowledge about the properties of different file systems and storage hardware solutions, we propose to survey existing and planned object store solutions, evaluating possible performance or maintenance advantages over classical POSIX file systems.
Remote access to compute resources for remote data analysis in a fully interactive and graphical environment is a common requirement at EuroFEL RIs.
Visualization of individual slices of images within a HDF-container archived in ICAT is a common user requirement. Virtual appliances are one way to visualize data remotely, alternatively could be realized as web services:
Many photon-science applications are i/o rather than cpu-limited. pHDF5 is one way to accelerate parallel read/write access to HDF5-container. Currently a number of photon-science labs are supporting development of HDF5-accellerators by HDF.org.