Overview¶
This section provides an overview of features in I/O backends.
Feature |
ADIOS1 |
ADIOS2 |
HDF5 |
JSON |
Operating Systems |
Linux, OSX |
Linux, OSX, Windows |
||
Serial |
supported |
supported |
supported |
supported |
MPI-parallel |
supported |
supported |
supported |
no |
Dataset deletion |
no |
no |
supported |
supported |
Compression |
upcoming |
supported |
upcoming |
no |
Streaming/Staging |
not exposed |
upcoming |
no |
no |
Portable Files |
limited |
awaiting |
yes |
yes |
PByte-scalable |
yes |
yes |
no |
no |
Performance |
A |
TBD |
B |
C |
Native File Format |
|
|
|
|
supported/yes: implemented and accessible for users of openPMD-api
upcoming: planned for upcoming releases of openPMD-api
limited: for example, limited to certain datatypes
awaiting: planned for upcoming releases of a dependency
TBD: to be determined (e.g. with upcoming benchmarks)
Selected References¶
Axel Huebl, Rene Widera, Felix Schmitt, Alexander Matthes, Norbert Podhorszki, Jong Youl Choi, Scott Klasky, and Michael Bussmann. On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective, ISC High Performance 2017: High Performance Computing, pp. 15-29, 2017. arXiv:1706.00522, DOI:10.1007/978-3-319-67630-2_2