Half Day Parallel I/O Course - February 2013

Goal

This half-day course given on February 27, 2013 at SciNet, was on parallel I/O techniques. Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF.

Slides (PDF)

1. Introduction to Parallel I/O
2. Parallel I/O with MPI (MPI-IO)
3. Parallel I/O with NetCDF and HDF5

Videos

1. Introduction to Parallel I/O
   
   direct link
2. Parallel I/O with MPI (MPI-IO)
   
   direct link
3. Parallel I/O with NetCDF and HDF5 (apologies for the poor sound quality)
   
   direct link

Code

• Hands-on example code from /scinet/course/parIO/