Half Day Parallel I/O Course - February 2013

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search

Goal

This half-day course given on February 27, 2013 at SciNet, was on parallel I/O techniques. Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF.

Slides (PDF)

  1. Introduction to Parallel I/O
  2. Parallel I/O with MPI (MPI-IO)
  3. Parallel I/O with NetCDF and HDF5

Videos

  1. Introduction to Parallel I/O
    Click for Video
    direct link
  2. Parallel I/O with MPI (MPI-IO)
    Click for Video
    direct link
  3. Parallel I/O with NetCDF and HDF5 (apologies for the poor sound quality)
    Click for Video
    direct link

Code