Difference between revisions of "Half Day Parallel I/O Course - February 2013"

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search
Line 2: Line 2:
 
== Goal ==
 
== Goal ==
  
This half-day course given on February 27, 2013 at SciNet, on parallel I/O techniques.  Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF.
+
This half-day course given on February 27, 2013 at SciNet, was on parallel I/O techniques.  Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF.
  
 
== Slides (PDF) ==
 
== Slides (PDF) ==

Revision as of 12:51, 1 March 2013

Goal

This half-day course given on February 27, 2013 at SciNet, was on parallel I/O techniques. Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF.

Slides (PDF)

  1. Introduction to Parallel I/O
  2. Parallel I/O with MPI (MPI-IO)
  3. Parallel I/O with NetCDF and HDF5

Videos

  1. Introduction to Parallel I/O
    Click for Video
    direct link
  2. Parallel I/O with MPI (MPI-IO)
    Click for Video
    direct link
  3. Parallel I/O with NetCDF and HDF5
    Click for Video
    direct link

Code