Difference between revisions of "Half Day Parallel I/O Course - February 2013"
Jump to navigation
Jump to search
m (→Goal) |
(Fix direct links to videos.) |
||
| (3 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
| − | |||
== Goal == | == Goal == | ||
| − | This half-day course given on February 27, 2013 at SciNet, on parallel I/O techniques. Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF. | + | This half-day course given on February 27, 2013 at SciNet, was on parallel I/O techniques. Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF. |
== Slides (PDF) == | == Slides (PDF) == | ||
| Line 10: | Line 9: | ||
== Videos == | == Videos == | ||
| − | # [http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-intro/pario-intro.html Introduction to Parallel I/O]<br/>[[File:Morning_intro.png|180px|Click for Video|link=http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-intro/pario-intro.html]]<br/>[http://support.scinet.utoronto.ca/ParallelIOcourse/pario-intro/pario-intro.mp4 direct link] | + | # [http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-intro/pario-intro.html Introduction to Parallel I/O]<br/>[[File:Morning_intro.png|180px|Click for Video|link=http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-intro/pario-intro.html]]<br/>[http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-intro/pario-intro.mp4 direct link] |
| − | # [http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-mpiio/pario-mpiio.html Parallel I/O with MPI (MPI-IO)]<br/>[[File:Morning_intro.png|180px|Click for Video|link=http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-mpiio/pario-mpiio.html]]<br/>[http://support.scinet.utoronto.ca/ParallelIOcourse/pario- | + | # [http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-mpiio/pario-mpiio.html Parallel I/O with MPI (MPI-IO)]<br/>[[File:Morning_intro.png|180px|Click for Video|link=http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-mpiio/pario-mpiio.html]]<br/>[http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-mpiio/pario-mpiio.mp4 direct link] |
| − | # [http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-netcdfhdf5/pario-netcdfhdf5.html Parallel I/O with NetCDF and HDF5]<br/>[[File:Morning_intro.png|180px|Click for Video|link=http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-netcdfhdf5/pario-netcdfhdf5.html]]<br/>[http://support.scinet.utoronto.ca/ParallelIOcourse/pario- | + | # [http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-netcdfhdf5/pario-netcdfhdf5.html Parallel I/O with NetCDF and HDF5] (apologies for the poor sound quality)<br/>[[File:Morning_intro.png|180px|Click for Video|link=http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-netcdfhdf5/pario-netcdfhdf5.html]]<br/>[http://support.scinet.utoronto.ca/CourseVideo/ParallelIOcourse/pario-netcdfhdf5/pario-netcdfhdf5.mp4 direct link] |
== Code == | == Code == | ||
* [[Media:ScinetCourseParIO.tgz | Hands-on example code from /scinet/course/parIO/]] | * [[Media:ScinetCourseParIO.tgz | Hands-on example code from /scinet/course/parIO/]] | ||
Latest revision as of 17:29, 22 March 2013
Goal
This half-day course given on February 27, 2013 at SciNet, was on parallel I/O techniques. Doing large-scale computation can be much easier than recording the results of the computation. In this half day course, a variety of strategies for doing large-scale I/O were discussed either with parallel or large numbers of serial jobs; we then focused on technologies for truly Parallel I/O, including MPI-IO, HDF5, and NetCDF.
Slides (PDF)
Videos
- Introduction to Parallel I/O
direct link - Parallel I/O with MPI (MPI-IO)
direct link - Parallel I/O with NetCDF and HDF5 (apologies for the poor sound quality)
direct link