Parallel Scientific Computing - May 2011
This was an intensive week-long workshop on Scientific Parallel Programming, held at SciNet on the University of Toronto St. George campus.
The goal of the workshop was to enable young researchers already experienced in scientific computing to leave with the knowledge necessary to begin writing the parallel codes needed for their research. The workshop consisted of a mix of lectures and immediate feedback on practical assignments, designed to ensure that students leave with significant experience in both OpenMP and MPI, two of the standards for parallel computing today. GPGPU Programming with Cuda was also briefly introduced.
Lectures
- Intro to Class and to Parallel Programming
Slides - SciNet Resources
Slides - C Review
Slides - Introduction to OpenMP - part 1 part 2 part 3 part 4 part 5 part 6
Slides of all 6 OpenMP parts - Introduction to MPI - part 1 part 2
Slides of both MPI parts - Hydrodynamics
Slides - HPC Best Practices and Version Control
Slides - Parallel Debugging
Slides - N-Body - part 1 part 2
Slides of the OpenMP part
Slides of the MPI part - I/O on a Parallel File System
Slides - Intro to GPGPU Programming
Slides