Difference between revisions of "Parallel Scientific Computing - May 2011"

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search
m
Line 4: Line 4:
 
The goal of the workshop was to enable young researchers already experienced in scientific computing to leave with the knowledge necessary to begin writing the parallel codes needed for their research. The workshop consisted of a mix of lectures and immediate feedback on practical assignments, designed to ensure that students leave with significant experience in both OpenMP and MPI, two of the standards for parallel computing today. GPGPU Programming with Cuda was also briefly introduced.  
 
The goal of the workshop was to enable young researchers already experienced in scientific computing to leave with the knowledge necessary to begin writing the parallel codes needed for their research. The workshop consisted of a mix of lectures and immediate feedback on practical assignments, designed to ensure that students leave with significant experience in both OpenMP and MPI, two of the standards for parallel computing today. GPGPU Programming with Cuda was also briefly introduced.  
  
==Slides (PDF)==
+
==Lectures==
# [[Media:Monday_Morning_Intro_Parallel.pdf| Intro to Class and to Parallel Programming]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_Intro_Parallel/Monday_Morning_Intro_Parallel.mp4 Intro to Class and to Parallel Programming] <br />[[File:MonMorIntro_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_Intro_Parallel/Monday_Morning_Intro_Parallel.mp4]] <br />[[Media:Monday_Morning_Intro_Parallel.pdf|Slides]]
# [[Media:Monday_Morning_SciNet_Resources.pdf| SciNet Resources]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_SciNet_Resources/Monday_Morning_SciNet_Resources.mp4 SciNet Resources] <br />[[File:MonMorSN_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_SciNet_Resources/Monday_Morning_SciNet_Resources.mp4]] <br />[[Media:Monday_Morning_SciNet_Resources.pdf|Slides]]
# [[Media:Monday_Morning_C_Review.pdf| C Review]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_C_Review/Monday_Morning_C_Review.mp4 C Review] <br />[[File:MonMorC_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_C_Review/Monday_Morning_C_Review.mp4]] <br />[[Media:Monday_Morning_C_Review.pdf| Slides]]
# [[Media:Monday_Afternoon_OpenMP1.pdf| Introduction to OpenMP]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP1/Monday_Afternoon_OpenMP1.mp4 Introduction to OpenMP - part 1][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP2/Monday_Afternoon_OpenMP2.mp4 part 2][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP3/Monday_Afternoon_OpenMP3.mp4 part 3][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP4/Tuesday_Morning_OpenMP4.mp4 part 4][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP5/Tuesday_Morning_OpenMP5.mp4 part 5][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP6/Tuesday_Morning_OpenMP6.mp4 part 6] <br />[[File:MonAftOMP1_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP1/Monday_Afternoon_OpenMP1.mp4]] [[File:MonAftOMP2_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse//Monday_Afternoon_OpenMP2/Monday_Afternoon_OpenMP2.mp4]] [[File:MonAftOMP3_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP3/Monday_Afternoon_OpenMP3.mp4]] <br/> <br/>[[File:TueMorOMP4_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse//Tuesday_Morning_OpenMP4/Tuesday_Morning_OpenMP4.mp4]] [[File:TueMorOMP5_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse//Tuesday_Morning_OpenMP5/Tuesday_Morning_OpenMP5.mp4]] [[File:TueMorOMP6_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP6/Tuesday_Morning_OpenMP6.mp4]] <br />[[Media:Monday_Afternoon_OpenMP1.pdf| Slides of all 6 OpenMP parts]]
# [[Media:MPI.pdf | Introduction to MPI]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Afternoon_MPI1/Tuesday_Afternoon_MPI1.mp4 Introduction to MPI Part 1][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Morning_MPI/Wednesday_Morning_MPI.mp4 Part 2]<br/>[[File:TueAftMPI1_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Afternoon_MPI1/Tuesday_Afternoon_MPI1.mp4 ]] [[File:WedMorMPI_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Morning_MPI/Wednesday_Morning_MPI.mp4]] <br/> [[Media:MPI.pdf | Slides of both MPI parts]]
# [[Media:Hydro-may2011.pdf‎ | Hydrodynamics]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Afternoon_Hydro/Wednesday_Afternoon_Hydro.mp4 Hydrodynamics]<br/>[[File:WedAftHyd_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Afternoon_Hydro/Wednesday_Afternoon_Hydro.mp4]]<br/>  [[Media:Hydro-may2011.pdf‎ | Slides]]
# [[Media:Snug_techtalk_revcontrol.pdf | Version Control]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_BP_Revision_Control/Thursday_Morning_BP_Revision_Control.mp4 HPC Best Practices and Version Control]<br/>[[File:ThuMorBPR_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_BP_Revision_Control/Thursday_Morning_BP_Revision_Control.mp4]] <br/> [[Media:Snug_techtalk_revcontrol.pdf | Slides]]
# [[Media:Best-practice-debug.pdf | Parallel Debugging]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_Debugging/Thursday_Morning_Debugging.mp4 Parallel Debugging]<br/>[[File:ThuMorDbg_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_Debugging/Thursday_Morning_Debugging.mp4]] <br/> [[Media:Best-practice-debug.pdf | Slides]]
# [[Media:ThurdayAfternoonNbody.pdf | N-body Part 1 (openmp)]] [[Media:Nbody-mpi.pdf | Part 2 (mpi)]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP1/Thursday_Afternoon_Nbody_OpenMP1.mp4 N-Body - part 1][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP2_MPI/Thursday_Afternoon_Nbody_OpenMP2_MPI.mp4 part 2]<br/>[[File:ThuAftNB1_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP1/Thursday_Afternoon_Nbody_OpenMP1.mp4]] [[File:ThuAftNB2_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP2_MPI/Thursday_Afternoon_Nbody_OpenMP2_MPI.mp4]] <br/>[[Media:ThurdayAfternoonNbody.pdf | Slides of the OpenMP part]] [[Media:Nbody-mpi.pdf | Slides of the MPI part]]
# [[Media:Snugio.pdf | I/O Best practices on the parallel file system]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_IO/Friday_Morning_IO.mp4 I/O on a Parallel File System]<br/>[[File:FriMorIO.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_IO/Friday_Morning_IO.mp4]] <br/> [[Media:Snugio.pdf | Slides]]
# [[Media:Gpgpu.pdf | CUDA GPU programming]]
+
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_GPGPU/Friday_Morning_GPGPU.mp4 Intro to GPGPU Programming] <br/>[[File:FriMorGPU_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_GPGPU/Friday_Morning_GPGPU.mp4]]<br/>  [[Media:Gpgpu.pdf | Slides]]
 
 
==Videos==
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_Intro_Parallel/Monday_Morning_Intro_Parallel.mp4 Intro to Class and to Parallel Programming] <br/>[[File:MonMorIntro_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_Intro_Parallel/Monday_Morning_Intro_Parallel.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_SciNet_Resources/Monday_Morning_SciNet_Resources.mp4 SciNet Resources]<br/>[[File:MonMorSN_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_SciNet_Resources/Monday_Morning_SciNet_Resources.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_C_Review/Monday_Morning_C_Review.mp4 C Review]<br/>[[File:MonMorC_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_C_Review/Monday_Morning_C_Review.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP1/Monday_Afternoon_OpenMP1.mp4 Introduction to OpenMP - part 1][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP2/Monday_Afternoon_OpenMP2.mp4 part 2][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP3/Monday_Afternoon_OpenMP3.mp4 part 3][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP4/Tuesday_Morning_OpenMP4.mp4 part 4][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP5/Tuesday_Morning_OpenMP5.mp4 part 5][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP6/Tuesday_Morning_OpenMP6.mp4 part 6]<br/>[[File:MonAftOMP1_FirstFrame.png|120px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP1/Monday_Afternoon_OpenMP1.mp4]] [[File:MonAftOMP2_FirstFrame.png|120px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse//Monday_Afternoon_OpenMP2/Monday_Afternoon_OpenMP2.mp4]] [[File:MonAftOMP3_FirstFrame.png|120px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Afternoon_OpenMP3/Monday_Afternoon_OpenMP3.mp4]] [[File:TueMorOMP4_FirstFrame.png|120px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse//Tuesday_Morning_OpenMP4/Tuesday_Morning_OpenMP4.mp4]] [[File:TueMorOMP5_FirstFrame.png|120px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse//Tuesday_Morning_OpenMP5/Tuesday_Morning_OpenMP5.mp4]] [[File:TueMorOMP6_FirstFrame.png|120px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Morning_OpenMP6/Tuesday_Morning_OpenMP6.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Afternoon_MPI1/Tuesday_Afternoon_MPI1.mp4 Introduction to MPI Part 1][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Morning_MPI/Wednesday_Morning_MPI.mp4 Part 2]<br/>[[File:TueAftMPI1_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Tuesday_Afternoon_MPI1/Tuesday_Afternoon_MPI1.mp4 ]] [[File:WedMorMPI_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Morning_MPI/Wednesday_Morning_MPI.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Afternoon_Hydro/Wednesday_Afternoon_Hydro.mp4 Hydrodynamics]<br/>[[File:WedAftHyd_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Wednesday_Afternoon_Hydro/Wednesday_Afternoon_Hydro.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_BP_Revision_Control/Thursday_Morning_BP_Revision_Control.mp4 HPC Best Practices and Version Control]<br/>[[File:ThuMorBPR_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_BP_Revision_Control/Thursday_Morning_BP_Revision_Control.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_Debugging/Thursday_Morning_Debugging.mp4 Parallel Debugging]<br/>[[File:ThuMorDbg_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_Debugging/Thursday_Morning_Debugging.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP1/Thursday_Afternoon_Nbody_OpenMP1.mp4 N-Body - part 1][https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP2_MPI/Thursday_Afternoon_Nbody_OpenMP2_MPI.mp4 part 2]<br/>[[File:ThuAftNB1_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP1/Thursday_Afternoon_Nbody_OpenMP1.mp4]] [[File:ThuAftNB2_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Afternoon_Nbody_OpenMP2_MPI/Thursday_Afternoon_Nbody_OpenMP2_MPI.mp4]]  
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_IO/Friday_Morning_IO.mp4 I/O on a Parallel File System]<br/>[[File:FriMorIO.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_IO/Friday_Morning_IO.mp4]]
 
# [https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_GPGPU/Friday_Morning_GPGPU.mp4 Intro to GPGPU Programming] <br/>[[File:FriMorGPU_FirstFrame.png|180px|Click for Video|link=https://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_GPGPU/Friday_Morning_GPGPU.mp4]]
 
  
 
==Source Code==
 
==Source Code==
 
*[[Media:Ppp2011code.tgz | Tar-ball of the source code used in class]]
 
*[[Media:Ppp2011code.tgz | Tar-ball of the source code used in class]]

Revision as of 10:45, 3 June 2011

This was an intensive week-long workshop on Scientific Parallel Programming, held at SciNet on the University of Toronto St. George campus.

Goal

The goal of the workshop was to enable young researchers already experienced in scientific computing to leave with the knowledge necessary to begin writing the parallel codes needed for their research. The workshop consisted of a mix of lectures and immediate feedback on practical assignments, designed to ensure that students leave with significant experience in both OpenMP and MPI, two of the standards for parallel computing today. GPGPU Programming with Cuda was also briefly introduced.

Lectures

  1. Intro to Class and to Parallel Programming
    Click for Video
    Slides
  2. SciNet Resources
    Click for Video
    Slides
  3. C Review
    Click for Video
    Slides
  4. Introduction to OpenMP - part 1part 2part 3part 4part 5part 6
    Click for Video Click for Video Click for Video

    Click for Video Click for Video Click for Video
    Slides of all 6 OpenMP parts
  5. Introduction to MPI Part 1Part 2
    Click for Video Click for Video
    Slides of both MPI parts
  6. Hydrodynamics
    Click for Video
    Slides
  7. HPC Best Practices and Version Control
    Click for Video
    Slides
  8. Parallel Debugging
    Click for Video
    Slides
  9. N-Body - part 1part 2
    Click for Video Click for Video
    Slides of the OpenMP part Slides of the MPI part
  10. I/O on a Parallel File System
    Click for Video
    Slides
  11. Intro to GPGPU Programming
    Click for Video
    Slides

Source Code