Difference between revisions of "Knowledge Base: Tutorials and Manuals"
Jump to navigation
Jump to search
m (→Programming) |
|||
Line 73: | Line 73: | ||
===General=== | ===General=== | ||
* [http://software-carpentry.org Software Carpentry Resources] | * [http://software-carpentry.org Software Carpentry Resources] | ||
− | * [[Media:Snug_techtalk_revcontrol.pdf| | + | * Version Control: [http://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_BP_Revision_Control/Thursday_Morning_BP_Revision_Control.mp4 Video]/ [[Media:Snug_techtalk_revcontrol.pdf | Slides]] |
* [[IBM_Nov_Workshop | IBM AIX Workshop, SciNet, Nov 2008 ]] | * [[IBM_Nov_Workshop | IBM AIX Workshop, SciNet, Nov 2008 ]] | ||
− | |||
* [[IBM_Compiler_Workshop | IBM Compiler Workshop, SciNet, Feb 2009]] | * [[IBM_Compiler_Workshop | IBM Compiler Workshop, SciNet, Feb 2009]] | ||
− | |||
===Fortran=== | ===Fortran=== | ||
* Modern Fortran Course (1 day), SciNet, 19 Apr 2011 | * Modern Fortran Course (1 day), SciNet, 19 Apr 2011 | ||
Line 92: | Line 90: | ||
* [http://support.scinet.utoronto.ca/Manuals/xlC++-compiler.pdf IBM C++ compiler], [http://support.scinet.utoronto.ca/Manuals/xlC++-langref.pdf language], [http://support.scinet.utoronto.ca/Manuals/xlC++-proguide.pdf optimization] | * [http://support.scinet.utoronto.ca/Manuals/xlC++-compiler.pdf IBM C++ compiler], [http://support.scinet.utoronto.ca/Manuals/xlC++-langref.pdf language], [http://support.scinet.utoronto.ca/Manuals/xlC++-proguide.pdf optimization] | ||
===C=== | ===C=== | ||
+ | * C refresher: [http://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Monday_Morning_C_Review/Monday_Morning_C_Review.mp4 Video]/ [[Media:Monday_Morning_C_Review.pdf| Slides]] | ||
* [http://support.scinet.utoronto.ca/Manuals/xlc-compiler.pdf IBM C compiler], [http://support.scinet.utoronto.ca/Manuals/xlc-langref.pdf language], [http://support.scinet.utoronto.ca/Manuals/xlc-proguide.pdf optimization] | * [http://support.scinet.utoronto.ca/Manuals/xlc-compiler.pdf IBM C compiler], [http://support.scinet.utoronto.ca/Manuals/xlc-langref.pdf language], [http://support.scinet.utoronto.ca/Manuals/xlc-proguide.pdf optimization] | ||
===Perl=== | ===Perl=== | ||
Line 101: | Line 100: | ||
==Parallel Programming== | ==Parallel Programming== | ||
− | |||
* Parallel Programming Course (5 days), SciNet, May 2011 | * Parallel Programming Course (5 days), SciNet, May 2011 | ||
** [[Parallel_Scientific_Computing_-_May_2011 | Videos, slides and code]] | ** [[Parallel_Scientific_Computing_-_May_2011 | Videos, slides and code]] | ||
Line 122: | Line 120: | ||
* [[GPC MPI Versions]] | * [[GPC MPI Versions]] | ||
* [[Co-array Fortran on the GPC]] | * [[Co-array Fortran on the GPC]] | ||
+ | * [[IBM_Feb_Workshop | IBM MPI Workshop, SciNet, Feb 2009]] | ||
+ | * [http://support.scinet.utoronto.ca/Manuals/UPC/compiler.pdf IBM UPC compiler], [http://support.scinet.utoronto.ca/Manuals/UPC/langref.pdf language], [http://support.scinet.utoronto.ca/Manuals/UPC/upcopt.pdf optimization], [http://support.scinet.utoronto.ca/Manuals/UPC/standlib.pdf library], [http://support.scinet.utoronto.ca/Manuals/UPC/upcusersguide.pdf user's guide], [http://support.scinet.utoronto.ca/Manuals/UPC/proguide.pdf programmer's guide] | ||
+ | |||
+ | ==GPU Computing== | ||
+ | * [[SciNet GPU Workshop July 2010]] | ||
+ | * Intro to GPGPU Programming: [http://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_GPGPU/Friday_Morning_GPGPU.mp4 Video]/ [[Media:Gpgpu.pdf | Slides]]<br />(from 5 day parallel programming course at SciNet, May 2011) | ||
+ | * [http://developer.nvidia.com/object/cuda_training.html NVidia archived courses for GPGPU Programming] | ||
==Performance Tuning== | ==Performance Tuning== | ||
Line 132: | Line 137: | ||
==Debugging== | ==Debugging== | ||
− | * [[Media:Snugdebug.pdf|TechTalk: Debuggers & Parallel Debugging on SciNet - gdb, ddd, padb], SciNet User Group Meeting, Nov 2010]] | + | * [[Media:Snugdebug.pdf|TechTalk: Debuggers & Parallel Debugging on SciNet - gdb, ddd, padb], SciNet User Group Meeting, Nov 2010]]<br/ > [http://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Thursday_Morning_Debugging/Thursday_Morning_Debugging.mp4 Video] |
− | |||
==Math libraries (BLAS, LAPACK, FFT)== | ==Math libraries (BLAS, LAPACK, FFT)== | ||
* [[Media:FP_Consistency.pdf|Intel Compiler Floating Point Consistency]] | * [[Media:FP_Consistency.pdf|Intel Compiler Floating Point Consistency]] | ||
Line 148: | Line 152: | ||
**[[Media:Netcdfhdf5.pdf|NetCDF/HDF5 Slides]] | **[[Media:Netcdfhdf5.pdf|NetCDF/HDF5 Slides]] | ||
**[[Media:ParIO.tgz|Source Code]]. | **[[Media:ParIO.tgz|Source Code]]. | ||
− | * [[Media:Snugio.pdf|Sept 2010 SNUG TechTalk: Parallel File System and IO]] | + | * [[Media:Snugio.pdf|Sept 2010 SNUG TechTalk: Parallel File System and IO]] <br/ >[http://support.scinet.utoronto.ca/CourseVideo/PPPcourse/Friday_Morning_IO/Friday_Morning_IO.mp4 Video] |
* [[File System and I/O dos and don'ts]] | * [[File System and I/O dos and don'ts]] | ||
− | |||
− | |||
− | |||
− | |||
==Visualization== | ==Visualization== |
Revision as of 11:23, 3 June 2011
Manuals Intel (GPC):
IBM (TCS):
Scheduler (Adaptive Computing/Cluster Resources) DDT (Allinea) |
Training material
For upcoming classes, see our Courses website!
SciNet Basics
- SciNet User Tutorial
- Intro to SciNet, SciNet, Sept 2010
- SciNet Resources: Video/ Slides
- Essentials
- Frequenty asked questions
- Ssh
- GPC quickstart
- TCS quickstart
- ARC/GPU quickstart
- ARC/Cell quickstart
- Important .bashrc guidelines
- Software and libraries
- Installing your own modules
- User-space modules and packages (April 2011 SNUG TechTalk)
Batch job management
- Job Monitoring on SciNet and Job Efficiency
- Wallclock time
- Checkpoints
- Signals
- Moab
- Serial Jobs
- Ramdisk
- Moab workload manager
- Moab commands
- Torque resource manager
- Torque PBS commands
- Parallel environment
- Cluster information center (with error codes)
- LoadLeveler: using & administering
Programming
General
- Software Carpentry Resources
- Version Control: Video/ Slides
- IBM AIX Workshop, SciNet, Nov 2008
- IBM Compiler Workshop, SciNet, Feb 2009
Fortran
- Modern Fortran Course (1 day), SciNet, 19 Apr 2011
- IBM Fortran compiler language, optimization
C++
- Scientific C++ Course (1 day), SciNet, 15 March 2011
- Intel C & C++ compiler
- Intel Fortran compiler
- IBM C++ compiler, language, optimization
C
- C refresher: Video/ Slides
- IBM C compiler, language, optimization
Perl
Python
R
Parallel Programming
- Parallel Programming Course (5 days), SciNet, May 2011
- Parallel Computing for Computational Fluid Dynamics (CFD), SciNet, 23 March 2011
- Intro to Practical Parallel Programming (1 day), SciNet, 22 Sept 2010:
- Parallel Scientific Computing Workshop (5 days), SciNet, Aug 2009:
- Virtual School for CSE Web courses (Jul/Aug 2010):
- Petascale programming environments and tools
- Big data for science
- Proven algorithmic techniques for many-core processors
- LLNL MPI Tutorial: This was the basis for the MPI workshop at SciNet.
- Intel MPI library
- GPC MPI Versions
- Co-array Fortran on the GPC
- IBM MPI Workshop, SciNet, Feb 2009
- IBM UPC compiler, language, optimization, library, user's guide, programmer's guide
GPU Computing
- SciNet GPU Workshop July 2010
- Intro to GPGPU Programming: Video/ Slides
(from 5 day parallel programming course at SciNet, May 2011) - NVidia archived courses for GPGPU Programming
Performance Tuning
- Introduction To Performance
- Performance tools for GPC and TCS
- Dec 2010 SNUG TechTalk: Profiling Tools on GPC
- High Performance Computing Book
Online version of an older O'Reilly book which covers the basics of (mostly serial) programming for performance. Covers the most important issues today very clearly. - How to Write Fast Numerical Code
Good introduction to thinking about performance. - Performance tuning
Debugging
- TechTalk: Debuggers & Parallel Debugging on SciNet - gdb, ddd, padb], SciNet User Group Meeting, Nov 2010
Video
Math libraries (BLAS, LAPACK, FFT)
- Intel Compiler Floating Point Consistency
- Math Kernel Library (MKL)
- Math Kernel Library's Vector Statistical Library
- Math Kernel Library link line advisor
($MKLPATH → ${MKLPATH} in makefiles) - ESSL high performance math library V4 (V3)
- Parallel ESSL high performance math library V3.3
I/O
- Data management
- Intro to Parallel I/O, SciNet, Oct 6th, 2010:
- Sept 2010 SNUG TechTalk: Parallel File System and IO
Video - File System and I/O dos and don'ts
Visualization
- Using Paraview
- Science Illustrated: Two-day symposium on Visualizing Science, Feb 2011
- Videos of the talks given at Science Illustrated (recorded by KMDI at UoT):
- Opening remarks by Paul Young
- Information Visualization and the Myth of Information Overload by Christopher Collins
- Beyond Basic Visualization by Ramses Van Zon
- Network Visualization & Analysis by Igor Jurisica
- Simulation and Visualization of Blood Flow by David Steinman
- Scientific Visualizations: Does the Science Matter? by Thomas Lucas
- How can visualization impact public perception of science? Panelists: Jay Ingram, Peter Calamai, Reni Barlow, Hooley McLaughlin
- How Info Graphics are Created for the Mainstream Media by Peter Calamai
- Design Boot Camp by Graham Huber
- Visualization Large Datasets by Jonathan Dursi
- Visualizing Colliding Black Holes by Herald Pfeiffer
- Closing remarks by Mubdi Rahman
Applications
Currently, information on the following applications is available: