Difference between revisions of "SciNet User Support Library"

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search
Line 10: Line 10:
 
| valign="top" width="50%" style="padding:1em; border:1px solid #8fa1b2; background-color:#F6DEDE" |
 
| valign="top" width="50%" style="padding:1em; border:1px solid #8fa1b2; background-color:#F6DEDE" |
 
== QuickStart Guides ==
 
== QuickStart Guides ==
* [[Essentials|Essential Login Information]]
+
* [[Essentials|Login Essentials]]
* [[GPC_Quickstart|GPC - General Purpose Cluster: Nehalem (x86_64) cluster running Linux]]
+
* [[GPC_Quickstart|GPC (General Purpose Cluster)]]
* [[TCS_Quickstart|TCS - Tightly Coupled System: IBM Power 6 system running AIX]]
+
* [[TCS_Quickstart|TCS (Tightly Coupled System)]]
* [[Storage_Quickstart|Storage at SciNet]]
+
* [[Storage_Quickstart|Storage]]
* [[Data_Transfer|Data Transfer from SciNet]]
+
* [[Data_Transfer|Data Transfer]]
 
* [[Software_and_Libraries | Software & Libraries]]
 
* [[Software_and_Libraries | Software & Libraries]]
 
* [[Moab | Job Scheduling System (Moab/Torque) ]]
 
* [[Moab | Job Scheduling System (Moab/Torque) ]]
* [[Introduction_To_Performance|A Performance Primer]]
+
* [[Introduction_To_Performance|Performance Primer]]
* [[FAQ | Frequently Asked Questions]]
+
* [[Performance_And_Debugging_Tools:_GPC | GPC Performance & Debugging]]
* [[Performance_And_Debugging_Tools:_GPC | Performance & Debugging Tools: GPC]]
+
* [[Performance_And_Debugging_Tools:_TCS | TCS Performance & Debugging]]
* [[Performance_And_Debugging_Tools:_TCS | Performance & Debugging Tools: TCS]]
+
* [[FAQ | FAQ (Frequently Asked Questions)]]
* [[Acknowledging SciNet]]
+
 
====SciNet Accounts====
+
SciNet Accounts:
 +
 
 
* [[Application Process]]
 
* [[Application Process]]
 
* [https://portal.scinet.utoronto.ca/usage_policy/ SciNet Usage Policy]
 
* [https://portal.scinet.utoronto.ca/usage_policy/ SciNet Usage Policy]
 +
* [[SciNet Usage Reports]]
 +
* [[Acknowledging SciNet]]
 +
 
| valign="top" style="padding:1em; border:1px solid #8fa1b2; background-color:#DEF6DE" |
 
| valign="top" style="padding:1em; border:1px solid #8fa1b2; background-color:#DEF6DE" |
  
 
== Manuals ==
 
== Manuals ==
  
* Intel Manuals (GPC):
+
* GPC (Intel)  
** C/C++: [http://software.intel.com/sites/products/documentation/hpc/compilerpro/en-us/cpp/lin/compiler_c/index.htm Intel (R) C++ Compiler 11.1 User and Reference Guide]
+
** [http://software.intel.com/sites/products/documentation/hpc/compilerpro/en-us/cpp/lin/compiler_c/index.htm C & C++ Compiler]
** FORTRAN: [http://software.intel.com/sites/products/documentation/hpc/compilerpro/en-us/fortran/lin/compiler_f/index.htm Intel(R) Fortran Compiler 11.1 User and Reference Guide]
+
** [http://software.intel.com/sites/products/documentation/hpc/compilerpro/en-us/fortran/lin/compiler_f/index.htm Fortran Compiler]
** MKL: [http://software.intel.com/sites/products/documentation/hpc/mkl/lin/index.htm Intel(R) Math Kernel Library for Linux* OS User's Guide], [http://software.intel.com/en-us/articles/intel-mkl-link-line-advisor Intel(R) Math Kernel Library Link Line Advisor]
+
** [http://software.intel.com/sites/products/documentation/hpc/mkl/lin/index.htm Math Kernel Library]
** MPI: [http://software.intel.com/sites/products/documentation/hpc/mpi/linux/reference_manual.pdf Intel(R) MPI Library for Linux* OS Reference Manual]
+
** [http://software.intel.com/en-us/articles/intel-mkl-link-line-advisor Math Kernel Library Link Line Advisor]
 +
** [http://software.intel.com/sites/products/documentation/hpc/mpi/linux/reference_manual.pdf Intel(R) MPI Library]
  
* IBM AIX Manuals (TCS):
+
* TCS (IBM)
** C: [http://support.scinet.utoronto.ca/Manuals/xlc-compiler.pdf Compiler Reference], [http://support.scinet.utoronto.ca/Manuals/xlc-proguide.pdf Optimization and Programming Guide], [http://support.scinet.utoronto.ca/Manuals/xlc-langref.pdf Language Reference].
+
** [http://support.scinet.utoronto.ca/Manuals/xlc-compiler.pdf C Compiler], [http://support.scinet.utoronto.ca/Manuals/xlc-proguide.pdf Optimization & Programming], [http://support.scinet.utoronto.ca/Manuals/xlc-langref.pdf Language]
** C++: [http://support.scinet.utoronto.ca/Manuals/xlC++-compiler.pdf Compiler Reference], [http://support.scinet.utoronto.ca/Manuals/xlC++-proguide.pdf Optimization and Programming Guide], [http://support.scinet.utoronto.ca/Manuals/xlC++-langref.pdf Language Reference].
+
** [http://support.scinet.utoronto.ca/Manuals/xlC++-compiler.pdf C++ Compiler], [http://support.scinet.utoronto.ca/Manuals/xlC++-proguide.pdf Optimization & Programming], [http://support.scinet.utoronto.ca/Manuals/xlC++-langref.pdf Language]
** FORTRAN: [http://support.scinet.utoronto.ca/Manuals/xlf-compiler.pdf Compiler Reference], [http://support.scinet.utoronto.ca/Manuals/xlf-proguide.pdf Optimization and Programming Guide], [http://support.scinet.utoronto.ca/Manuals/xlf-langref.pdf Language Reference].
+
** [http://support.scinet.utoronto.ca/Manuals/xlf-compiler.pdf Fortran Compiler], [http://support.scinet.utoronto.ca/Manuals/xlf-proguide.pdf Optimization & Programming], [http://support.scinet.utoronto.ca/Manuals/xlf-langref.pdf Language]
** ESSL (High performance math library): [http://publib.boulder.ibm.com/epubs/pdf/am501405.pdf Guide and Reference], [http://publib.boulder.ibm.com/epubs/pdf/am601305.pdf Parallel ESSL Guide and Reference]
+
** [http://publib.boulder.ibm.com/epubs/pdf/am501405.pdf ESSL High performance math library V4] ([http://publib.boulder.ibm.com/epubs/pdf/am601305.pdf V3])
** [http://support.scinet.utoronto.ca/Manuals/JUMP-AIX-POWER6-AppsPerformanceTuning-wp032008.pdf Application Performance Tuning and Optimization on POWER6]
+
** [http://support.scinet.utoronto.ca/Manuals/JUMP-AIX-POWER6-AppsPerformanceTuning-wp032008.pdf Performance Tuning & Optimization]
** LoadLeveler: [http://support.scinet.utoronto.ca/Manuals/LL-usingandadministering.pdf LoadLeveler Using and Administering]
+
** [http://support.scinet.utoronto.ca/Manuals/LL-usingandadministering.pdf LoadLeveler: Using & Administering]
** Parallel Environment: [http://support.scinet.utoronto.ca/Manuals/PE5.1-operationanduse.pdf Parallel Environment Operation and Use]
+
** [http://support.scinet.utoronto.ca/Manuals/PE5.1-operationanduse.pdf Parallel Environment: Operation & Use]
  
* Adaptive Computing (Cluster Resources) Manuals:
+
* Adaptive Computing/Cluster Resources
** MOAB: [http://www.clusterresources.com/products/mwm/docs/index.shtml Moab Workload Manager]
+
** [http://www.clusterresources.com/products/mwm/docs/index.shtml MOAB Workload Manager]
** TORQUE: [http://www.clusterresources.com/products/torque/docs/ Torque Resource Manager]
+
** [http://www.clusterresources.com/products/torque/docs/ TORQUE Resource Manager]
  
 
|-
 
|-
Line 53: Line 58:
 
== Tutorials ==
 
== Tutorials ==
 
* [https://support.scinet.utoronto.ca/wiki/images/5/54/SciNet_Tutorial.pdf SciNet User Tutorial]
 
* [https://support.scinet.utoronto.ca/wiki/images/5/54/SciNet_Tutorial.pdf SciNet User Tutorial]
====Workshops given at SciNet:====
+
* Parallel Scientific Computing Workshop, SciNet, Aug 2009: [[ Parallel_Scientific_Computing_-_Aug_09  | Slides ]]/[http://www.cita.utoronto.ca/~ljdursi/PSP/ Video]
* SciNet Parallel Scientific Computing Workshop, Aug 2009 - [[ Parallel_Scientific_Computing_-_Aug_09  | Slides ]] and [http://www.cita.utoronto.ca/~ljdursi/PSP/ Video]
+
* [[IBM_Nov_Workshop | IBM AIX Workshop, SciNet, Nov 2008 ]]  
* [[IBM_Nov_Workshop | IBM AIX Workshop, Nov 2008 ]]
+
* [[IBM_Feb_Workshop | IBM MPI Workshop, SciNet, Feb 2009]]
* [[IBM_Feb_Workshop | IBM MPI Workshop, Feb 2009]]
+
* [[IBM_Compiler_Workshop | IBM Compiler Workshop, SciNet, Feb 2009]]
* [[IBM_Compiler_Workshop | IBM Compiler Workshop, Feb 2009]]
+
* [http://www.vscse.org/news/apply_summer2010.html  Virtual School for CSE]: Free webinar-style courses (but must register):
 
+
** Petascale programming environments and tools, Jul 6–9, 2010
====Online Parallel/Scientific Programming Courses====
+
** Big data for science, Jul 26–30, 2010
* [http://www.vscse.org/news/apply_summer2010.html  Virtual School for CSE] -- Free online webinar-style courses, but one must register beforehand:
+
** Proven algorithmic techniques for many-core processors, Aug 2–6, 2010
** Petascale Programming Environments and Tools, July 6–9, 2010
 
** Big Data for Science, July 26–30, 2010
 
** Proven Algorithmic Techniques for Many-core Processors, August 2–6, 2010
 
 
* [http://developer.nvidia.com/object/cuda_training.html  NVidia archived courses for GPGPU Programming]
 
* [http://developer.nvidia.com/object/cuda_training.html  NVidia archived courses for GPGPU Programming]
 
+
* [https://computing.llnl.gov/tutorials/mpi/ LLNL MPI Tutorial]: This was the basis for the MPI workshop at SciNet.  
====Useful Links:====
+
* [http://cnx.org/content/col11136/latest/  High Performance Computing Book]: Online version of an older O'Reilly book which covers the basics of (mostly serial) programming for performance.  Covers the most important issues today very clearly.
* [https://computing.llnl.gov/tutorials/mpi/ LLNL MPI Tutorial] - This tutorial by Blaise Barney was used as the basis for Kirk Jordan's MPI workshop at SciNet.  It is well worth studying.
+
* [http://www.ece.cmu.edu/~franzf/papers/gttse07.pdf  How to Write Fast Numerical Code ]: good introduction to thinking about performance.
* [http://cnx.org/content/col11136/latest/  High Performance Computing Book ] - An online version of an older O'Reilly book which covers the basics of (mostly serial) programming for performance.  The most important issues today are covered here, and very clearly.
 
* [http://www.ece.cmu.edu/~franzf/papers/gttse07.pdf  How to Write Fast Numerical Code ] - a good introduction to thinking about performance.
 
  
 
| valign="top" style="padding:1em; border:1px solid #8fa1b2; background-color:#DEDEDE" |
 
| valign="top" style="padding:1em; border:1px solid #8fa1b2; background-color:#DEDEDE" |

Revision as of 14:01, 13 May 2010

Welcome to the SciNet User Support library. Here you will find up-to-date manuals put together by SciNet staff and users, as well as links to external resources, to help you make use of SciNet resources for computational scientific discovery.

System Status

System status can now be found at docs.scinet.utoronto.ca


Mon 23 Apr 2018 GPC-compute is decommissioned, GPC-storage available until 30 May 2018

Thu 18 Apr 2018 Niagara system will undergo an upgrade to its Infiniband network between 9am and 12pm, should be transparent to users, however there is a chance of network interruption.

Fri 13 Apr 2018 HPSS system will be down for a few hours on Mon, Apr/16, 9AM, for hardware upgrades, in preparation for the eventual move to the Niagara side.

Tue 10 Apr 2018 Niagara is open to users.

Wed 4 Apr 2018 We are very close to the production launch of Niagara, the new system installed at SciNet. While the RAC allocation year officially starts today, April 4/18, the Niagara system is still undergoing some final tuning and software updates, so the plan is to officially open it to users on next week.

All active GPC users will have their accounts, $HOME, and $PROJECT, transferred to the new Niagara system. Those of you who are new to SciNet, but got RAC allocations on Niagara, will have your accounts created and ready for you to login.

We are planning an extended Intro to SciNet/Niagara session, available in person at our office, and webcast on Vidyo and possibly other means, on Wednesday April 11 at noon EST.


QuickStart Guides

SciNet Accounts:

Manuals

Tutorials

Template:SciNetWiki:Current events

User-Supplied Content

Share your expertise with the SciNet Community!