Difference between revisions of "SciNet User Support Library"

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search
 
(185 intermediate revisions by 7 users not shown)
Line 1: Line 1:
 
__NOTOC__
 
__NOTOC__
 +
{| style="border-spacing: 8px; width:100%"
 +
| valign="top" style="cellpadding:1em; padding:1em; border:2px solid; background-color:#f6f674; border-radius:5px"|
 +
'''WARNING: SciNet is in the process of replacing this wiki with a new documentation site. For current information, please go to [https://docs.scinet.utoronto.ca https://docs.scinet.utoronto.ca]'''
 +
|}
 +
 +
 
{|  style="border-spacing: 8px;"
 
{|  style="border-spacing: 8px;"
 
| valign="top" style="cellpadding:1em; padding:1em; border:3px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|
 
| valign="top" style="cellpadding:1em; padding:1em; border:3px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|
 
{{SciNetWiki:System_Alerts}}
 
{{SciNetWiki:System_Alerts}}
 
| valign="top" style="cellpadding:1em; padding:1em; border:3px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|
 
| valign="top" style="cellpadding:1em; padding:1em; border:3px solid #0645ad; background-color:#f6f6f6; border-radius:7px"|
==System Updates==
+
==System News==
* Apr 4, Allinea DDT 4.0 now available (and default version) for all our systems, with 128 task license.
+
* April 23, 2018: GPC & Sandy decommissioned.
* Apr 4, Allinea MAP is now available on the GPC.
+
* April 10, 2018: Niagara commissioned.
* Mar 21, BGQ systems are running RHEL6.3 and V1R2M0 driver.
+
* March 20th, 2018: Gravity decommissioned.
* Mar 19, P7 xlf and vacpp compilers patched to latest versions, and the default modules refer to these latest versions.
+
* Dec 4, 2017 : scratchtcs decommissioned.
* Mar 18, Ray de-novo assembler v2.1.0 available on GPC
+
* Nov 28, 2017: The GPC has been reduced from 30,912 to 16,800 cores to make room for the installation of Niagara.
* Mar 7, PGI compilers v13.2 available on ARC and GPC
+
* Sept 29, 2017: The TCS has been decommissioned.
* Mar 7, Gnuplot 4.6.1 available on GPC
 
* Mar 5, [[P7 Linux Cluster]] expanded by 3 nodes.
 
  
([[Previous_updates:|Previous updates]])
+
([[Previous System News]])
 
|-
 
|-
 
| valign="top" width="50%" style="padding:1em; border:1px solid #aaaaaa; background-color:#f6e8e8; border-radius:7px" |
 
| valign="top" width="50%" style="padding:1em; border:1px solid #aaaaaa; background-color:#f6e8e8; border-radius:7px" |
  
 
== QuickStart Guides ==
 
== QuickStart Guides ==
 +
* [[SciNet Command Line Utilities]]
 
* [[Media:SciNet_Tutorial.pdf|SciNet User Tutorial]]
 
* [[Media:SciNet_Tutorial.pdf|SciNet User Tutorial]]
* [[Knowledge_Base:_Tutorials_and_Manuals|Tutorials and Manuals]]
 
* [[GPC_Quickstart|GPC: General Purpose Cluster]]
 
* [[TCS_Quickstart|TCS: Tightly Coupled System]]
 
* [[GPU_Devel_Nodes|ARC: GPU nodes]]
 
 
* [[P7_Linux_Cluster|P7: Power 7 Linux cluster]]
 
* [[P7_Linux_Cluster|P7: Power 7 Linux cluster]]
 
* [[BGQ|BGQ: BlueGene/Q clusters]]
 
* [[BGQ|BGQ: BlueGene/Q clusters]]
Line 30: Line 31:
 
* [[FAQ | FAQ (frequently asked questions)]]
 
* [[FAQ | FAQ (frequently asked questions)]]
 
* [[Acknowledging_SciNet | Acknowledging SciNet]]
 
* [[Acknowledging_SciNet | Acknowledging SciNet]]
 +
* [https://courses.scinet.utoronto.ca SciNet education]
 +
* [https://www.youtube.com/channel/UC42CaO-AAQhwqa8RGzE3daQ SciNet YouTube Channel]
 
| valign="top" style="padding:1em; border:1px solid #aaaaaa; background-color:#e8f6e8; border-radius:7px" |
 
| valign="top" style="padding:1em; border:1px solid #aaaaaa; background-color:#e8f6e8; border-radius:7px" |
 +
 +
== Tutorials and Manuals ==
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#SciNet_Basics|SciNet basics]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Linux|Linux]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Batch_job_management|Batch job management]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Programming|Programming]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Parallel_Programming|Parallel programming]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#GPU_Computing|GPU computing]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Performance_Tuning|Performance tuning]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Debugging|Debugging]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Math_libraries_.28BLAS.2C_LAPACK.2C_FFT.29|Math libraries (BLAS, LAPACK, FFT)]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#I/O|I/O and databases]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Visualization|Visualization]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Applications|Applications]]
 +
* [[Knowledge_Base:_Tutorials_and_Manuals#Manuals|Manuals (compilers etc)]]
 +
* [[2016_Ontario_Summer_School_for_High_Performance_Computing_Central]]
 +
* [[2015_Ontario_Summer_School_for_High_Performance_Computing_Central]]
 +
|-
 +
| valign="top" style="padding:1em; border:1px solid #aaaaaa; background-color:#e8e8f6; border-radius:7px" |
  
 
== What's New On The Wiki ==
 
== What's New On The Wiki ==
 
<div style='text-align:left;'>
 
<div style='text-align:left;'>
* Mar 21, 2013: Slides+recording [[Scientific Computing Course#Topics_2|Scientific Computing Course]] lecture III.2
+
 
* Mar 20, 2013: Slides of the [[Media:Cpp11.pdf|SciNet Developer Seminar on C++11]]
+
* Dec 2014: Updated [[GPC Quickstart]] with info on email notifications from the scheduler.
* Mar 19, 2013: Slides+recording [[Scientific Computing Course#Topics_2|Scientific Computing Course]] lecture III.1
+
 
* Mar 17, 2013: [[Media:TechTalkChandanSparseMKL.pdf‎|Using Sparse Matrix and Solver Routines from Intel MKL by Deepak Chandan (TechTalk slides)]]
+
* Dec 2014: [[Hdf5]] compilation page updated.
* Mar 14, 2013: Slides+recording [[Scientific Computing Course#Topics|Scientific Computing Course]] lecture II.8
+
 
* Mar 13, 2013: Updated [[Media:Introscinet.pdf|Intro to SciNet]] slides
+
* Dec 2014: [[Research Computing with Python 2014]] lectures 5-8
* Mar 12, 2013: Slides+recording [[Scientific Computing Course#Topics|Scientific Computing Course]] lecture II.7
+
 
* Mar 7, 2013: Slides+recording [[Scientific Computing Course#Topics|Scientific Computing Course]] lecture II.6
+
* Nov 2014: "Modern CUDA Features" TechTalk slides in [[SciNet TechTalks and Seminars]].
* Mar 5, 2013: Slides [[Scientific Computing Course#Topics|Scientific Computing Course]] lecture II.5
+
 
* Mar 1, 2013: Slides+recordings of the [[Half Day Parallel I/O Course - February 2013 | Half Day Parallel I/O Course]]
+
* Nov 2014: [[Research Computing with Python 2014]] lectures 1-4
 +
 
 +
* Sept 2014: [[User_Tips#Reducing_virtual_memory_consumption_for_multithreaded_programs| Tip on reducing virtual memory consumption for multithreaded programs]]
 +
 
 +
* Sept 2014: Improved information on the [[Python]] versions installed on the GPC, and which modules are included in each version.
 +
 
 +
* Sept 2014: Description on using job arrays on the GPC on the [[Scheduler]] page.
 +
 
 +
* Sept 2014: [[Intro to Tkinter|Tkinter instructions]], [[Media:Tkinter.pdf|slides]] and [[Media:Tkinter_code.tgz|code]] for the TkInter workshop held in September.
 +
 
 +
* Sept 2014: Instructions on using [[Hadoop for HPCers|Hadoop]] (for the Hadoop workshop held in September).
 +
 
 
</div>
 
</div>
 
Previous new stuff can be found in the [[What's new archive]].
 
Previous new stuff can be found in the [[What's new archive]].
|-
 
| valign="top" style="padding:1em; border:1px solid #aaaaaa; background-color:#e8e8f6; border-radius:7px" |
 
{{SciNetWiki:Community_Portal}}
 
 
| valign="top" style="padding:1em; border:1px solid #aaaaaa; background-color:#f4f4fa; border-radius:7px" |
 
| valign="top" style="padding:1em; border:1px solid #aaaaaa; background-color:#f4f4fa; border-radius:7px" |
 
<div style='text-align:left;'>
 
<div style='text-align:left;'>
{{SciNetWiki:Current_events}}</div>
+
{{SciNetWiki:Community_Portal}}
 +
</div>
 
|}
 
|}
  

Latest revision as of 14:59, 15 May 2018

WARNING: SciNet is in the process of replacing this wiki with a new documentation site. For current information, please go to https://docs.scinet.utoronto.ca


System Status

System status can now be found at docs.scinet.utoronto.ca


Mon 23 Apr 2018 GPC-compute is decommissioned, GPC-storage available until 30 May 2018

Thu 18 Apr 2018 Niagara system will undergo an upgrade to its Infiniband network between 9am and 12pm, should be transparent to users, however there is a chance of network interruption.

Fri 13 Apr 2018 HPSS system will be down for a few hours on Mon, Apr/16, 9AM, for hardware upgrades, in preparation for the eventual move to the Niagara side.

Tue 10 Apr 2018 Niagara is open to users.

Wed 4 Apr 2018 We are very close to the production launch of Niagara, the new system installed at SciNet. While the RAC allocation year officially starts today, April 4/18, the Niagara system is still undergoing some final tuning and software updates, so the plan is to officially open it to users on next week.

All active GPC users will have their accounts, $HOME, and $PROJECT, transferred to the new Niagara system. Those of you who are new to SciNet, but got RAC allocations on Niagara, will have your accounts created and ready for you to login.

We are planning an extended Intro to SciNet/Niagara session, available in person at our office, and webcast on Vidyo and possibly other means, on Wednesday April 11 at noon EST.


System News

  • April 23, 2018: GPC & Sandy decommissioned.
  • April 10, 2018: Niagara commissioned.
  • March 20th, 2018: Gravity decommissioned.
  • Dec 4, 2017 : scratchtcs decommissioned.
  • Nov 28, 2017: The GPC has been reduced from 30,912 to 16,800 cores to make room for the installation of Niagara.
  • Sept 29, 2017: The TCS has been decommissioned.

(Previous System News)

QuickStart Guides

Tutorials and Manuals

What's New On The Wiki

  • Dec 2014: Updated GPC Quickstart with info on email notifications from the scheduler.
  • Dec 2014: Hdf5 compilation page updated.
  • Sept 2014: Improved information on the Python versions installed on the GPC, and which modules are included in each version.
  • Sept 2014: Description on using job arrays on the GPC on the Scheduler page.
  • Sept 2014: Instructions on using Hadoop (for the Hadoop workshop held in September).

Previous new stuff can be found in the What's new archive.