P8
| P8 | |
|---|---|
| Installed | June 2016 |
| Operating System | Linux (RHEL 7.2) le |
| Number of Nodes | 2x 8core Power8 with 2x NVIDIA K80 |
| Interconnect | Infiniband ( EDR ) |
| Ram/Node | 512 Gb |
| Cores/Node | 16 (128 Threads) |
| Login/Devel Node | p8t01,p8t02 (from login.scinet) |
| Vendor Compilers | xlc/xlf |
Specifications
The P8 Test System consists of two IBM Power 822LC Servers each with 2x8core 3.25GHz Power8 CPUs and 512GB Ram. Similar to Power 7, the Power 8 utilizes Simultaneous Multi Threading (SMT), but extends the design to 8 threads per core allowing the 16 physical cores to support up to 128 threads. Each node has two NVIDIA Tesla K80 GPUs with CUDA Capability 3.7 (Kepler), consisting of 2xGK210 GPUs each with 12 GB of RAM, so each node has effectively 4 GPU's.
Compile/Devel/Test
First login via ssh with your scinet account at login.scinet.utoronto.ca, and from there you can proceed to p8t01 and p8t02.
Software
GNU Compilers
gcc/g++/gfortran version 4.8.5 is the default with RHEL 7.2 and is available by default.
IBM Compilers
To use the IBM Power specific compilers xlc/xlc++/xlf you need to load the following modules
NOT INSTALLED YET
NVIDIA toolkit
Driver Version
The current NVIDIA driver version for gravity is 352.93
CUDA
The current installed CUDA Tookit is 7.5.
module load cuda/7.5
The CUDA driver is installed locally, however the CUDA Toolkit is installed in:
/usr/local/cuda-7.5/
OpenMPI
Currently OpenMPI has been setup on the two nodes connected over FDR Infiniband.
$ module openmpi/1.10.3-gcc-4.8.5