P8

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search
P8
P8 s822.jpg
Installed June 2016
Operating System Linux (RHEL 7.2) le
Number of Nodes 2x 8core Power8 with 2x NVIDIA K80
Interconnect Infiniband ( EDR )
Ram/Node 512 Gb
Cores/Node 16 (128 Threads)
Login/Devel Node p8t01,p8t02 (from login.scinet)
Vendor Compilers xlc/xlf

Specifications

The P8 Test System consists of two IBM Power 822LC Servers each with 2x8core 3.25GHz Power8 CPUs and 512GB Ram. Similar to Power 7, the Power 8 utilizes Simultaneous Multi Threading (SMT), but extends the design to 8 threads per core allowing the 16 physical cores to support up to 128 threads. Each node has two NVIDIA Tesla K80 GPUs with CUDA Capability 3.7 (Kepler), consisting of 2xGK210 GPUs each with 12 GB of RAM, so each node has effectively 4 GPU's.

Compile/Devel/Test

First login via ssh with your scinet account at login.scinet.utoronto.ca, and from there you can proceed to p8t01 and p8t02.


Software

GNU Compilers

gcc/g++/gfortran version 4.8.5 is the default with RHEL 7.2 and is available by default.

IBM Compilers

To use the IBM Power specific compilers xlc/xlc++/xlf you need to load the following modules

NOT INSTALLED YET

NVIDIA toolkit

Driver Version

The current NVIDIA driver version for gravity is 352.93

CUDA

The current installed CUDA Tookit is 7.5.

module load cuda/7.5


The CUDA driver is installed locally, however the CUDA Toolkit is installed in:

/usr/local/cuda-7.5/


OpenMPI

Currently OpenMPI has been setup on the two nodes connected over FDR Infiniband.

$ module openmpi/1.10.3-gcc-4.8.5