SciNet Command Line Utilities
Below is list of handy command-line utilities written by SciNet to help manage your data and compute. Currently, on the GPC you need to have the extras module loaded for these to work. Note that in the table, optional arguments are denoted with square brackets (i.e. '[]'), while mandatory arguments are denoted with angular brackets (i.e. '<>').
Storage
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| quota | Short overview of a user's storage usage. | GPC | |
| diskUsage | -h to see all command options | Informs about the user and group file system usage. | GPC |
| topUserDirOver1000list | Lists your directories that have over 1,000 files | GPC | |
| topUserDirOver1GBlist | Lists your directories that have over 1 GB of data | GPC |
Jobs & Queues
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| qsum | most showq arguments work | Lists jobs running or in the queue, grouped by user. | GPC,TCS |
| llq1 | Detailed information on jobs that are actively running. | TCS | |
| scinet gpc priority | Compute usage in the last 14 days, and how this affects your priority in the queue. | GPC | |
| nodeperf | [userName] | Who is doing what on the current node? | GPC |
| jobperf | <jobId | jobName> | Informs about the performance of all nodes of a given job. | GPC |
| jobError | <jobId | jobName> | Displays realtime error output of a given job. | GPC |
| jobOutput | <jobId | jobName> | Displays realtime standard output of a given job. | GPC |
| jobcd | <jobId | jobName> | Allows users to quickly move into the working directory of a given job. | GPC |
| jobscript | <jobId | jobName> | Displays the submission script used when submitting a given job. | GPC |
| jobssh | <jobId | jobName> | Allows users to connect to the head-node of a given job. | GPC |
| jobtop | <jobId | jobName> | Allows users to "top" on the head-node of a given job. | GPC |
| jobdep | <jobId> | Displays dependencies of given job. | GPC |
| jobtree | [userName] | Displays the jobs tree of dependencies for a given user. | GPC |
| debugjob | [nodes] | Requests a time-limited interactive session of up to 8 dedicated nodes | GPC |
Modules
| Command | Arguments | Description | Cluster |
|---|---|---|---|
| modulefind | [searchWord] | Finds modules containing searchWord and indicate their compatibility with already loaded modules. | GPC |
| moduleadvice | <modulename> | Show the module commands required to load modulename, taking into account prerequisites and conflicts with already loaded modules. | GPC |
| modulewrap | <comma-separated-modules> <command> | Load the modules in the comma-separated-modules list (no spaces!) only to run the given command. | GPC |
Related Topics
Checking the memory usage from jobs
GPC Quickstart
Scheduler
Monitoring Jobs
Tech Talk on Monitoring Jobs