Gain insights into using HPC systems and supercomputers to solve large computational problems. Explore HPC components, software stacks, job schedulers, and parallel programming, including Open MP, MPI, and GPU coding.

Learn to use High Performance Computing (HPC) Systems  and solve large computational problems.  This course assumes basic familiarity with the Bash command line environment found on GNU/Linux and other Unix-like environments. This course is of the first of its kind, should be your second step from my previous Educative course "Learn to Analyze Text Data in Bash Shell and Linux"

You'll learn:
- Intro to HPC Systems and Supercomputers
- HPC system's basic components
- HPC software stack
- HPC job schedulers and batch systems (PBS and Slurm with demos)
- Introduction to parallel programming (Open MP, MPI and GPU coding)

Video demos are included, I think it is a must have course for students, researchers, big data analysts, and developers. It will help you to utilize High Performance Computing systems at your institution. Non-interactive course. More details at:  www.scientificprogramming.io/learn-hpc

Ajay Shenoy

This course demystifies HPC and introduces you to the essential tools required to schedule and run parallel programs. Easy to understand.

India

Learn to Use HPC Systems and Supercomputers

Slurm has several commands to interact with its daemons:



+ `sacct` is used to report job or job step accounting information about active or completed jobs.

+ `salloc` is used to allocate resources for a job in real time.

+ `sattach` is used to attach standard input, output, and error plus signal capabilities to a currently running job or job step.

+ `sbatch` is used to submit a job script for later execution. The script will typically contain one or more `srun` commands to launch parallel tasks.

+ `sbcast` is used to transfer a file from local disk to local disk on the nodes allocated to a job. 

+ `scancel` is used to cancel a pending or running job or job step. It can also be used to send an arbitrary signal to all processes associated with a running job or job step.

+ `scontrol` is the administrative tool used to view and/or modify Slurm state. Many scontrol commands can only be executed as user root.

+ `sinfo` reports the state of partitions and nodes managed by Slurm. It has a wide variety of filtering, sorting, and formatting options.

+ `smap` reports state information for jobs, partitions, and nodes managed by Slurm, but graphically displays the information to reflect network topology.

+ `squeue` reports the state of jobs or job steps. It has a wide variety of filtering, sorting, and formatting options. By default, it reports the running jobs in priority order and then the pending jobs in priority order.

+ `srun` is used to submit a job for execution or initiate job steps in real time.

+ `strigger` is used to set, get or view event triggers. Event triggers include things such as nodes going down or jobs approaching their time limit.

+ `sview` is a graphical user interface to get and update state information for jobs, partitions, and nodes managed by Slurm.

Some of the above commands are discussed with examples.



Supercomputers and HPC clusters

Components of a HPC system

HPC software stack

PBS - Portable Batch System

SLURM -Workload Manager

Parallel programming - OpenMP

Parallel programming - MPI

Parallel programming - GPU and CUDA

Conclusions and references

Slurm commands