0% completed

All LessonsFree Lessons (5)

Supercomputers and HPC clusters

A Little bit of Supercomputing history Supercomputing examples HPC cluster computers Benefits of using cluster computing

Components of a HPC system

Components of a HPC cluster Login node(s)Compute node(s)Master node(s)Storage node(s)

HPC software stack

HPC software list

HPC software modules

PBS - Portable Batch System

Introduction to PBS PBS basic commands PBS `qsub`PBS `qstat`PBS `qdel` command PBS `qalter`PBS job states PBS variables A simple PBS job script PBS interactive jobs PBS arrays PBS Matlab example

SLURM -Workload Manager

Introduction to Slurm Slurm commands A simple Slurm job Slurm distrbuted MPI and GPU jobs Slurm multi-threaded OpenMP jobs Slurm interactive jobs Slurm array jobs Slurm job dependencies

Parallel programming - OpenMP

OpenMP OpenMP basics Open MP - clauses OpenMP - worksharing constructs OpenMP- Hello world!Open MP - reduction and parallel `for-loop`OpenMP - section parallelization OpenMP vector addition

Parallel programming - MPI

MPI - Message Passing Interface MPI program stucture MPI - hello world!MPI send/ receive MPI `ping-pong` send and receive example

Parallel programming - GPU and CUDA

GPUs - graphics processing units GPU Programming - CUDA CUDA - hello world!CUDA - vector additon demo

Conclusions and references

Conclusion References

Learn to Use HPC Systems and Supercomputers/

...

/

Data Transfer

Data Transfer

We'll cover the following...

On HPC systems, we can interact with the command line over SSH. We can also create and move file and directories. We can run a program and get some output. But the question is how can we

Upload files, say our datasets, to the HPC machine?
Download files, say the results of our analysis, from the HPC machine for further analysis locally?

There are two popular ...