Create a cluster in the cloud

Contents:

• Set up the cloud infrastructure
  • Getting ready
  • Setting the config
• Finalising the setup
  • Final configuration step
  • Check Slurm is running
• Running the cluster
  • Slurm jobs
  • Slurm elastic scaling
  • Cluster shell
  • Installing software on your cluster
  • Performance metrics
  • Destroying the whole cluster

Welcome to the documentation for cluster in the cloud. By the end of this you will have a fully-operational, elastically-scaling Slurm cluster running on cloud resources.

In the future, the intention is that this tutorial will cover installing on all major cloud providers but for now only Oracle Public Cloud is covered.

This tutorial was created by Matt Williams at the ACRC in Bristol. Contributions to this document are welcome at GitHub.

Prerequisites

To complete this tutorial you will need:

• access to a command-line (i.e. Linux, MacOS Terminal or WSL)
• an SSH key pair
• an account with credit on Oracle cloud
  • the account must have admin permissions to create infrastructure
• local software installed
  • Terraform 0.11
  • SSH

Start by creating the infrastructure.