garrettmills
/
k8s-hpc-demo
1
0
Fork 0
Code Issues Pull-Requests Releases Wiki Aktivität
Du kannst nicht mehr als 25 Themen auswählen Themen müssen entweder mit einem Buchstaben oder einer Ziffer beginnen. Sie können Bindestriche („-“) enthalten und bis zu 35 Zeichen lang sein.
26 Commits
1 Branch
0 Tags
57 KiB
 
 
Branches Tags
${ item.name }
Tag ${ searchTerm } erstellen
Erstelle Branch ${ searchTerm }
von „master“
${ noResults }
Datei suchen
Garrett Mills 2bca8fa37c
Update 'README.md' 		vor 3 Jahren
container add pandas container demo vor 5 Jahren
definitions big bang vor 5 Jahren
demos update sample means demo vor 5 Jahren
README.md Update 'README.md' vor 3 Jahren
cluster_exec.sh add README and rename files vor 5 Jahren
setup.sh big bang vor 5 Jahren
start_cluster.sh big bang vor 5 Jahren
stop_cluster.sh big bang vor 5 Jahren

README.md

Computing in the Kubernetes Framework

This repository contains some resources for getting started with OpenMPI and high-performance computing on Kubernetes. This accompanies a presentation given by Garrett Mills at the KU CRMDA on Docker, Kubernetes, and high-performance computing.

Get up and running.

If you want to follow along or try OpenMPI on Kubernetes out for yourself, you can get started by creating a virtual cluster on your machine with Minikube. Here's how to get set up:

  1. Install VirtualBox. Our test Kubernetes cluster will run on a collection of VMs, so we'll install VirtualBox to make that possible. Here's the download.
  2. Install kubectl. This is the Kubernetes CLI tool. It's how you interface with Kubernetes. Grab it here.
  3. Install Minikube. Minikube is a software tool that creates a Kubernetes cluster with VMs on your local machine. This is an excellent tool for testing deployments. Get it here.
  4. Install Helm. Helm is a Kubernetes package manager used by the cluster framework. Here's the link.
  5. Clone this repository to your computer using Git: git clone https://code.garrettmills.dev/garrettmills/k8s-hpc-demo

That's it! You're ready to start using the Kubernetes cluster on your computer.

Basic use.

From within the cloned repository's folder, run the ./setup.sh command. This will clone the kube-openmpi repository and generate the SSH key used by OpenMPI.

Now, we can start the cluster by running the ./start_cluster.sh script. This will create the Kubernetes resources and start the cluster. If you have the watch command line tool installed, it will open up the cluster status page so you can see when it's done initializing.

At this point, we have a fully-functional OpenMPI cluster. By default, the definitions provided in this repo will create 5 worker nodes. You can run commands on the cluster using the ./cluster_exec.sh script. For example:

$ ./cluster_exec.sh mpiexec --allow-run-as-root --hostfile /kube-openmpi/generated/hostfile -n 5 echo "Hello, world!"
Hello, world!
Hello, world!
Hello, world!
Hello, world!
Hello, world!

When you're finished with the cluster, stop it using the ./stop_cluster.sh command.