What is K8s?

This is a very high level overview of the aspects of Kubernetes (a.k.a. K8s) which are particularly salient to the running Inspect evals.

Kubernetes is a container orchestration platform. Containers are typically Docker containers.

A Kubernetes cluster consists a set of many nodes which run containerised applications. A node is a VM or physical machine. A Pod houses one or more containers on a node. There can be many Pods on a node.

A namespace is a way to segregate resources in a cluster.

Helm is a package manager for Kubernetes. It is used to install charts which are bundles of Kubernetes resources. Helm creates releases which are instances of charts. We typically install one Helm release per eval sample (one for every epoch too).