Introduction

Volcano is a batch processing platform based on Kubernetes. It provides a series of features required by machine learning, deep learning, bioinformatics, genomics, and other big data applications, as a powerful supplement to Kubernetes capabilities.

Volcano is derived from the Huawei Cloud high-performance batch computing solution. It plays an important role in the stable running of Huawei Cloud services such as ModelArts and CCI. Volcano provides general-purpose, high-performance computing capabilities, such as job scheduling engine, heterogeneous chip management, and job running management, serving end users through computing frameworks for different industries, such as AI, big data, gene sequencing, and rendering. (Volcano has been open-sourced in GitHub.)

Volcano provides job scheduling, job management, and queue management for computing applications. Its main features are as follows:

• Diverse computing frameworks, such as TensorFlow, MPI, and Spark, can run on Kubernetes in containers. Common APIs for batch computing jobs through CRD, various plug-ins, and advanced job lifecycle management are provided.
• Advanced scheduling capabilities are provided for batch computing and high-performance computing scenarios, including group scheduling, preemptive priority scheduling, packing, resource reservation, and task topology.
• Queues can be effectively managed for scheduling jobs. Complex job scheduling capabilities such as queue priority and multi-level queues are supported.

Open source community: https://github.com/volcano-sh/volcano

Installing the Add-on

1. Log in to the CCE console and access the cluster details page. Choose Add-ons in the navigation pane, locate volcano on the right, and click Install.
2. Configure parameters.

   {
   	"resource_exporter_enable": "false"
   }

   resource_exporter_enable: indicates whether to enable the function of collecting node NUMA information. If this parameter is set to true, the function is enabled. The default value is false.

3. Click Install.

Volcano 1.0.0 Version Upgrade

Volcano 1.0.0 is incompatible with later versions and cannot be upgraded on the console. If you want to use the volcano add-on of a later version, uninstall volcano 1.0.0 and then install volcano of a later version on the console.

To uninstall volcano, run the following commands:

kubectl delete crd jobs.batch.volcano.sh

kubectl delete crd commands.bus.volcano.sh