(Optional) Configuring Image Pre-provisioning
Image pre-provisioning is the process of loading required images on compute nodes in advance. This can improve image loading efficiency and reduce the training job startup time.
Lite Cluster resource pools enable image pre-provisioning, which pulls images from nodes in the pools beforehand, accelerating image pulling during inference and large-scale distributed training.
This section describes how to configure image pre-provisioning on Lite Cluster.
Prerequisites
- You have purchased and enabled Lite Cluster resources. For details, see Enabling Lite Cluster Resources.
- To obtain the image source for image pre-provisioning, you need to grant SWR operation permissions to ModelArts, so that ModelArts can use the dependent services and perform resource operations on your behalf. For details, see Configuring Agency Authorization for ModelArts with One Click.
- If a custom image is used for image pre-provisioning, upload the created custom image to SWR. For details, see Pushing an Image
Configuring Image Pre-provisioning for Lite Cluster
- Log in to the ModelArts console. In the navigation pane on the left, choose Lite Cluster under Resource Management.
- Click the name of a resource pool to access its details page.
- Click Configuration Management on the left.
Figure 1 Configuration Management
- In Pre-provision Image, click
and configure parameters.
Table 1 Parameters Parameter
Description
Image Source
Select Preset or Custom.
- Preset: Select an image on SWR or a shared image.
- Custom: Enter an image path.
You need to upload the created custom image to SWR in advance. For details, see Pushing an Image.
Image Key
To pre-provision an image that you do not have permissions on, you will need to add an image key. Once enabled, select the namespace and key. For details about how to create a key, see Creating a Secret. The key type must be kubernetes.io/dockerconfigjson.
To create a key, refer to the tenant's SWR login command for the repository address, username, and password. Figure 5 shows a temporary login command. To obtain a long-term valid login command, click Learn how to obtain a long-term login command.
To add multiple keys, click the plus sign (+).
Add
To add multiple images, click this button.
Figure 2 Pre-provisioning a preset imageFigure 3 Selecting a preset imageFigure 4 Pre-provisioning a custom image - Click OK. Then, you can see the information about the image that is pre-provisioned.
If pre-provisioning an image failed, check whether the image path and key are correct.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot