Help Center/ ModelArts/ Image Management/ Using a Custom Image to Train Models (Model Training)/ Preparing a Training Image/ Migrating an Image to ModelArts Training
Updated on 2024-08-14 GMT+08:00
View PDF
Share

Migrating an Image to ModelArts Training

To migrate an image to the model training, perform the following operations:
  1. Add the default user group ma-group (gid = 100) of the model training for the image.

    If the user group whose gid is 100 already exists, the error message "groupadd: GID '100' already exists" may be displayed. You can use the cat /etc/group | grep 100 command to check whether the user group whose GID is 100 exists.

    If the user group whose gid is 100 already exists, skip this step and delete the command RUN groupadd ma-group -g 100 from the Dockerfile.

  2. Add the default user ma-user (uid = 1000) of the model training for the image.

    If the user whose uid is 1000 already exists, the error message "useradd: UID 1000 is not unique" may be displayed. You can use the cat /etc/passwd | grep 1000 command to check whether the user whose UID is 1000 exists.

    If the user whose uid is 1000 already exists, skip this step and delete the command RUN useradd -d /home/ma-user -m -u 1000 -g 100 -s /bin/bash ma-user from the Dockerfile.

  3. Modify the permissions on files in the image to allow ma-user whose uid is 1000 to read and write the files.

You can modify an image by referring to the following Dockerfile so that the image complies with specifications for custom images of the model training.

FROM {An existing image}

USER root

# If the user group whose GID is 100 already exists, delete the groupadd command.
RUN groupadd ma-group -g 100
# If the user whose UID is 1000 already exists, delete the useradd command.
RUN useradd -m -d /home/ma-user -s /bin/bash -g 100 -u 1000 ma-user

# Modify the permissions on image files so that user ma-user whose UID is 1000 can read and write the files.
RUN chown -R ma-user:100 {Path to the Python software package}

# Configure the preset environment variables of the container image.
# Set PYTHONUNBUFFERED to 1 to prevent log loss.
ENV PYTHONUNBUFFERED=1

# Configure the default user and working directory of the container image.
USER ma-user
WORKDIR /home/ma-user

After editing the Dockerfile, run the following command to build a new image:

docker build -f Dockerfile . -t {New image}

Upload the new image to SWR. For details, see How Can I Log In to SWR and Upload Images to It?