Help Center/ ModelArts/ Drawer/ Creating an Algorithm/ Code Directory
Updated on 2025-05-29 GMT+08:00
Share

Code Directory

Description

OBS path for storing the algorithm code. The files required for training, such as the training code, dependence installation packages, and pre-generated models, are uploaded to the code directory.

The code directory cannot contain irrelevant files or directories. Otherwise, uploading data may fail.

Do not store training data in the code directory. When the training job starts, the data stored in the code directory will be downloaded to the backend. A large amount of training data may lead to a download failure.

After you create the training job, ModelArts downloads the code directory and its subdirectories to the training container.

Take OBS path obs://obs-bucket/training-test/demo-code as an example. The content in the OBS path will be automatically downloaded to ${MA_JOB_DIR}/demo-code in the training container, and demo-code (customizable) is the last-level directory of the OBS path.

  • Any programming language is supported.
  • The number of files (including files and folders) cannot exceed 1,000.
  • The total file size cannot exceed 5 GB.

FAQs

How Do I Reference a Python Dependency Package in the Training Code?

Create a file named pip-requirements.txt in the code directory, and specify the dependency package name and version in the file.

The code directory structure is as follows:

|---Code directory
     |---model.py               #Boot file
     |---pip-requirements.txt   # Customized configuration file, which specifies the name and version of the dependency package

The following shows the content of the pip-requirements.txt file:

alembic==0.8.6 
bleach==1.4.3 
click==6.6

If your dependency package is not an open-source installation package, the system cannot automatically download and install the package. In this case, place the WHL package in the code directory. For details, see FAQs.

How Do I Install a Library That C++ Depends on?

A third-party library may be used during training. Take C++ as an example. You must upload the local source code to the notebook development environment and generate the required dependency file in the environment. During training, the dependency file is read to complete the training job. For details, see How Do I Install a Library That C++ Depends on?

Parent Topic: Creating an Algorithm