Configure Cloud Resources

Resource Requirements

Creating an OBS Bucket

ModelArts requires you to create an OBS bucket for storing the model weight files, training data, training scripts, and training artifacts. For details, see How Do I Create an OBS Bucket for ModelArts to Store Data?

The following shows the folders in the OBS bucket. The planned directories must be the same as the file paths involved in the training script. After a training job is created and the OBS bucket is added to the code directory, all files in the folder will be copied to the training container. If the file size is too large, the copy speed will decrease. You are advised to only retain related files in the directory to avoid storing irrelevant content.

|——{OBS bucket}                                  # Custom bucket name, for example, verl
   |──{verl-a2}                             # Custom OBS folder name, for example, verl-a2
       |──{models}                          # Custom OBS folder for storing various models, for example, models
           |──{Qwen3-8b}                    # Custom OBS folder for storing models, for example, Qwen3-8
           |──{Qwen2.5-VL-32b-Instruct}     # Custom OBS folder for storing models, for example, Qwen2.5-VL-32b-Instruct
           |──{Qwen3-30B-A3B}               # Custom OBS folder for storing models, for example, Qwen3-30B-A3B
       |──run_train_8b.sh                   # Startup script of the Qwen3-8B training job
       |──run_qwen3-8b_npu_ma.sh            # Execution script of the Qwen3-8B training job
       |──run_train_32b.sh                  # Startup script of the Qwen2.5-VL-32b-Instruct training job
       |──run_qwen2_5_vl_32b_npu_ma.sh      # Execution script of the Qwen2.5-VL-32b-Instruct training job
       |──run_train_30b.sh                  # Startup script of the Qwen3-30B-A3B training job
       |──run_qwen3_30b_a3b_npu_ma.sh       # Execution script of the Qwen3-30B-A3B training job
       |──{dataset}/                        # Custom OBS folder for storing various datasets, for example, dataset.
            |──{gsm8k}/                     # OBS folder for storing the training dataset GSM8K
            |──{geometry3k}/                # OBS folder for storing the training dataset Geometry3K
       |──gsm8k.py                          # Data preprocessing script
       |──geometry3k.py                     # Data preprocessing script
       |──{ckpts}                           # Custom OBS folder for storing the training output, for example, ckpts

You can use tools such as OBS Browser+ and obsutil to access and manage OBS buckets and upload and download files and data.