Help Center/ ModelArts/ DevEnviron/ ModelArts CLI Command Reference/ Using the ma-cli dli-job Command to Submit a DLI Spark Job/ Uploading Local Files or OBS Files to a DLI Group
Updated on 2023-11-21 GMT+08:00
View PDF
Share

Uploading Local Files or OBS Files to a DLI Group

Run the ma-cli dli-job upload command to upload local files or OBS files to a DLI group.

$ ma-cli dli-job upload -h
Usage: ma-cli dli-job upload [OPTIONS] PATHS...

  Upload DLI resource.

  Tips: --obs-path is need when upload local file.

  Example:

  # Upload an OBS path to DLI resource
  ma-cli dli-job upload obs://your-bucket/test.py -g test-group --kind pyFile

  # Upload a local path to DLI resource
  ma-cli dli-job upload ./test.py -g test-group -obs ${your-bucket} --kind pyFile

  # Upload local path and OBS path to DLI resource
  ma-cli dli-job upload ./test.py obs://your-bucket/test.py -g test-group -obs ${your-bucket}

Options:
  -k, --kind [jar|pyFile|file]  DLI resources type.
  -g, --group TEXT              DLI resources group.
  -tags, --tags TEXT            DLI resources tags, follow --tags `key1`=`value1`.
  -obs, --obs-bucket TEXT       OBS bucket for upload local file.
  -async, --is-async            whether to upload resource packages in asynchronous mode. The default value is False.
  -C, --config-file TEXT        Configure file path for authorization.
  -D, --debug                   Debug Mode. Shows full stack trace when error occurs.
  -P, --profile TEXT            CLI connection profile to use. The default profile is "DEFAULT".
  -H, -h, --help                Show this message and exit.
Table 1 Parameters

Parameter

Type

Mandatory

Description

PATHS

String

Yes

Paths to the local files or OBS files to be uploaded to a DLI group. Multiple paths can be specified at a time.

-k / --kind

String

No

Type of the file to be uploaded, which can be JAR, PyFile, or file

-g / --group

String

No

Name of the DLI group to which the file is to be uploaded

-tags / --tags

String

No

Tag of the file to be uploaded

-obs / --obs-bucket

String

No

If the file to be uploaded contains a local path, specify an OBS bucket for transit.

-async / --is-async

Bool

No

Asynchronously upload files. This method is recommended.

Examples

  • Upload local files to a DLI group. 
    ma-cli dli-job upload ./test.py -obs ${your-bucket} --kind pyFile

  • Upload OBS files to a DLI group. 
    ma-cli dli-job upload obs://your-bucket/test.py --kind pyFile