Updated on 2023-11-21 GMT+08:00

Querying DLI Spark Run Logs

Run ma-cli dli-job get-log to query backend logs of DLI Spark jobs.

$ ma-cli dli-job get-log -h
Usage: ma-cli dli-job get-log [OPTIONS]

  Get DLI spark job log details.

  Example:

  # Get job log by job id
  ma-cli dli-job get-log --job-id ${job_id}

Options:
  -i, --job-id TEXT       Get DLI spark job details by job id.  [required]
  -C, --config-file TEXT  Configure file path for authorization.
  -D, --debug             Debug Mode. Shows full stack trace when error occurs.
  -P, --profile TEXT      CLI connection profile to use. The default profile is "DEFAULT".
  -H, -h, --help          Show this message and exit.
Table 1 Parameters

Parameter

Type

Mandatory

Description

-i / --job-id

String

Yes

ID of a DLI Spark job used to obtain job logs

Example

Run the following command to obtain run logs of a DLI Spark job using its job ID:

ma-cli dli-job get-log --job-id ${your_job_id}