Updated on 2024-11-29 GMT+08:00

How Do I View MRS Job Logs?

  1. On the Jobs page of the MRS console, you can view logs of each job, including launcherJob and realJob logs.

    • Generally, error logs are printed in stderr and stdout for launcherJob jobs, as shown in the following figure:

    • You can view realJob logs on the ResourceManager web UI provided by the Yarn service on MRS Manager.

  2. Log in to the Master node of the cluster to obtain the job log files in 1. The HDFS path is /tmp/logs/{submit_user}/logs/{application_id}.
  3. After the job is submitted, if the job application ID cannot be found on the Yarn web UI, the job fails to be submitted. You can log in to the active Master node of the cluster and view the job submission process log /var/log/executor/logs/exe.log.