Updated on 2024-12-13 GMT+08:00

Accessing the Spark Web UI

Scenario

Once the Spark component is installed in the MRS cluster, you can easily monitor the status of Spark applications on the Spark web UI.

This section describes how to access the Spark web UI in an MRS cluster.

Prerequisites

  • The Spark component has been installed in an MRS cluster and is running properly.
  • A user with the Spark management permission has been created. The hadoop, hive, and supergroup user groups have been added, and the hadoop user group has been added as the primary group.

Procedure

  1. Log in to Manager as a user with the Spark management permissions and choose Cluster > Services > Spark.
  2. On the Spark overview page, click JobHistory(xxx) next to the Spark web UI.

    Figure 1 Spark Web UI

  3. Check the status of all Spark applications on the displayed Spark web UI.

    The Spark web UI displays information such as the application ID, application name, start time, execution time, and user to whom the application belongs.