Help Center > > User Guide> MRS Cluster Component Operation Guide> Using Spark> Accessing the Spark Web UI

Accessing the Spark Web UI

Updated at:Sep 08, 2020 GMT+08:00

You can view the running status of Spark applications on the Spark web UI.

Spark has two web UIs.

  • Spark UI: used to display the status of running applications.

    The UI includes the following parts: Jobs, Stages, Storage, Environment, Executors, SQL, and JDBC/ODBC Server. The Streaming application has one more Streaming tab.

  • History Server UI: used to display the running status of Spark applications that are complete or incomplete.

    History Server UI includes the application ID, application name, start time, end time, execution time, and owner information.

Spark UI

  1. Go to the cluster details page and choose Components.

    • If the Components tab is not displayed on the cluster details page, complete IAM user synchronization first. (On the Dashboard tab page of the cluster details page, click Click to synchronize on the right side of IAM User Sync to synchronize IAM users.)
    • For MRS 1.8.10 or earlier, log in to MRS Manager. For details, see Accessing MRS Manager. Then, choose Services.

  2. Select Yarn. In the Yarn Summary area, click ResourceManager (Active) in ResourceManager Web UI to access the web UI.

    Figure 1 ResourceManager Web UI

  3. Locate the Spark application. Click ApplicationMaster in the last column of the application information. The Spark UI is displayed.

    Figure 2 ApplicationMaster
    Figure 3 Spark UI

History Server

  1. Go to the cluster details page and choose Components.

    • If the Components tab is not displayed on the cluster details page, complete IAM user synchronization first. (On the Dashboard tab page of the cluster details page, click Click to synchronize on the right side of IAM User Sync to synchronize IAM users.)
    • For MRS 1.8.10 or earlier, log in to MRS Manager. For details, see Accessing MRS Manager. Then, choose Services.

  2. Select Spark. In the Spark Summary area, click JobHistory next to Spark Web UI to access the web UI.

    Figure 4 ResourceManager Web UI
    Figure 5 Spark History Server

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?







Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel