Updated on 2022-12-09 GMT+08:00

Viewing Historical Job Information

Scenario

Query the execution status and execution duration of a Loader job during routine maintenance. You can perform the following operations on the job:

  • Dirty Data: Query data that fails to be processed or data that is filtered out during job execution, and check which source data does not meet transformation or cleaning rules.
  • Logs: Query log information about job execution in MapReduce.

This section applies to MRS 3.x or later.

Prerequisites

You have obtained the username and password for logging in to the Loader WebUI.

Procedure

  1. Access the Loader web UI.

    1. Log in to FusionInsight Manager. For details, see Accessing FusionInsight Manager (MRS 3.x or Later).
    2. Choose Cluster > Name of the desired cluster > Services > Loader.
    3. Click LoaderServer(Node name, Active). The Loader web UI is displayed.
      Figure 1 Loader web UI

  2. Query historical records of a Loader job.

    1. Locate the row that contains the job to be viewed.
    2. Click More and select View History to view the job execution history.
      Figure 2 Viewing historical records
      Table 1 Parameters

      Name

      Description

      Rows/Files Read

      Indicates the number of rows (files) read from the input source.

      Rows/Files Written

      Number of rows (files) written to the output source.

      Rows/Files Skipped

      • Indicates the number of bad rows (files) recorded during transformation. The input format is incorrect, so transformation cannot be performed.
      • Number of rows that are skipped after filtering conditions are configured during conversion.