Viewing Historical Job Information
Scenario
Query the execution status and execution duration of a Loader job during routine maintenance. You can perform the following operations on the job:
- Dirty Data: Query data that fails to be processed or data that is filtered out during job execution, and check which source data does not meet transformation or cleaning rules.
- Logs: Query log information about job execution in MapReduce.
This section applies to MRS 3.x or later.
Prerequisites
You have obtained the username and password for logging in to the Loader WebUI.
Procedure
- Access the Loader web UI.
- Log in to FusionInsight Manager. For details, see Accessing FusionInsight Manager (MRS 3.x or Later).
- Choose Cluster > Name of the desired cluster > Services > Loader.
- Click LoaderServer(Node name, Active). The Loader web UI is displayed.
Figure 1 Loader web UI
- Query historical records of a Loader job.
- Locate the row that contains the job to be viewed.
- Click More and select View History to view the job execution history.
Figure 2 Viewing historical records
Table 1 Parameters Name
Description
Rows/Files Read
Indicates the number of rows (files) read from the input source.
Rows/Files Written
Number of rows (files) written to the output source.
Rows/Files Skipped
- Indicates the number of bad rows (files) recorded during transformation. The input format is incorrect, so transformation cannot be performed.
- Number of rows that are skipped after filtering conditions are configured during conversion.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot