What Should I Do If MapReduce Job Information Cannot Be Opened Through Tracking URL on the ResourceManager Web UI?

Question

Why cannot a finished MapReduce job be opened on the ResourceManager web UI after the MapReduce JobHistoryServer service address is changed?

Answer

The JobHistoryServer address (mapreduce.jobhistory.address / mapreduce.jobhistory.webapp.<https.>address) is a MapReduce parameter that is submitted to the ResourceManager along with the job. Once the job is finished, the ResourceManager saves this parameter as the redirection address for viewing job history information in RMStateStore.

Update the MapReduce client configuration file with the new JobHistoryServer service address promptly to view the job history information of a new job. Otherwise, the job history information page will not load as it will still point to the old address. For MapReduce jobs that ran before the service address was changed, the redirection information is stored in RMStateStore and cannot be modified. Therefore, the ResourceManager web UI cannot redirect to the new address. However, you can still search for jobs by directly accessing the new JobHistoryServer service address, and the job information will remain intact.