mrs
- User Guide
- IAM Permissions Management
- MRS Quick Start
- Configuring Clusters
- Overview
- Cluster List
- Methods of Purchasing MRS Clusters
- Quick Purchase of a Hadoop Analysis Cluster
- Quick Purchase of an HBase Cluster
- Quick Purchase of a Kafka Cluster
- Custom Purchase of a Cluster
- Creating a Cluster
- Creating the Smallest Cluster
- Creating a Cluster (History Versions)
- Configuring a Cluster with Storage and Compute Separated
- Managing Cluster Tags
- Bootstrap Actions
- Managing Active Clusters
- Viewing and Monitoring Clusters
- Manually Scaling Out a Cluster
- Manually Scaling In a Cluster
- Using Auto Scaling in a Cluster
- Configuring Auto Scaling Rules When Creating a Cluster
- Scaling Up Master Node Specifications
- Configuring Message Notification
- O&M
- Terminating a Cluster
- Unsubscribing from a Cluster
- Deleting a Failed Task
- Managing a Component
- Introduction
- Querying Configurations
- Managing Services
- Configuring Service Parameters
- Configuring Customized Service Parameters
- Synchronizing Service Configurations
- Managing Role Instances
- Configuring Role Instance Parameters
- Synchronizing Role Instance Configuration
- Decommissioning and Recommissioning Role Instances
- Managing a Host(Node)
- Isolating a Host
- Canceling Isolation of a Host
- Starting and Stopping a Cluster
- Synchronizing Cluster Configurations
- Exporting Configuration Data of a Cluster
- Performing Rolling Restart
- Managing Jobs
- Introduction to Jobs
- Running a MapReduce Job
- Running a Spark Job
- Running a HiveSql Job
- Running a SparkSql Job
- Running a Flink Job
- Running a Kafka Job
- Viewing Job Configurations and Logs
- Stopping Jobs
- Copying Jobs
- Deleting Jobs
- Using Encrypted OBS Data for Job Running
- Configuring Job Notification Rules
- Managing Data Files
- Alarm Management
- Alarm Reference
- ALM-12001 Audit Log Dump Failure
- ALM-12002 HA Resource Is Abnormal
- ALM-12004 OLdap Resource Is Abnormal
- ALM-12005 OKerberos Resource Is Abnormal
- ALM-12006 Node Fault
- ALM-12007 Process Fault
- ALM-12010 Manager Heartbeat Interruption Between the Active and Standby Nodes
- ALM-12011 Manager Data Synchronization Exception Between the Active and Standby Nodes
- ALM-12012 NTP Service Is Abnormal
- ALM-12016 CPU Usage Exceeds the Threshold
- ALM-12017 Insufficient Disk Capacity
- ALM-12018 Memory Usage Exceeds the Threshold
- ALM-12027 Host PID Usage Exceeds the Threshold
- ALM-12028 Number of Processes in the D State on the Host Exceeds the Threshold
- ALM-12031 User omm or Password Is About to Expire
- ALM-12032 User ommdba or Password Is About to Expire
- ALM-12033 Slow Disk Fault
- ALM-12034 Periodic Backup Failure
- ALM-12035 Unknown Data Status After Recovery Task Failure
- ALM-12037 NTP Server Is Abnormal
- ALM-12038 Monitoring Indicator Dump Failure
- ALM-12039 GaussDB Data Is Not Synchronized
- ALM-12040 Insufficient System Entropy
- ALM-13000 ZooKeeper Service Unavailable
- ALM-13001 Available ZooKeeper Connections Are Insufficient
- ALM-13002 ZooKeeper Heap Memory or Direct Memory Usage Exceeds the Threshold
- ALM-14000 HDFS Service Unavailable
- ALM-14001 HDFS Disk Usage Exceeds the Threshold
- ALM-14002 DataNode Disk Usage Exceeds the Threshold
- ALM-14003 Number of Lost HDFS Blocks Exceeds the Threshold
- ALM-14004 Number of Damaged HDFS Blocks Exceeds the Threshold
- ALM-14006 Number of HDFS Files Exceeds the Threshold
- ALM-14007 HDFS NameNode Memory Usage Exceeds the Threshold
- ALM-14008 HDFS DataNode Memory Usage Exceeds the Threshold
- ALM-14009 Number of Dead DataNodes Exceeds the Threshold
- ALM-14010 NameService Service Is Abnormal
- ALM-14011 HDFS DataNode Data Directory Is Not Configured Properly
- ALM-14012 HDFS JournalNode Data Is Not Synchronized
- ALM-16000 Percentage of Sessions Connected to the HiveServer to Maximum Number Allowed Exceeds the Threshold
- ALM-16001 Hive Warehouse Space Usage Exceeds the Threshold
- ALM-16002 Successful Hive SQL Operations Are Lower than the Threshold
- ALM-16004 Hive Service Unavailable
- ALM-18000 Yarn Service Unavailable
- ALM-18002 NodeManager Heartbeat Lost
- ALM-18003 NodeManager Unhealthy
- ALM-18006 MapReduce Job Execution Timeout
- ALM-19000 HBase Service Unavailable
- ALM-19006 HBase Replication Synchronization Failed
- ALM-25000 LdapServer Service Unavailable
- ALM-25004 Abnormal LdapServer Data Synchronization
- ALM-25500 KrbServer Service Unavailable
- ALM-27001 DBService Unavailable
- ALM-27003 DBService Heartbeat Interruption Between the Active and Standby Nodes
- ALM-27004 Data Inconsistency Between Active and Standby DBServices
- ALM-28001 Spark Service Unavailable
- ALM-26051 Storm Service Unavailable
- ALM-26052 Number of Available Supervisors in Storm Is Lower Than the Threshold
- ALM-26053 Slot Usage of Storm Exceeds the Threshold
- ALM-26054 Heap Memory Usage of Storm Nimbus Exceeds the Threshold
- ALM-38000 Kafka Service Unavailable
- ALM-38001 Insufficient Kafka Disk Space
- ALM-38002 Heap Memory Usage of Kafka Exceeds the Threshold
- ALM-24000 Flume Service Unavailable
- ALM-24001 Flume Agent Is Abnormal
- ALM-24003 Flume Client Connection Failure
- ALM-24004 Flume Fails to Read Data
- ALM-24005 Data Transmission by Flume Is Abnormal
- ALM-12041 Permission of Key Files Is Abnormal
- ALM-12042 Key File Configurations Are Abnormal
- ALM-23001 Loader Service Unavailable
- ALM-12357 Failed to Export Audit Logs to the OBS
- ALM-12014 Partition Lost
- ALM-12015 Partition Filesystem Readonly
- ALM-12043 DNS Resolution Duration Exceeds the Threshold
- ALM-12045 Network Read Packet Dropped Rate Exceeds the Threshold
- ALM-12046 Network Write Packet Dropped Rate Exceeds the Threshold
- ALM-12047 Network Read Packet Error Rate Exceeds the Threshold
- ALM-12048 Network Write Packet Error Rate Exceeds the Threshold
- ALM-12049 Network Read Throughput Rate Exceeds the Threshold
- ALM-12050 Network Write Throughput Rate Exceeds the Threshold
- ALM-12051 Disk Inode Usage Exceeds the Threshold
- ALM-12052 TCP Temporary Port Usage Exceeds the Threshold
- ALM-12053 File Handle Usage Exceeds the Threshold
- ALM-12054 The Certificate File Is Invalid
- ALM-12055 The Certificate File Is About to Expire
- ALM-18008 Heap Memory Usage of Yarn ResourceManager Exceeds the Threshold
- ALM-18009 Heap Memory Usage of MapReduce JobHistoryServer Exceeds the Threshold
- ALM-20002 Hue Service Unavailable
- ALM-43001 Spark Service Unavailable
- ALM-43006 Heap Memory Usage of the JobHistory Process Exceeds the Threshold
- ALM-43007 Non-Heap Memory Usage of the JobHistory Process Exceeds the Threshold
- ALM-43008 Direct Memory Usage of the JobHistory Process Exceeds the Threshold
- ALM-43009 JobHistory GC Time Exceeds the Threshold
- ALM-43010 Heap Memory Usage of the JDBCServer Process Exceeds the Threshold
- ALM-43011 Non-Heap Memory Usage of the JDBCServer Process Exceeds the Threshold
- ALM-43012 Direct Memory Usage of the JDBCServer Process Exceeds the Threshold
- ALM-43013 JDBCServer GC Time Exceeds the Threshold
- Patch Operation Guide
- MRS Patch Description
- Log Management
- Health Check Management
- Performing a Health Check
- Viewing and Exporting a Check Report
- DBService Health Check
- Flume Health Check
- HBase Health Check
- Host Health Check
- HDFS Health Check
- Hive Health Check
- Kafka Health Check
- KrbServer Health Check
- LdapServer Health Check
- Loader Health Check
- MapReduce Health Check
- OMS Health Check
- Spark Health Check
- Storm Health Check
- Yarn Health Check
- ZooKeeper Health Check
- Tenant Management
- Introduction
- Creating a Tenant
- Creating a Sub-tenant
- Deleting a Tenant
- Managing a Tenant Directory
- Recovering Tenant Data
- Creating a Resource Pool
- Modifying a Resource Pool
- Deleting a Resource Pool
- Configuring a Queue
- Configuring the Queue Capacity Policy of a Resource Pool
- Clearing the Configuration of a Queue
- Backup and Restoration
- Security Management
- Default Users of Clusters with Kerberos Authentication Disabled
- Default Users of Clusters with Kerberos Authentication Enabled
- Changing the Password for an OS User
- Changing the Password for User admin
- Changing the Password for the Kerberos Administrator
- Changing the Password for the LDAP Administrator and the LDAP User (including OMS LDAP)
- Changing the Password for a Component Running User
- Changing the Password for the OMS Database Administrator
- Changing the Password for the Data Access User of the OMS Database
- Changing the Password for a Component Database User
- Replacing HA Certificates
- Updating the Key of a Cluster
- MRS Multi-User Permission Management
- Users and Permissions of Clusters with Kerberos Authentication Enabled
- Default Users of Clusters with Kerberos Authentication Enabled
- Creating a Role
- Creating a User Group
- Creating a User
- Modifying User Information
- Locking a User
- Unlocking a User
- Deleting a User
- Changing the Password of an Operation User
- Initializing the Password of a System User
- Downloading a User Authentication File
- Modifying a Password Policy
- Configuring Cross-Cluster Mutual Trust Relationships
- Configuring Users to Access Resources of a Trusted Cluster
- Configuring Fine-Grained Permissions for MRS Multi-User Access to OBS
- Managing Historical Clusters
- Viewing Operation Logs
- Managing Data Connections
- Connecting to Clusters
- MRS Manager Operation Guide
- MRS Manager Introduction
- Accessing MRS Manager
- Accessing MRS Manager Supporting Kerberos Authentication
- Viewing Running Tasks in a Cluster
- Monitoring Management
- Alarm Management
- Alarm Reference
- ALM-12001 Audit Log Dump Failure
- ALM-12002 HA Resource Is Abnormal
- ALM-12004 OLdap Resource Is Abnormal
- ALM-12005 OKerberos Resource Is Abnormal
- ALM-12006 Node Fault
- ALM-12007 Process Fault
- ALM-12010 Manager Heartbeat Interruption Between the Active and Standby Nodes
- ALM-12011 Manager Data Synchronization Exception Between the Active and Standby Nodes
- ALM-12012 NTP Service Is Abnormal
- ALM-12016 CPU Usage Exceeds the Threshold
- ALM-12017 Insufficient Disk Capacity
- ALM-12018 Memory Usage Exceeds the Threshold
- ALM-12027 Host PID Usage Exceeds the Threshold
- ALM-12028 Number of Processes in the D State on the Host Exceeds the Threshold
- ALM-12031 User omm or Password Is About to Expire
- ALM-12032 User ommdba or Password Is About to Expire
- ALM-12033 Slow Disk Fault
- ALM-12034 Periodic Backup Failure
- ALM-12035 Unknown Data Status After Recovery Task Failure
- ALM-12037 NTP Server Is Abnormal
- ALM-12038 Monitoring Indicator Dump Failure
- ALM-12039 GaussDB Data Is Not Synchronized
- ALM-12040 Insufficient System Entropy
- ALM-13000 ZooKeeper Service Unavailable
- ALM-13001 Available ZooKeeper Connections Are Insufficient
- ALM-13002 ZooKeeper Heap Memory or Direct Memory Usage Exceeds the Threshold
- ALM-14000 HDFS Service Unavailable
- ALM-14001 HDFS Disk Usage Exceeds the Threshold
- ALM-14002 DataNode Disk Usage Exceeds the Threshold
- ALM-14003 Number of Lost HDFS Blocks Exceeds the Threshold
- ALM-14004 Number of Damaged HDFS Blocks Exceeds the Threshold
- ALM-14006 Number of HDFS Files Exceeds the Threshold
- ALM-14007 HDFS NameNode Memory Usage Exceeds the Threshold
- ALM-14008 HDFS DataNode Memory Usage Exceeds the Threshold
- ALM-14009 Number of Dead DataNodes Exceeds the Threshold
- ALM-14010 NameService Service Is Abnormal
- ALM-14011 HDFS DataNode Data Directory Is Not Configured Properly
- ALM-14012 HDFS JournalNode Data Is Not Synchronized
- ALM-16000 Percentage of Sessions Connected to the HiveServer to Maximum Number Allowed Exceeds the Threshold
- ALM-16001 Hive Warehouse Space Usage Exceeds the Threshold
- ALM-16002 Successful Hive SQL Operations Are Lower than the Threshold
- ALM-16004 Hive Service Unavailable
- ALM-18000 Yarn Service Unavailable
- ALM-18002 NodeManager Heartbeat Lost
- ALM-18003 NodeManager Unhealthy
- ALM-18006 MapReduce Job Execution Timeout
- ALM-19000 HBase Service Unavailable
- ALM-19006 HBase Replication Synchronization Failed
- ALM-25000 LdapServer Service Unavailable
- ALM-25004 Abnormal LdapServer Data Synchronization
- ALM-25500 KrbServer Service Unavailable
- ALM-27001 DBService Unavailable
- ALM-27003 DBService Heartbeat Interruption Between the Active and Standby Nodes
- ALM-27004 Data Inconsistency Between Active and Standby DBServices
- ALM-28001 Spark Service Unavailable
- ALM-26051 Storm Service Unavailable
- ALM-26052 Number of Available Supervisors in Storm Is Lower Than the Threshold
- ALM-26053 Slot Usage of Storm Exceeds the Threshold
- ALM-26054 Heap Memory Usage of Storm Nimbus Exceeds the Threshold
- ALM-38000 Kafka Service Unavailable
- ALM-38001 Insufficient Kafka Disk Space
- ALM-38002 Heap Memory Usage of Kafka Exceeds the Threshold
- ALM-24000 Flume Service Unavailable
- ALM-24001 Flume Agent Is Abnormal
- ALM-24003 Flume Client Connection Failure
- ALM-24004 Flume Fails to Read Data
- ALM-24005 Data Transmission by Flume Is Abnormal
- ALM-12041 Permission of Key Files Is Abnormal
- ALM-12042 Key File Configurations Are Abnormal
- ALM-23001 Loader Service Unavailable
- ALM-12357 Failed to Export Audit Logs to the OBS
- ALM-12014 Partition Lost
- ALM-12015 Partition Filesystem Readonly
- ALM-12043 DNS Resolution Duration Exceeds the Threshold
- ALM-12045 Network Read Packet Dropped Rate Exceeds the Threshold
- ALM-12046 Network Write Packet Dropped Rate Exceeds the Threshold
- ALM-12047 Network Read Packet Error Rate Exceeds the Threshold
- ALM-12048 Network Write Packet Error Rate Exceeds the Threshold
- ALM-12049 Network Read Throughput Rate Exceeds the Threshold
- ALM-12050 Network Write Throughput Rate Exceeds the Threshold
- ALM-12051 Disk Inode Usage Exceeds the Threshold
- ALM-12052 TCP Temporary Port Usage Exceeds the Threshold
- ALM-12053 File Handle Usage Exceeds the Threshold
- ALM-12054 The Certificate File Is Invalid
- ALM-12055 The Certificate File Is About to Expire
- ALM-18008 Heap Memory Usage of Yarn ResourceManager Exceeds the Threshold
- ALM-18009 Heap Memory Usage of MapReduce JobHistoryServer Exceeds the Threshold
- ALM-20002 Hue Service Unavailable
- ALM-43001 Spark Service Unavailable
- ALM-43006 Heap Memory Usage of the JobHistory Process Exceeds the Threshold
- ALM-43007 Non-Heap Memory Usage of the JobHistory Process Exceeds the Threshold
- ALM-43008 Direct Memory Usage of the JobHistory Process Exceeds the Threshold
- ALM-43009 JobHistory GC Time Exceeds the Threshold
- ALM-43010 Heap Memory Usage of the JDBCServer Process Exceeds the Threshold
- ALM-43011 Non-Heap Memory Usage of the JDBCServer Process Exceeds the Threshold
- ALM-43012 Direct Memory Usage of the JDBCServer Process Exceeds the Threshold
- ALM-43013 JDBCServer GC Time Exceeds the Threshold
- Object Management
- Introduction
- Querying Configurations
- Managing Services
- Configuring Service Parameters
- Configuring Customized Service Parameters
- Synchronizing Service Configurations
- Managing Role Instances
- Configuring Role Instance Parameters
- Synchronizing Role Instance Configuration
- Decommissioning and Recommissioning Role Instances
- Managing a Host
- Isolating a Host
- Canceling Isolation of a Host
- Starting and Stopping a Cluster
- Synchronizing Cluster Configurations
- Exporting Configuration Data of a Cluster
- Log Management
- Health Check Management
- Performing a Health Check
- Viewing and Exporting a Check Report
- Configuring the Number of Health Check Reports to Be Reserved
- Managing Health Check Reports
- DBService Health Check
- Flume Health Check
- HBase Health Check
- Host Health Check
- HDFS Health Check
- Hive Health Check
- Kafka Health Check
- KrbServer Health Check
- LdapServer Health Check
- Loader Health Check
- MapReduce Health Check
- OMS Health Check
- Spark Health Check
- Storm Health Check
- Yarn Health Check
- ZooKeeper Health Check
- Static Service Pool Management
- Tenant Management
- Introduction
- Creating a Tenant
- Creating a Sub-tenant
- Deleting a Tenant
- Managing a Tenant Directory
- Recovering Tenant Data
- Creating a Resource Pool
- Modifying a Resource Pool
- Deleting a Resource Pool
- Configuring a Queue
- Configuring the Queue Capacity Policy of a Resource Pool
- Clearing the Configuration of a Queue
- Backup and Restoration
- Security Management
- Default Users of Clusters with Kerberos Authentication Disabled
- Changing the Password for an OS User
- Changing the Password for User admin
- Changing the Password for the Kerberos Administrator
- Changing the Password for the LDAP Administrator and the LDAP User (including OMS LDAP)
- Changing the Password for a Component Running User
- Changing the Password for the OMS Database Administrator
- Changing the Password for the Data Access User of the OMS Database
- Changing the Password for a Component Database User
- Replacing HA Certificates
- Updating the Key of a Cluster
- Permission Management
- Patch Operation Guide
- Restoring Patches for the Isolated Hosts
- Rolling Restart
- Data Migration
- Data Backup and Restoration
- MRS Cluster Component Operation Guide
- Using Hadoop from Scratch
- Using Spark SQL from Scratch
- Using Spark
- Using Hive
- Using HBase
- Using Hue
- Using Kafka
- Using Storm
- Using CarbonData
- Using Flume
- Introduction
- Installing the Flume Client
- Viewing Flume Client Logs
- Stopping or Uninstalling the Flume Client
- Using the Encryption Tool of the Flume Client
- Flume Configuration Parameter Description
- Example: Using Flume to Collect Logs and Import Them to Kafka
- Example: Using Flume to Read OBS Files and Upload Them to HDFS
- Using Loader
- Using Presto
- Using KafkaManager
- Using OpenTSDB
- Using Flink
- Using Impala
- Using Kudu
- Using Alluxio
- Using Ranger
- Using MRS to Access OBS
- Security
- Appendix
Help Center
>
>
User Guide>
Managing Active Clusters>
Managing Jobs>
Viewing Job Configurations and Logs
Viewing Job Configurations and Logs
Updated at:
Nov 06, 2019 GMT+08:00
This section describes how to view job configurations and logs.
Background
- You can view configurations of all jobs.
- You can only view logs of running jobs.
Because logs of Spark SQL and DistCp jobs are not in the background, you cannot view logs of running Spark SQL and DistCp jobs.
Procedure
- Log in to the MRS management console.
- Choose Clusters > Active Clusters, select a running cluster, and click its name to switch to the cluster details page.
- Click Jobs.
- In the Operation column corresponding to the selected job, click View Details.
In the View Details window that is displayed, configuration of the selected job is displayed.
- Select a MapReduce job, and click View Log in the Operation column corresponding to the selected job.
In the page that is displayed, log information of the selected job is displayed.
The MapReduce job is only an example. You can view log information about MapReduce, Spark, Spark Script, and Hive Script jobs regardless of their status.
Each tenant can submit 10 jobs and query 10 logs concurrently.
Parent topic:
Managing Jobs
