Updated on 2024-10-25 GMT+08:00

JobGateway Log Overview

Log Description

Log path: /var/log/Bigdata/job-gateway/

Log archive rule: The automatic compression and archive function is enabled for JobGateway run logs. When the total size of all log files exceeds 20 MB (configurable), the log files are automatically compressed into a package named in the format of Original log file name-yyyy-mm-dd.No..log.zip. A maximum of 20 latest compressed files are retained. The number of compressed files and compression threshold can be configured.

Table 1 JobGateway log list

Log Type

Log File Name

Description

JobServer run log

job-gateway.log

Service run log

prestart.log

Service prestart log

availability-check.log

Service availability check log

verbose-gc-sp.txt

Service GC log

gc.log

Service GC log

JobServer audit log

access_log.{yyyy-MM-dd}.log

Service audit log

Balance run log

availability-check.log

Service availability check log

error.log

Service error log

prestart.log

Service prestart log

start.log

Service startup log

Balance audit log

access_http.log

Service audit log

Log Levels

The following table describes the log levels provided by JobGateway.

The log levels are ERROR, WARN, INFO, and DEBUG in descending order of priority. Only logs whose levels are higher than or equal to the specified level are recorded. The higher the log level specified, the fewer the logs are recorded.

Table 2 Log levels

Level

Description

ERROR

Logs of this level record error information about system running

WARN

Logs of this level record exception information about the current event processing

INFO

Logs of this level record normal running status information about the system and events

DEBUG

Logs of this level record the system information and system debugging information

To modify log levels, perform the following operations:

  1. Log in to FusionInsight Manager.
  2. Choose Cluster > Services > JobGateway and click Configurations.
  3. Click All Configurations.
  4. On the menu bar on the left, select the log menu of the target role.
  5. Select a desired log level.
  6. Click Save then OK.

Log Format

The following table lists the JobGateway log formats.

Table 3 Log formats

Log Type

Format

Example

Run log

<yyyy-MM-dd HH:mm:ss> <Log level> <Name of the thread that generates the log > <Name of the class that generates the log:Number of code lines >Message in the log >

[2024-05-22 10:37:10.000] [INFO ] [job-status-refresh-task-fc1ff7bb-a49f-40bb-ada8-d6793c2bed20] [com.huawei.bigdata.jobgateway.job.task.JobStatusRefreshTask:60] - [start update job task]

Audit log

<Remote host name > <Remote username > <Authenticated remote user > <yyyy-MM-dd HH:mm:ss,SSS > < "First line of the log request" Response code Number of sent bytes>

192.18.212.17 - - [29/Apr/2024:11:51:31 +0800] "GET /mrs/job/wait_nums HTTP/1.1" 200 11