Updated on 2024-04-19 GMT+08:00

Managing Logs

CSS provides log backup and search functions to help you locate faults. You can back up cluster logs to OBS buckets and download required log files to analyze and locate faults.

Enabling Log Management

  1. Log in to the CSS management console.
  2. Choose Clusters > Logstash, click the name of the target cluster. The Basic Information page is displayed.
  3. Click the Logs tab and enable Log Management.
  4. (Optional) If log management is enabled, CSS automatically creates an OBS bucket, backup path, and IAM agency for you to back up logs. The automatically created OBS bucket, backup path, and IAM agency are displayed on the page. If you want to change the OBS bucket, backup path, and IAM agency, click on the right of Log Backup Configuration.

    In the displayed Edit Log Backup Configuration dialog box, you can either select an existing OBS bucket and IAM agency or create a new bucket and agency. To create a new bucket, click Create Bucket. To create a new agency, click Create IAM Agency. For details, see Creating a Bucket and Creating an Agency.

    Table 1 Parameter description

    Parameter

    Description

    Remarks

    OBS Bucket

    Name of the OBS bucket used for storing logs

    The OBS bucket must be in the same region as the cluster.

    Backup Path

    Storage path of logs in the OBS bucket

    The backup path configuration rules are as follows:
    • The backup path cannot contain the following characters: \:*?"<>|
    • The backup path cannot start with a slash (/).
    • The backup path cannot start or end with a period (.).
    • The backup path cannot contain more than 1,023 characters.

    IAM Agency

    IAM agency authorized by the current account for CSS to access or maintain data stored in OBS

    The following requirements must be met for existing IAM agencies or those that will be created:

    • Agency Type must be Cloud service.
    • Cloud Service must be Elasticsearch.
    • The agency must have the OBS Administrator permission for the OBS project in Global service.
  5. Back up logs.
    1. Automatically backing up logs

      Click the icon on the right of Auto Backup to enable the auto backup function.

      indicates that the auto backup function is enabled, and indicates that it is disabled.

      After enabling the auto backup function, set the backup start time on the Edit Auto Backup Policy page. When the scheduled time arrives, the system will back up logs automatically.

    1. Manually backing up logs

      On the Log Backup tab page, click Back Up. On the displayed page, click Yes to start backup.

      If Task Status in the log backup list is Successful, the backup is successful.

      All logs in the cluster are copied to a specified OBS path. You can view or download log files from the OBS path.

  6. Search for logs.

    You can search for logs by cluster node. A maximum of 1,000 latest logs are displayed.

    On the Log Search page, select the target node, log type, and log level, and click . The search results are displayed.

Viewing Logs

After backing up logs, you can click Backup Path to go to the OBS console and view the logs.

Deprecation logs and running logs of CSS are backed up. Table 2 lists the logs stored in the OBS bucket.

Table 2 Log types

Log Name

Description

logstash-deprecation.log

Deprecation log

logstash-plain.log

Logstash running log