Run Logs

Procedure

1. Access the IoTDA service page and click Access Console.
2. In the navigation pane, choose O&M > Run Logs, and click Configure Run Log.
   Figure 1 Configuring the log function
   

3. On the displayed dialog box, select the service type for data collection and click OK.
   Figure 2 Configuring the log function
   

4. Create a run log forwarding rule to forward the collected log data to other cloud services, so that you can view and process it. You are advised to forward log data to LTS. The following uses LTS as an example.
   1. In the navigation pane, choose Rules > Data Forwarding, and click Create Rule.
   2. Configure parameters by referring to the following table, and click Create Rule.

      Table 3 Creating a rule

      Parameter	Description
      Rule Name	Specify the name of a rule to create.
      Description	Describe the rule.
      Data Source	Select Run log.
      Trigger	After the data source is selected, the platform automatically matches the trigger event.
      Resource Space	You can select a single resource space or all resource spaces.

   3. Click the Set Forwarding Target tab, and then click Add to set a forwarding target.

      Table 4 Setting the forwarding target

      Parameter	Description
      Forwarding Target	Select Log Tank Service (LTS).
      Region	Currently, log data can be forwarded only to LTS in the same region.
      Log Group/log Stream	Select a log group and log stream of LTS. If no log group or log stream is available, create them by referring to Managing Log Groups and Managing Log Streams.

      

      Logs are retained in the log group for 7 days by default. Logs older than the retention period will be automatically deleted. For long-term storage, you can transfer logs to Object Storage Service (OBS) buckets. For details, see Transferring Logs to OBS.

      LTS provides a free quota of 500 MB per month. By default, it continues to collect logs when the quota is used up. You will be billed for the excess usage on a pay-per-use basis. You can log in to the LTS console and choose Configuration Center to disable this function.

   4. Click No, and then click Enable Rule to forward run logs to LTS.

5. Log in to the LTS console and choose Log Management.
6. Select the log group and log stream created in 3 to view the logs reported by IoTDA. You can search for raw and target logs by referring to Log Search. For example, you can search for logs by device ID or service type.
   Figure 3 Viewing logs
   
   Figure 4 Viewing logs
   

7. On the log stream details page, click Visualization. On the log structuring page displayed, click Delimiter. You are advised to use | for extraction.
   Figure 5 Log visualization
   

8. Select a sample log that contains time, device ID, service type, operation, request parameter, result information, and execution status. Select |, click Intelligent Extraction, change the names of the extracted fields (for example, change them to accessTime, deviceId, serviceType, operate, request, response, and status), and change the field type to string. Click Save to complete the log structuring configuration. For details, see Structuring Logs.
   Figure 6 Structuring logs
   
   Figure 7 Structuring logs
   

9. After the raw logs are structured, the service will respond. On the Log Management page, select the log group and log stream created in 3, and click Visualization to view target logs. You can query logs using SQL statements. For example, to query logs by device ID and service type, run select * where deviceId = '5ebac4b54d9b0202c5d8ef0c_test_log' and serviceType = 'device.property'.
   Figure 8 Log visualization