Processing Log Data Using DSL Functions

You can use log processing functions to cleanse massive log data collected by LTS and standardize the data format. This section describes the common scenarios and operations for calling these functions to cleanse data.

The DSL processing feature is currently available only to invited users in regions CN North-Beijing4, CN East-Shanghai1, and CN South-Guangzhou. It will be open to all users in the future.

• Scenario 1: Filtering Logs in LTS
  
• Scenario 2: Assigning Values to Empty Log Fields Using the e_set Function
  
• Scenario 3: Deleting and Renaming Fields Using the e_drop_fields and e_rename Functions
  
• Scenario 4: Converting Log Parameter Types Using the v, Cn_int, and Dt_totimestamp Functions
  
• Scenario 5: Filling Default Values for Non-existent Log Fields Using the default Parameter
  
• Scenario 6: Determining Logs and Adding Fields Using the e_if or e_switch Function
  
• Scenario 7: Converting Data to Nanosecond-Level Unix Timestamps
  
• Scenario 8: Converting Data to Microsecond-Level Standard ISO 8601 Timestamps