Updating a Data Processing Job

Function

This API is used to update a data processing job.

Calling Method

For details, see Calling APIs.

URI

PUT /v2/{project_id}/workspaces/{workspace_id}/siem/data-transformations/{data_transformation_id}

**Table 1** Path Parameters
Parameter	Mandatory	Type	Description
project_id	Yes	String	Definition Project ID, which is used to specify the project that a resource belongs to. You can query the resources of a project by project ID. You can obtain the project ID from the API or console. Obtaining the Project ID Constraints N/A Range N/A Default Value N/A
workspace_id	Yes	String	Workspace ID.
data_transformation_id	Yes	String	Data conversion ID.

Request Parameters

**Table 2** Request header parameters
Parameter	Mandatory	Type	Description
X-Auth-Token	Yes	String	Definition User token. You can obtain it by calling the IAM API for obtaining a user token. The user token is the value of X-Subject-Token in the response header. Obtaining a User Token Constraints N/A Range N/A Default Value N/A

**Table 3** Request body parameters
Parameter	Mandatory	Type	Description
data_transformation_name	No	String	Data conversion name.
description	No	String	Data conversion description.
directory	No	String	Directory group.
script	No	String	Job script.
status	No	String	Definition Job status. ENABLED DISABLED Constraints N/A Range ENABLED DISABLED Default Value N/A
belong	No	String	Ownership.
job_mode	No	String	Definition Job mode. STREAMING: streaming processing BATCH: batch processing SEARCH: retrieval Constraints N/A Range STREAMING BATCH SEARCH Default Value N/A
cu_quota_amount	No	Float	Total CU quantity.
job_mode_setting	No	IsapJobModeSettingDto object	Data transmission object for job mode settings.
environment	No	String	Definition Environment type. PROD: production environment TEST: test environment Constraints N/A Range PROD TEST Default Value N/A
output_table_id	No	String	UUID
output_table_ids	No	Array of strings	Output table ID list.
output_table_names	No	Array of strings	Output table name list.

**Table 4** IsapJobModeSettingDto
Parameter	Mandatory	Type	Description
batch_overtime_interval	No	Integer	Integer interval.
batch_overtime_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
batch_frequency_interval	No	Integer	Integer interval.
batch_frequency_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
streaming_state_ttl_interval	No	Integer	Integer interval.
streaming_state_ttl_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
streaming_checkpoint_ttl_interval	No	Integer	Integer interval.
streaming_checkpoint_ttl_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
streaming_startup_mode	No	String	Definition Job startup mode. UPGRADE: startup in upgrade mode REFRESH_NEW: startup in refresh mode Constraints N/A Range UPGRADE REFRESH_NEW Default Value N/A
batch_overtime_strategy_interval	No	Integer	Integer interval.
batch_overtime_strategy_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_delay_interval	No	Integer	Integer interval.
search_delay_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_frequency_interval	No	Integer	Integer interval.
search_frequency_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_overtime_interval	No	Integer	Integer interval.
search_overtime_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_period_interval	No	Integer	Integer interval.
search_period_unit	No	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_table_id	No	String	UUID
search_table_name	No	String	Table name.
field_not_null_policy	No	String	Definition Policy for processing non-empty fields in job tables. LOOSE STRICT Constraints N/A Value Range LOOSE STRICT Default Value LOOSE
dss_id	No	Integer	Long integer interval.

Response Parameters

Status code: 200

**Table 5** Response body parameters
Parameter	Type	Description
data_transformation_id	String	UUID
data_transformation_name	String	Data conversion name.
script	String	Job script.
status	String	Definition Job status. ENABLED DISABLED Constraints N/A Range ENABLED DISABLED Default Value N/A
directory	String	Directory group.
description	String	Data conversion description.
job_mode	String	Definition Job mode. STREAMING: streaming processing BATCH: batch processing SEARCH: retrieval Constraints N/A Range STREAMING BATCH SEARCH Default Value N/A
job_mode_setting	IsapJobModeSettingVo object	Job mode settings.
process_status	String	Definition Job processing status. COMPLETED: completed. CREATING: being created UPDATING: being updated ENABLING: being enabled DISABLING: being disabled DELETING: being deleted CREATE_FAILED: creation failed UPDATE_FAILED: update failed ENABLE_FAILED: enabling failed DISABLE_FAILED: disabling failed DELETE_FAILED: deletion failed RECOVERING: being recovered Constraints N/A Range COMPLETED CREATING UPDATING ENABLING DISABLING DELETING CREATE_FAILED UPDATE_FAILED ENABLE_FAILED DISABLE_FAILED DELETE_FAILED RECOVERING Default Value N/A
process_error	String	Definition Data processing error. NONE Constraints N/A Range NONE Default Value N/A
environment	String	Definition Environment type. PROD: production environment TEST: test environment Constraints N/A Range PROD TEST Default Value N/A
output_table_id	String	UUID
output_table_name	String	Table name.
output_table_ids	Array of strings	Output table ID list.
output_table_names	Array of strings	Output table name list.
create_by	String	Creator.
create_time	Integer	Timestamp, in ms.
update_by	String	Updater.
update_time	Integer	Timestamp, in ms.
delete_time	Integer	Timestamp, in ms.

**Table 6** IsapJobModeSettingVo
Parameter	Type	Description
batch_overtime_interval	Integer	Integer interval.
batch_overtime_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
batch_frequency_interval	Integer	Integer interval.
batch_frequency_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
streaming_state_ttl_interval	Integer	Integer interval.
streaming_state_ttl_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
streaming_checkpoint_ttl_interval	Integer	Integer interval.
streaming_checkpoint_ttl_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
streaming_startup_mode	String	Definition Job startup mode. UPGRADE: startup in upgrade mode REFRESH_NEW: startup in refresh mode Constraints N/A Range UPGRADE REFRESH_NEW Default Value N/A
batch_overtime_strategy_interval	Integer	Integer interval.
batch_overtime_strategy_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_delay_interval	Integer	Integer interval.
search_delay_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_frequency_interval	Integer	Integer interval.
search_frequency_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_overtime_interval	Integer	Integer interval.
search_overtime_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_period_interval	Integer	Integer interval.
search_period_unit	String	Definition Time unit. MINUTE HOUR DAY MONTH: month Constraints N/A Range MINUTE HOUR DAY MONTH Default Value N/A
search_table_id	String	UUID
search_table_name	String	Table name.
field_not_null_policy	String	Definition Policy for processing non-empty fields in job tables. LOOSE STRICT Constraints N/A Value Range LOOSE STRICT Default Value LOOSE

Example Requests

Update a data processing job.

https://{endpoint}//v2/{project_id}/workspaces/{workspace_id}/siem/data-transformations/{data_transformation_id}

{
  "data_transformation_name" : "job_liubiao_test6",
  "script" : "SELECT * FROM s_sec_test;",
  "status" : "DISABLED",
  "directory" : "",
  "description" : "test",
  "belong" : "SYSTEM",
  "environment" : "PROD",
  "cu_quota_amount" : 1,
  "output_table_ids" : [ "2a750856-48b9-4628-b892-1281febc54f5" ],
  "output_table_names" : [ "s_sec_mudi_6" ],
  "job_mode" : "STREAMING",
  "job_mode_setting" : {
    "streaming_state_ttl_interval" : 10,
    "streaming_state_ttl_unit" : "MINUTE",
    "streaming_checkpoint_ttl_interval" : 10,
    "streaming_checkpoint_ttl_unit" : "MINUTE",
    "streaming_startup_mode" : "REFRESH_NEW"
  }
}

Example Responses

Status code: 200

Request succeeded.

{
  "create_by" : "test_account",
  "create_time" : 1726822643601,
  "delete_time" : 0,
  "description" : "test",
  "directory" : "",
  "environment" : "PROD",
  "job_mode" : "STREAMING",
  "job_mode_setting" : {
    "field_not_null_policy" : "LOOSE",
    "streaming_checkpoint_ttl_interval" : 10,
    "streaming_checkpoint_ttl_unit" : "MINUTE",
    "streaming_startup_mode" : "REFRESH_NEW",
    "streaming_state_ttl_interval" : 10,
    "streaming_state_ttl_unit" : "MINUTE"
  },
  "output_table_ids" : [ "2a750856-48b9-4628-b892-1281febc54f5" ],
  "output_table_names" : [ "s_sec_mudi_6" ],
  "process_error" : "NONE",
  "process_status" : "UPDATING",
  "script" : "SELECT * FROM s_sec_test;",
  "status" : "DISABLED",
  "update_by" : "test_user",
  "update_time" : 1768293934298
}

SDK Sample Code

The SDK sample code is as follows.

Update a data processing job.

      
       
         
         
           package com.huaweicloud.sdk.test;

import com.huaweicloud.sdk.core.auth.ICredential;
import com.huaweicloud.sdk.core.auth.BasicCredentials;
import com.huaweicloud.sdk.core.exception.ConnectionException;
import com.huaweicloud.sdk.core.exception.RequestTimeoutException;
import com.huaweicloud.sdk.core.exception.ServiceResponseException;
import com.huaweicloud.sdk.secmaster.v2.region.SecMasterRegion;
import com.huaweicloud.sdk.secmaster.v2.*;
import com.huaweicloud.sdk.secmaster.v2.model.*;

import java.util.List;
import java.util.ArrayList;

public class UpdateDataTransformationSolution {

    public static void main(String[] args) {
        // The AK and SK used for authentication are hard-coded or stored in plaintext, which has great security risks. It is recommended that the AK and SK be stored in ciphertext in configuration files or environment variables and decrypted during use to ensure security.
        // In this example, AK and SK are stored in environment variables for authentication. Before running this example, set environment variables CLOUD_SDK_AK and CLOUD_SDK_SK in the local environment
        String ak = System.getenv("CLOUD_SDK_AK");
        String sk = System.getenv("CLOUD_SDK_SK");
        String projectId = "{project_id}";

        ICredential auth = new BasicCredentials()
                .withProjectId(projectId)
                .withAk(ak)
                .withSk(sk);

        SecMasterClient client = SecMasterClient.newBuilder()
                .withCredential(auth)
                .withRegion(SecMasterRegion.valueOf("<YOUR REGION>"))
                .build();
        UpdateDataTransformationRequest request = new UpdateDataTransformationRequest();
        request.withWorkspaceId("{workspace_id}");
        request.withDataTransformationId("{data_transformation_id}");
        UpdateDataTransformationRequestBody body = new UpdateDataTransformationRequestBody();
        List<String> listbodyOutputTableNames = new ArrayList<>();
        listbodyOutputTableNames.add("s_sec_mudi_6");
        List<String> listbodyOutputTableIds = new ArrayList<>();
        listbodyOutputTableIds.add("2a750856-48b9-4628-b892-1281febc54f5");
        IsapJobModeSettingDto jobModeSettingbody = new IsapJobModeSettingDto();
        jobModeSettingbody.withStreamingCheckpointTtlInterval(10)
            .withStreamingStartupMode(IsapJobModeSettingDto.StreamingStartupModeEnum.fromValue("REFRESH_NEW"))
            .withStreamingCheckpointTtlUnit(IsapJobModeSettingDto.StreamingCheckpointTtlUnitEnum.fromValue("MINUTE"))
            .withStreamingStateTtlInterval(10)
            .withStreamingStateTtlUnit(IsapJobModeSettingDto.StreamingStateTtlUnitEnum.fromValue("MINUTE"));
        body.withOutputTableNames(listbodyOutputTableNames);
        body.withOutputTableIds(listbodyOutputTableIds);
        body.withEnvironment(UpdateDataTransformationRequestBody.EnvironmentEnum.fromValue("PROD"));
        body.withJobModeSetting(jobModeSettingbody);
        body.withCuQuotaAmount(1f);
        body.withJobMode(UpdateDataTransformationRequestBody.JobModeEnum.fromValue("STREAMING"));
        body.withBelong("SYSTEM");
        body.withStatus(UpdateDataTransformationRequestBody.StatusEnum.fromValue("DISABLED"));
        body.withScript("SELECT * FROM s_sec_test;");
        body.withDirectory("");
        body.withDescription("test");
        body.withDataTransformationName("job_liubiao_test6");
        request.withBody(body);
        try {
            UpdateDataTransformationResponse response = client.updateDataTransformation(request);
            System.out.println(response.toString());
        } catch (ConnectionException e) {
            e.printStackTrace();
        } catch (RequestTimeoutException e) {
            e.printStackTrace();
        } catch (ServiceResponseException e) {
            e.printStackTrace();
            System.out.println(e.getHttpStatusCode());
            System.out.println(e.getRequestId());
            System.out.println(e.getErrorCode());
            System.out.println(e.getErrorMsg());
        }
    }
}

          

        

      
     

Update a data processing job.

      
       
         
         
           # coding: utf-8

import os
from huaweicloudsdkcore.auth.credentials import BasicCredentials
from huaweicloudsdksecmaster.v2.region.secmaster_region import SecMasterRegion
from huaweicloudsdkcore.exceptions import exceptions
from huaweicloudsdksecmaster.v2 import *

if __name__ == "__main__":
    # The AK and SK used for authentication are hard-coded or stored in plaintext, which has great security risks. It is recommended that the AK and SK be stored in ciphertext in configuration files or environment variables and decrypted during use to ensure security.
    # In this example, AK and SK are stored in environment variables for authentication. Before running this example, set environment variables CLOUD_SDK_AK and CLOUD_SDK_SK in the local environment
    ak = os.environ["CLOUD_SDK_AK"]
    sk = os.environ["CLOUD_SDK_SK"]
    projectId = "{project_id}"

    credentials = BasicCredentials(ak, sk, projectId)

    client = SecMasterClient.new_builder() \
        .with_credentials(credentials) \
        .with_region(SecMasterRegion.value_of("<YOUR REGION>")) \
        .build()

    try:
        request = UpdateDataTransformationRequest()
        request.workspace_id = "{workspace_id}"
        request.data_transformation_id = "{data_transformation_id}"
        listOutputTableNamesbody = [
            "s_sec_mudi_6"
        ]
        listOutputTableIdsbody = [
            "2a750856-48b9-4628-b892-1281febc54f5"
        ]
        jobModeSettingbody = IsapJobModeSettingDto(
            streaming_checkpoint_ttl_interval=10,
            streaming_startup_mode="REFRESH_NEW",
            streaming_checkpoint_ttl_unit="MINUTE",
            streaming_state_ttl_interval=10,
            streaming_state_ttl_unit="MINUTE"
        )
        request.body = UpdateDataTransformationRequestBody(
            output_table_names=listOutputTableNamesbody,
            output_table_ids=listOutputTableIdsbody,
            environment="PROD",
            job_mode_setting=jobModeSettingbody,
            cu_quota_amount=1,
            job_mode="STREAMING",
            belong="SYSTEM",
            status="DISABLED",
            script="SELECT * FROM s_sec_test;",
            directory="",
            description="test",
            data_transformation_name="job_liubiao_test6"
        )
        response = client.update_data_transformation(request)
        print(response)
    except exceptions.ClientRequestException as e:
        print(e.status_code)
        print(e.request_id)
        print(e.error_code)
        print(e.error_msg)

          

        

      
     

Update a data processing job.

      
       
         
         
           package main

import (
	"fmt"
	"github.com/huaweicloud/huaweicloud-sdk-go-v3/core/auth/basic"
    secmaster "github.com/huaweicloud/huaweicloud-sdk-go-v3/services/secmaster/v2"
	"github.com/huaweicloud/huaweicloud-sdk-go-v3/services/secmaster/v2/model"
    region "github.com/huaweicloud/huaweicloud-sdk-go-v3/services/secmaster/v2/region"
)

func main() {
    // The AK and SK used for authentication are hard-coded or stored in plaintext, which has great security risks. It is recommended that the AK and SK be stored in ciphertext in configuration files or environment variables and decrypted during use to ensure security.
    // In this example, AK and SK are stored in environment variables for authentication. Before running this example, set environment variables CLOUD_SDK_AK and CLOUD_SDK_SK in the local environment
    ak := os.Getenv("CLOUD_SDK_AK")
    sk := os.Getenv("CLOUD_SDK_SK")
    projectId := "{project_id}"

    auth := basic.NewCredentialsBuilder().
        WithAk(ak).
        WithSk(sk).
        WithProjectId(projectId).
        Build()

    client := secmaster.NewSecMasterClient(
        secmaster.SecMasterClientBuilder().
            WithRegion(region.ValueOf("<YOUR REGION>")).
            WithCredential(auth).
            Build())

    request := &model.UpdateDataTransformationRequest{}
	request.WorkspaceId = "{workspace_id}"
	request.DataTransformationId = "{data_transformation_id}"
	var listOutputTableNamesbody = []string{
        "s_sec_mudi_6",
    }
	var listOutputTableIdsbody = []string{
        "2a750856-48b9-4628-b892-1281febc54f5",
    }
	streamingCheckpointTtlIntervalJobModeSetting:= int32(10)
	streamingStartupModeJobModeSetting:= model.GetIsapJobModeSettingDtoStreamingStartupModeEnum().REFRESH_NEW
	streamingCheckpointTtlUnitJobModeSetting:= model.GetIsapJobModeSettingDtoStreamingCheckpointTtlUnitEnum().MINUTE
	streamingStateTtlIntervalJobModeSetting:= int32(10)
	streamingStateTtlUnitJobModeSetting:= model.GetIsapJobModeSettingDtoStreamingStateTtlUnitEnum().MINUTE
	jobModeSettingbody := &model.IsapJobModeSettingDto{
		StreamingCheckpointTtlInterval: &streamingCheckpointTtlIntervalJobModeSetting,
		StreamingStartupMode: &streamingStartupModeJobModeSetting,
		StreamingCheckpointTtlUnit: &streamingCheckpointTtlUnitJobModeSetting,
		StreamingStateTtlInterval: &streamingStateTtlIntervalJobModeSetting,
		StreamingStateTtlUnit: &streamingStateTtlUnitJobModeSetting,
	}
	environmentEnvironment:= model.GetJobEnvironmentEnvironmentEnum().PROD
	cuQuotaAmountUpdateDataTransformationRequestBody:= float32(1)
	jobModeJobMode:= model.GetIsapJobModeJobModeEnum().STREAMING
	belongUpdateDataTransformationRequestBody:= "SYSTEM"
	statusStatus:= model.GetJobStatusStatusEnum().DISABLED
	scriptUpdateDataTransformationRequestBody:= "SELECT * FROM s_sec_test;"
	directoryUpdateDataTransformationRequestBody:= ""
	descriptionUpdateDataTransformationRequestBody:= "test"
	dataTransformationNameUpdateDataTransformationRequestBody:= "job_liubiao_test6"
	request.Body = &model.UpdateDataTransformationRequestBody{
		OutputTableNames: &listOutputTableNamesbody,
		OutputTableIds: &listOutputTableIdsbody,
		Environment: &environmentEnvironment,
		JobModeSetting: jobModeSettingbody,
		CuQuotaAmount: &cuQuotaAmountUpdateDataTransformationRequestBody,
		JobMode: &jobModeJobMode,
		Belong: &belongUpdateDataTransformationRequestBody,
		Status: &statusStatus,
		Script: &scriptUpdateDataTransformationRequestBody,
		Directory: &directoryUpdateDataTransformationRequestBody,
		Description: &descriptionUpdateDataTransformationRequestBody,
		DataTransformationName: &dataTransformationNameUpdateDataTransformationRequestBody,
	}
	response, err := client.UpdateDataTransformation(request)
	if err == nil {
        fmt.Printf("%+v\n", response)
    } else {
        fmt.Println(err)
    }
}

          

        

      
     