Link to OBS

Updated on 2025-01-14 GMT+08:00

View PDF

Description

By creating an OBS link, you can extract files from or load files to Object Storage Service (OBS). Files in CSV, JSON, and binary format are supported.

Sample Link

The following is the message body of a sample link. You are advised to store the AK and SK in ciphertext in the configuration file or environment variables and decrypt them when needed to ensure security.

{
    "links": [
        {
            "link-config-values": {
                "configs": [
                    {
                        "inputs": [
                            {
                                "name": "linkConfig.storageType",
                                "value": "OBS"
                            },
                            {
                                "name": "linkConfig.obsBucketType",
                                "value": "PFS"
                            },
                            {
                                "name": "linkConfig.server",
                                "value": "10.121.16.183"
                            },
                            {
                                "name": "linkConfig.port",
                                "value": "443"
                            },
                            {
                                "name":"linkConfig.accessKey",
                                "value": "<YOUR AK>"
                            },
                            {
                                "name":"linkConfig.securityKey",
                                "value":"<YOUR SK>"
                            }
                        ],
                        "name": "linkConfig"
                    }
                ]
            },
            "name": "obs_link",
            "connector-name": "obs-connector"
        }
    ]
}

Link Parameters

Parameter	Mandatory	Type	Description
linkConfig.storageType	Yes	String	Storage class of an object
linkConfig.obsBucketType	No	String	OBS bucket type OB: object bucket PFS: parallel file system NOTE: A parallel file system is recommended because filtering files in an object bucket is slow.
linkConfig.server	Yes	String	Endpoint of the OBS server.
linkConfig.port	Yes	String	Data transmission port. The HTTPS port number is 443 and the HTTP port number is 80.
linkConfig.accessKey	Yes	String	AK. You are advised to store it in ciphertext in the configuration file or an environment variable and decrypt it when needed to ensure security.
linkConfig.securityKey	Yes	String	SK. You are advised to store it in ciphertext in the configuration file or an environment variable and decrypt it when needed to ensure security.