From HTTP/HTTPS

Sample JSON File

"from-config-values": {
        "configs": [
          {
            "inputs": [
              {
                "name": "fromJobConfig.inputDirectory",
                "value": "http://10.114.196.186:8080/httpfrom/symbol.txt"
              },
              {
                "name": "fromJobConfig.inputFormat",
                "value": "BINARY_FILE"
              },
              {
                "name": "fromJobConfig.fromCompression",
                "value": "TARGZ"
              },
              {
                "name": "fromJobConfig.compressedFileSuffix",
                "value": "*"
              },
              {
                "name": "fromJobConfig.fileSeparator",
                "value": "|"
              }
            ],
            "name": "fromJobConfig"
          }
        ]
      }

Parameter Description

Parameter	Mandatory	Type	Description
fromJobConfig.inputDirectory	Yes	String	URL of the file to be extracted These connectors are used to read files with an HTTP/HTTPS URL, such as reading public files on the third-party object storage system and web disks.
fromJobConfig.inputFormat	Yes	Enumeration	File format required for data transmission. Currently, only the binary format is supported.
fromJobConfig.fromCompression	No	Enumeration	Compression format of the source files. The options are as follows: NONE: Files in all formats are transferred. GZIP: Files in gzip format are transferred. ZIP: Files in Zip format are transferred. TAR.GZ: Files in TAR.GZ format are transferred.
fromJobConfig.compressedFileSuffix	No	String	Extension of the files to be decompressed. The decompression operation is performed only when the file name extension is used in a batch of files. Otherwise, files are transferred in the original format. If you enter * or leave the parameter blank, all files are decompressed.
fromJobConfig.fileSeparator	No	String	File separator. When multiple files are transferred, CDM uses the file separator to separate files. The default value is \|.
fromJobConfig.useQuery	No	Boolean	If you set this parameter to true, the name of the objects uploaded to OBS does not carry the query parameter. If you set this parameter to false, the name of the objects uploaded to OBS carries the query parameter.
fromJobConfig.decryption	No	Enumeration	Whether to decrypt the encrypted file before export and the decryption method. The options are as follows: NONE: Do not decrypt but directly export the file. AES-256-GCM: Use the AES-256-GCM (NoPadding) algorithm to decrypt the file and then export the file.
fromJobConfig.dek	No	String	Data decryption key. The key is a string of 64-bit hexadecimal numbers and must be the same as the data encryption key toJobConfig.dek configured during encryption. If the encryption and decryption keys are inconsistent, the system does not report an exception, but the decrypted data is incorrect.
fromJobConfig.iv	No	String	Initialization vector required for decryption. The initialization vector is a string of 32-bit hexadecimal numbers and must be the same as the initialization vector toJobConfig.iv configured during encryption. If the initialization vectors are inconsistent, the system does not report an exception, but the decrypted data is incorrect.
fromJobConfig.md5FileSuffix	No	String	Check whether the files extracted by CDM are consistent with those in the migration source.