From DIS
Sample JSON File
"from-config-values": { "configs": [ { "inputs": [ { "name": "fromJobConfig.streamName", "value": "cdm" }, { "name": "fromJobConfig.disConsumerStrategy", "value": "FROM_LAST_STOP" }, { "name": "fromJobConfig.isPermanency", "value": "true" }, { "name": "fromJobConfig.maxPollRecords", "value": "100" }, { "name": "fromJobConfig.shardId", "value": "0" }, { "name": "fromJobConfig.dataFormat", "value": "BINARY" }, { "name": "fromJobConfig.separator", "value": "," } ], "name": "fromJobConfig" } ] }
Parameter Description
Parameter |
Mandatory |
Type |
Description |
---|---|---|---|
fromJobConfig.streamName |
Yes |
String |
DIS stream name |
fromJobConfig.disConsumerStrategy |
Yes |
Enumeration |
Used to set the initial offset when data is pulled from DIS. The options are as follows:
|
fromJobConfig.isPermanency |
Yes |
Boolean |
Whether to run permanently |
fromJobConfig.maxPollRecords |
No |
String |
Maximum number of requests that can be sent to DIS each time |
fromJobConfig.shardId |
Yes |
String |
ID of the DIS partition. You can enter multiple partition IDs, which are separated by commas (,). |
fromJobConfig.dataFormat |
Yes |
Enumeration |
Format used for parsing data. The options are as follows:
|
fromJobConfig.separator |
No |
String |
Field delimiter |
fromJobConfig.appName |
No |
String |
Unique identifier of the consumer application |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot