From Kafka
Sample JSON File
"from-config-values": { "configs": [ { "inputs": [ { "name": "fromJobConfig.topicsList", "value": "est1,est2" }, { "name": "fromJobConfig.kafkaConsumerStrategy", "value": "EARLIEST" }, { "name": "fromJobConfig.isPermanency", "value": "true" } ], "name": "fromJobConfig" } ] }
Parameter Description
Parameter |
Mandatory |
Type |
Description |
---|---|---|---|
fromJobConfig.topicsList |
Yes |
String |
List of Kafka topics. Separate multiple topics by commas (,). |
fromJobConfig.kafkaConsumerStrategy |
Yes |
Enumeration |
Used to set the initial offset when data is pulled from Kafka. The options are as follows:
|
fromJobConfig.isPermanency |
Yes |
Boolean |
Whether to run permanently |
fromJobConfig.groupId |
No |
String |
Consumer group ID If you export data from DMS Kafka, enter any value for Kafka Platinum but a valid consumer group ID for Kafka Basic. |
fromJobConfig.dataFormat |
Yes |
Enumeration |
Format used for parsing data. The options are as follows:
|
fromJobConfig.maxPollRecords |
No |
String |
Maximum number of requests that can be sent to Kafka each time |
fromJobConfig.maxPollInterval |
No |
String |
Maximum interval between each poll |
fromJobConfig.separator |
No |
String |
Field delimiter |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot