Uploading Streaming Data in Protobuf Format

Initialize a DIS SDK client instance as instructed in Initializing a DIS SDK Client Instance.

Initialize the DIS client and add the bodySerializeType parameter as follows:

cli = disclient(endpoint='', ak='', sk='', projectid='', region='',bodySerializeType='protobuf')

Configure the following parameter:

1

streamname ="dis-test1"  #Name of an existing stream.

Parameter bodySerializeType in the test method must be set to protobuf so that streaming data is uploaded in protobuf format.

records of the protobuf_putRecords_test method in the protobuf_putRecords_sample.py file is the data to be uploaded. The data is uploaded in the following format:

1
2
3
4

records=[{"data": "abcdefd", "partition_key": "1"}]
#data: data to be uploaded. The value is user-definable; partition_key: partition to which data is written. The value is user-definable. 
 record1 = {"data": "xxx","partition_key": partition_key}   
#You can write multiple pieces of data. The data format is shown in record1. Each time a piece of data is written, the append method is used to transfer the data to the records.

After configuring the parameters, run the protobuf_putRecords_sample.py file to call protobuf_putRecords_test. The following is an example response:

1
2

200
{'failed_record_count': 0, 'records': [{'partition_id': 'shardId-0000000001', 'sequence_number': '15'}]}