Assessment

Updated on 2022-09-16 GMT+08:00

View PDF

Before changing shards, you need to carry out a preliminary evaluation and determine the number of new shards, whether to scale up the current DDM node class, and the number of required data nodes and their specifications.

Data volume: Run show db status to query the volume of data involved.
DDM node class: Determine nodes of the DDM instance and vCPUs and memory size of each node.
Data node class: Determine the number of data nodes and vCPUs and memory size of each node.
Business scale: Analyze current service scale and growth trend.

Customer stories:

A customer has a four-node DDM instance. Each node has 8 vCPUs and 16 GB memory. The instance is associated with 6 data nodes, containing 73,000 physical tables in total where 100 billion data records are stored, with the data volume up to about 12 TB.

Changing shards will definitely cause the migration of all schema data. Each data record must be rerouted, so the computing speed is obviously slower than the computing speed when shards are unchanged. Considering service requirements, change the DDM node class to 32 vCPUs | 64 GB, increase data nodes to 12, and upgrade the DDM kernel version to the latest. Then you can restore the node class to the original one as required. The shards are not changed, so only half of the shards are migrated from original data nodes to new data nodes, with no route redistribution involved. Keep shards unchanged and increase data nodes unless there is a single physical table whose storage has reached the upper limit.

Parent topic: Shard Configuration

Previous topic: Overview and Application Scenarios

Next topic: Pre-check