Automatically Expanding the Storage Space of a Kafka Instance
Specific processing policies will be triggered when the disk usage of a Kafka instance reaches the threshold. As a result, messages may be deleted or the message production may fail. To avoid these situations, you can enable automatic disk expansion.
Notes and Constraints
- Unavailable for old instances. See the console.
- Unavailable for single-node instances.
- This function may not be completed before the disk usage reaches the threshold when the disk usage increases rapidly.
- Services will not be affected.
Prerequisite
Expanding the storage space of a Kafka instance will incur fees. Ensure that your account has sufficient balance. For details about the pricing, see Product Pricing Details.
Authorizing Kafka
Permission DMS BSSAccess is required. Otherwise, the automatic expansion fails.
- Log in to the Kafka console as the tenant account or a subaccount in user group admin.
- Click
in the upper left corner to select a region.
- Choose Service Authorization.
- Check BSS and click Update Authorization.
- Once the operation succeeds, agency dms_admin_trust is created in IAM.
Once the dms_admin_trust is created, do not modify or delete it.
Enabling Automatic Storage Space Expansion
- Log in to the Kafka console.
- Click
in the upper left corner to select the region where your instance is located.
- Click a Kafka instance name to go to the instance overview page.
- In Disk Autoscaling in the Instance Information area, click
. The Disk Autoscaling dialog box is displayed.
- Click
and set the parameters described in Table 1.
Table 1 Disk autoscaling parameters Parameter
Description
Threshold
Threshold for triggering automatic disk scaling. The value range is 20% to 80%.
When the disk usage of any node in a cluster Kafka instance reaches this threshold, the disk is automatically expanded.
Increase By
Proportion of the storage space to be expanded to the total storage space of the instance. The value range is 10% to 100%. The minimum increase is 100 GB. If the storage space to be expanded is not a multiple of 100, the value will be rounded up to 100.
For example, when the total storage space of an instance is 300 GB and the increase is 10%, if the storage space to be expanded is 300 × 10% = 30 GB, it will be rounded up to 100 GB.
Upper Limit
The upper limit of the storage space. After the total storage space of an instance reaches this limit, the instance will not automatically expand the storage space.
- Click OK.
Later, check that Disk Autoscaling is changed to Enabled in the Instance Information area on the Kafka instance overview page.
Disabling Automatic Storage Space Expansion
- Log in to the Kafka console.
- Click
in the upper left corner to select the region where your instance is located.
- Click a Kafka instance name to go to the instance overview page.
- In Disk Autoscaling in the Instance Information area, click
. The Disk Autoscaling dialog box is displayed.
- In the Disk Autoscaling row, click
and click OK.
Later, check that Disk Autoscaling is changed to Disabled in the Instance Information area on the Kafka instance overview page.
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot