Performance Optimization
OBS manages partitions based on the UTF-8 code range of object names and implements horizontal expansion and dynamic load balancing accordingly. If you use sequential prefixes (such as timestamps or alphabetical order) in object naming, object access requests may be concentrated in a specific partition, causing access hotspots. The request rate in a hotspot partition is limited, as a result, access delay increases.
Random prefixes for object naming are recommended so that requests are evenly distributed across partitions, allowing horizontal expansion.
Example:
In a typical scenario of log archiving, the names of objects to be uploaded are as follows:
yourbucket/obslog/20190610-01.log.tar.gz yourbucket/obslog/20190610-02.log.tar.gz yourbucket/obslog/20190610-03.log.tar.gz yourbucket/obslog/20190610-04.log.tar.gz ... yourbucket/obslog/20190611-01.log.tar.gz yourbucket/obslog/20190611-02.log.tar.gz yourbucket/obslog/20190611-03.log.tar.gz yourbucket/obslog/20190611-04.log.tar.gz
You are advised to add a hexadecimal hash prefix with three or more digits to the object name.
yourbucket/6ac-obslog/20140610-01.log.tar.gz yourbucket/b42-obslog/20140610-02.log.tar.gz yourbucket/17f-obslog/20140610-03.log.tar.gz yourbucket/ac9-obslog/20140610-04.log.tar.gz ... yourbucket/95d-obslog/20140611-01.log.tar.gz yourbucket/4a5-obslog/20140611-02.log.tar.gz yourbucket/ea2-obslog/20140611-03.log.tar.gz yourbucket/ba3-obslog/20140611-04.log.tar.gz
Last Article: Verifying Data Consistency During Download
Next Article: Accessing OBS from App Clients
Did this article solve your problem?
Thank you for your score！Your feedback would help us improve the website.