How Do I Upload Objects Larger Than 5 GB?

Context

OBS Console puts limits on the size and number of files you can upload.

• In regions where batch upload is supported, a maximum of 100 files can be uploaded at a time, with a maximum total size of 5 GB.
• In regions where batch upload is not supported, only one file can be uploaded at a time, with a maximum size of 50 MB.

Therefore, for a single file to be uploaded, its maximum size can be 5 GB in a batch upload or 50 MB in a single upload.

Methods

• 5 GB < Object <= 48.8 TB

  If an object is larger than 5 GB, you can use OBS Browser+ or obsutil to upload it. Or you can use the OBS SDKs or API to upload the object (up to 48.8 TB) with a multipart upload.

  • Using OBS Browser+

    Files are uploaded using multipart upload on OBS Browser+. With multipart upload, you can upload a single file with the maximum size of 48.8 TB.

    OBS Browser allows up to 500 files to be uploaded at a time.

    For details about using OBS Browser+ to upload objects, see Uploading a File or Folder.

  • Using obsutil

    With multipart upload, you can upload a single file with the maximum size of 48.8 TB. There is no limit on the number of files that can be uploaded at a time.

    For details about using obsutil to upload objects, see Uploading an Object.

  • Using OBS SDKs

    OBS SDK supports uploading a large object with a multipart upload. A multipart upload consists of initiating a multipart upload, uploading parts one by one or concurrently, and assembling parts.

    Table 1 Multipart upload using OBS SDKs

    Language	References
    Java	Multipart Upload (Java SDK)
    Python	Multipart Upload (Python SDK)
    C	Multipart Upload (C SDK)
    Go	Multipart Upload (Go SDK)
    BrowserJS	Multipart Upload (BrowserJS SDK)
    .NET	Multipart Upload (.NET SDK)
    Android	Multipart Upload (Android SDK)
    iOS	Multipart Upload (iOS SDK)
    PHP	Multipart Upload (PHP SDK)
    Node.js	Multipart Upload (Node.js SDK)

  • Using OBS APIs

    You can upload a large object with a multipart upload API. A multipart upload consists of:

    1. Initiating a multipart upload
    2. Uploading a part
    3. Assembling parts
• Object > 48.8 TB

  If you need to upload data greater than 48.8 TB to OBS, see Migrating Local Data to OBS.