How Do I Upload Objects Larger Than 5 GB?

Context

OBS Console has limits on the size and the number of files you can upload.

• In regions that support batch uploads, up to 1,000 files can be uploaded at a time, with a total size of no more than 5 GB.
• In regions that do not support batch uploads, only one file can be uploaded at a time, with a size of no more than 50 MB.

An individual file can be up to 5 GB if batch upload is supported or up to 50 MB if batch upload is not supported.

Methods

• 5 GB < Object ≤ 48.8 TB

  If an object is larger than 5 GB, you can use OBS Browser+ or obsutil to upload it. Or you can use the OBS SDKs or API to upload the object (up to 48.8 TB) with a multipart upload.

  • Using OBS Browser+

    Files are uploaded using multipart upload on OBS Browser+. With multipart upload, you can upload a single file with the maximum size of 48.8 TB.

    OBS Browser+ allows up to 500 files to be uploaded at a time.

    For details about using OBS Browser+ to upload objects, see Uploading a File or Folder.

  • Using obsutil

    With multipart upload, you can upload a single file with the maximum size of 48.8 TB. There is no limit on the number of files that can be uploaded at a time.

    For details about using obsutil to upload objects, see Uploading an Object.

  • Using OBS SDKs

    OBS SDK supports uploading a large object with a multipart upload. A multipart upload consists of initiating a multipart upload, uploading parts one by one or concurrently, and assembling parts.

    Table 1 Multipart upload using OBS SDKs

    Language	References
    Java	Multipart Upload (SDK for Java)
    Python	Multipart Upload (SDK for Python)
    C	Multipart Upload (SDK for C)
    Go	Multipart Upload (SDK for Go)
    BrowserJS	Multipart Upload (SDK for BrowserJS)
    .NET	Multipart Upload (SDK for .NET)
    Android	Multipart Upload (SDK for Android)
    iOS	Multipart Upload (SDK for iOS)
    PHP	Multipart Upload (SDK for PHP)
    Node.js	Multipart Upload (SDK for Node.js)

  • Using OBS APIs

    You can upload a large object with a multipart upload API. A multipart upload consists of:

    1. Initiating a multipart upload
    2. Uploading parts
    3. Completing a multipart upload
• Object > 48.8 TB

  If you need to upload data greater than 48.8 TB to OBS, see Migrating Local Data to OBS.