Performing an Asynchronous Resumable Upload
Function
Asynchronous resumable upload is a resumable upload that supports asynchronous operations and can be paused, canceled, and resumed. It works by creating a sub-thread to perform resumable uploads. If the upload fails, the exception can be checked in a callback. If the upload is successful, an encapsulated Optional object can be obtained from the task.
If you have any questions during development, post them on the Issues page of GitHub. For details about parameters and usage of each API, see the API Reference.
Restrictions
- To upload an object, you must be the bucket owner or have the object upload permission. To use this API, permissions are required. You can use IAM policies to grant the obs:object:PutObject permission or bucket policies to grant the PutObject permission. For details, see Introduction to OBS Access Control, IAM Custom Policies, and Configuring an Object Policy.
- The mapping between OBS regions and endpoints must comply with what is listed in Regions and Endpoints.
- The file uploaded by the resumable upload API must exceed 100 KB.
- You must enable the resumable upload option when you use this API, so the progress of the last upload can be obtained for upload resumption.
Method
obsClientAsync.uploadFileAsync(UploadFileRequest request, TaskCallback<CompleteMultipartUploadResult, UploadFileRequest> completeCallback)
Request Parameters
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| request | Yes | Explanation: Request parameters for uploading an object. For details, see Table 2. | |
| completeCallback | Yes | Explanation: Callbacks executed to obtain results (success or exception) for an asynchronous upload. |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| bucketName | String | Yes | Explanation: Bucket name. Restrictions:
Default value: None |
| objectKey | String | Yes | Explanation: Object name. An object is uniquely identified by an object name in a bucket. An object name is a complete path that does not contain the bucket name. For example, if the address for accessing the object is examplebucket.obs.ap-southeast-1.myhuaweicloud.com/folder/test.txt, the object name is folder/test.txt. Value range: The value can contain 1 to 1,024 characters. Default value: None |
| objectMetadata | ObjectMetadata | No | Explanation: Object metadata. For details, see Table 4. Default value: None |
| acl | AccessControlList | No | Explanation: An ACL that can be specified at bucket creation. You can use either a pre-defined or a user-defined ACL. For more information about ACLs, see ACLs. Value range:
Default value: AccessControlList.REST_CANNED_PRIVATE |
| sseKmsHeader | SseKmsHeader | No | Explanation: Server-side encryption header. For details, see Table 7. Default value: None |
| sseCHeader | SseCHeader | No | Explanation: Server-side encryption header. For details, see Table 8. Default value: None |
| enableCheckpoint | boolean | No | Explanation: Whether to enable the resumable mode. Value range: true: The resumable mode is enabled. false: The resumable mode is disabled. Default value: false |
| checkpointFile | String | No | Explanation: Path of a file generated for recording the progress of a resumable upload. The file contains the information about parts and progress. Restrictions: This parameter is valid only for resumable uploads. Default value: If this parameter is left blank, the progress file will be in the same directory as the local file to be uploaded. |
| uploadFile | String | Yes | Explanation: Full path of the file or folder to be uploaded, for example, aa/bb.txt or aa/. Default value: None |
| extensionPermissionMap | Map<ExtensionObjectPermissionEnum, Set<String>> | No | Explanation: A permission map for granting bucket ACL permissions to one or more accounts. Table 9 specifies the permissions to grant, and Set<String> describes the list of account IDs (indicated by domain_id) the granted permissions apply to. Value range:
Default value: None |
| progressListener | ProgressListener | No | Explanation: Data transmission listener, used for obtaining the upload progress. For details, see Table 10. |
| partSize | long | No | Explanation: Part size. Value range: The value ranges from 100 KB to 5 GB, in bytes. Default value: 9 MB |
| taskNum | int | No | Explanation: Maximum number of files that can be uploaded concurrently in a multipart upload. Value range: An integer from 1 to 10000 Default value: 1, indicating concurrent uploads are not used. |
| encodeHeaders | boolean | No | Explanation: Whether to enable OBS to automatically encode request headers. Due to HTTP coding restrictions, non-ASCII characters cannot be sent. The SDK encodes the CJK characters in the header field using a URL and then sends the encoded data. For example, if content-disposition is set to attachment; filename="CJK characters.txt", the information stored in the object metadata is attachment; filename="%E4%B8%AD%E6%96%87.txt". When you use a browser to access the object metadata, the browser automatically decodes the data. Value range: true: Encoding with SDK is enabled. false: Encoding with SDK is disabled. Default value: true |
| needCalculateCRC64 | boolean | No | Explanation: Whether to automatically calculate the CRC64 value of the data to be uploaded and submit the CRC64 value to the server for verification. Restrictions: This parameter is not supported for POSIX or SFS objects. Value range: true: The SDK calculates CRC64 and submits it to the server for verification. false: CRC64 is not calculated. Default value: false |
| Method | Return Value | Type | Description |
|---|---|---|---|
| onSuccess | void | result (generic) | Called if the request is completed successfully. |
| onException | void | ObsException, request (generic) | Called if the request failed. The exception and corresponding request information are returned. |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| contentLength | Long | No | Explanation: Object size. Restrictions:
Default value: If this parameter is not specified, the SDK automatically calculates the size of the object. |
| contentType | String | No | Explanation: MIME type of the object. MIME type is a standard way of describing a data type and is used by the browser to decide how to display data. Value range: For details about common content types (MIME), see What Is Content-Type (MIME)? Default value: If this parameter is not specified, the SDK determines the file type based on the suffix of the object name and assigns a value to the parameter. For example, if the suffix of the object name is .xml, the object is an application/xml file. If the suffix is .html, the object is a text/html file. |
| contentEncoding | String | No | Explanation: Content-Encoding header in the response. It specifies which encoding format is applied to the object. Default value: None |
| contentDisposition | String | No | Explanation: Provides a default file name for the requested object. When the object with the default file name is being downloaded or accessed, the content is displayed as part of a web page in the browser or as an attachment in a download dialog box. Default value: None |
| cacheControl | String | No | Explanation: Cache-Control header in the response. It specifies the cache behavior of the web page when an object is downloaded. Default value: None |
| contentLanguage | String | No | Explanation: Language or language combination for visitors to customize and use. For details, see the definition of ContentLanguage in the HTTP protocol. Default value: None |
| expires | String | No | Explanation: The time a cached web page object expires. Restrictions: The time must be in the GMT format. Default value: None |
| storageClass | No | Explanation: Storage class of an object that can be specified at object creation. If you do not specify this header, the object inherits the storage class of the bucket. Value range: See Table 11. Default value: None | |
| webSiteRedirectLocation | String | No | Explanation: If the bucket is configured with website hosting, the request for obtaining the object can be redirected to another object in the bucket or an external URL. This parameter specifies the address the request for the object is redirected to. To another object in the same bucket: WebsiteRedirectLocation:/anotherPage.html To an external URL: WebsiteRedirectLocation:http://www.example.com/ Restrictions:
Default value: None |
| nextPosition | long | No | Explanation: Start position for the next append upload. Value range: 0 to the object length, in bytes. Default value: None |
| appendable | boolean | No | Explanation: Whether the object is appendable. Value range: true: The object is appendable. false: The object is not appendable. Default value: None |
| userMetadata | Map<String, Object> | No | Explanation: User-defined metadata of the object. To define it, you can add a header starting with x-obs-meta- in the request. In Map, the String key indicates the name of the user-defined metadata that starts with x-obs-meta-, and the Object value indicates the value of the user-defined metadata. To obtain the user-defined metadata of an object, use ObsClient.getObjectMetadata. For details, see Obtaining Customized Metadata. Restrictions:
Default value: None |
| Constant | Description |
|---|---|
| AccessControlList.REST_CANNED_PRIVATE | Private read/write. A bucket or object can only be accessed by its owner. |
| AccessControlList.REST_CANNED_PUBLIC_READ | Public read. If this permission is granted on a bucket, anyone can read the object list, multipart uploads, bucket metadata, and object versions in the bucket. If this permission is granted on an object, anyone can read the content and metadata of the object. |
| AccessControlList.REST_CANNED_PUBLIC_READ_WRITE | Public read/write. If this permission is granted on a bucket, anyone can read the object list, multipart uploads, and bucket metadata, and can upload or delete objects, initiate multipart uploads, upload parts, assemble parts, copy parts, and abort multipart upload tasks. If this permission is granted on an object, anyone can read the content and metadata of the object. |
| AccessControlList.REST_CANNED_PUBLIC_READ_DELIVERED | Public read on a bucket as well as objects in the bucket. If this permission is granted on a bucket, anyone can read the object list, multipart tasks, and bucket metadata, and can also read the content and metadata of the objects in the bucket. This permission cannot be granted on objects. |
| AccessControlList.REST_CANNED_PUBLIC_READ_WRITE_DELIVERED | Public read/write on a bucket as well as objects in the bucket. If this permission is granted on a bucket, anyone can read the object list, multipart uploads, and bucket metadata, and can upload or delete objects, initiate multipart upload tasks, upload parts, assemble parts, copy parts, and abort multipart uploads. They can also read the content and metadata of the objects in the bucket. This permission cannot be granted on objects. |
| AccessControlList.REST_CANNED_BUCKET_OWNER_FULL_CONTROL | If this permission is granted on an object, only the bucket and object owners have the full control over the object. By default, if you upload an object to a bucket owned by another user, the bucket owner does not have the permissions on your object. After you grant this permission to the bucket owner, the bucket owner can have full control over your object. For example, if user A uploads object x to user B's bucket, user B does not have control over object x. If user A sets bucket-owner-full-control for object x, user B then has control over object x. |
| Parameter | Type | Mandatory (Yes/No) | Type |
|---|---|---|---|
| owner | Owner | No | Explanation: Bucket owner information. For details, see Table 12. |
| delivered | boolean | No | Explanation: Whether the bucket ACL is applied to all objects in the bucket. Value range: true: The bucket ACL is applied to all objects in the bucket. false: The bucket ACL is not applied to any objects in the bucket. Default value: false |
| grants | Set<GrantAndPermission> | No | Explanation: Grantee information. For details, see Table 13. |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| encryption | Yes | Explanation: SSE-KMS is used for encrypting objects on the server side. Value range: kms. For details, see #obs_26_0415/table7501577412. Default value: None | |
| sseAlgorithm | No | Explanation: Encryption algorithm. Restrictions: Only KMS is supported. Value range: For details, see Table 17. Default value: None | |
| kmsKeyId | String | No | Explanation: ID of the KMS master key when SSE-KMS is used. Value range: Valid value formats are as follows:
In the preceding formats:
Default value:
|
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| algorithm | Yes | Explanation: SSE-C is used for encrypting objects on the server side. Value range: AES256, indicating AES is used to encrypt the object in SSE-C. For details, see Table 18. Default value: None | |
| sseAlgorithm | No | Explanation: Encryption algorithm. Restrictions: Only AES256 is supported. Value range: For details, see Table 17. Default value: None | |
| sseCKey | byte[] | Yes | Explanation: Key used for encrypting the object when SSE-C is used, in byte[] format. Default value: None |
| sseCKeyBase64 | String | No | Explanation: Base64-encoded key used for encrypting the object when SSE-C is used. Default value: None |
| Constant | Description |
|---|---|
| GRANT_READ | Grants a specific tenant the permissions to read the object and object metadata. |
| GRANT_READ_ACP | Grants a specific tenant the permissions to obtain the object ACL. |
| GRANT_WRITE_ACP | Grants a specific tenant the permissions to write the object ACL. |
| GRANT_FULL_CONTROL | Grants a specific tenant the permissions to read the content, metadata, and ACL of the object and write the object ACL. |
| Method | Return Value Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| void | Yes | Explanation: Used for obtaining the progress. For details, see Table 19. Default value: None |
| Constant | Default Value | Description |
|---|---|---|
| STANDARD | STANDARD | Standard storage class. |
| WARM | WARM | Infrequent Access storage class. |
| COLD | COLD | Archive storage class. |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| id | String | Yes | Explanation: Account (domain) ID of the bucket owner. Value range: To obtain an account ID, see How Do I Get My Account ID and User ID? Default value: None |
| displayName | String | No | Explanation: Account name of the owner. Value range: To obtain an account name, see How Do I Obtain an Account Name? Default value: None |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| grantee | CanonicalGrantee or GroupGrantee | Yes | Explanation: Grantees (users or user groups). Value range: Grantee (user) information. For details, see Table 14. Grantee (user group) information. For details, see Table 15. |
| permission | Permission | Yes | Explanation: Permissions to grant. Value range: For details, see Table 16. Default value: None |
| delivered | boolean | No | Explanation: Whether the bucket ACL is applied to all objects in the bucket. Value range: true: The bucket ACL is applied to all objects in the bucket. false: The bucket ACL is not applied to any objects in the bucket. Default value: false |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| grantId | String | Yes if Type is set to a user | Explanation: Account (domain) ID of the grantee. Value range: To obtain an account ID, see How Do I Get My Account ID and User ID? Default value: None |
| displayName | String | No | Explanation: Account name of the grantee. Value range: To obtain an account name, see How Do I Obtain an Account Name? Default value: None |
| Constant | Description |
|---|---|
| ALL_USERS | All users. |
| AUTHENTICATED_USERS | Authorized users. This constant is deprecated. |
| LOG_DELIVERY | Log delivery group. This constant is deprecated. |
| Constant | Default Value | Description |
|---|---|---|
| PERMISSION_READ | READ | Read permission. A grantee with this permission for a bucket can obtain the list of objects, multipart uploads, bucket metadata, and object versions in the bucket. A grantee with this permission for an object can obtain the object content and metadata. |
| PERMISSION_WRITE | WRITE | Write permission. A grantee with this permission for a bucket can upload, overwrite, and delete any object or part in the bucket. This permission is not available for objects. |
| PERMISSION_READ_ACP | READ_ACP | Permission to read an ACL. A grantee with this permission can obtain the ACL of a bucket or object. A bucket or object owner has this permission for their bucket or object by default. |
| PERMISSION_WRITE_ACP | WRITE_ACP | Permission to modify an ACL. A grantee with this permission can update the ACL of a bucket or object. A bucket or object owner has this permission for their bucket or object by default. This permission allows the grantee to change the access control policies, meaning the grantee has full control over a bucket or object. |
| PERMISSION_FULL_CONTROL | FULL_CONTROL | Full control access, including read and write permissions for a bucket and its ACL, or for an object and its ACL. A grantee with this permission for a bucket has READ, WRITE, READ_ACP, and WRITE_ACP permissions for the bucket. A grantee with this permission for an object has READ, READ_ACP, and WRITE_ACP permissions for the object. |
| Parameter | Type | Mandatory (Yes/No) | Description |
|---|---|---|---|
| status | Yes | Explanation: Progress data. For details, see Table 20. Default value: None |
| Method | Return Value Type | Description |
|---|---|---|
| getAverageSpeed() | double | Average upload speed, in byte/s. |
| getInstantaneousSpeed() | double | Instantaneous upload speed, in byte/s. |
| getTransferPercentage() | int | Upload progress, in percentage. |
| getNewlyTransferredBytes() | long | Number of new bytes, in bytes. |
| getTransferredBytes() | long | Number of bytes that have been transmitted, in bytes. |
| getTotalBytes() | long | Number of bytes to be transmitted, in bytes. |
Responses
| Method | Return Value | Type | Description |
|---|---|---|---|
| isTaskFinished | boolean | None | Whether the task is finished. |
| waitUntilFinished | void | None | Blocks the current thread and waits until the asynchronous upload completes. |
| cancel | boolean | None | Cancels an asynchronous upload. If the upload was successfully canceled, true is returned; otherwise, false is returned. |
| getResult | java.util.Optional | None | Blocks the current thread and waits until the asynchronous upload completes before returning the result. If the upload failed, the value of Optional.isPresent() is false. |
| Parameter | Type | Description |
|---|---|---|
| statusCode | int | Explanation: HTTP status code. Value range: A status code is a group of digits indicating the status of a response. It ranges from 2xx (indicating successes) to 4xx or 5xx (indicating errors). For more information, see Status Code. Default value: None |
| responseHeaders | Map<String, Object> | Explanation: Response header list, composed of tuples. In a tuple, the String key indicates the name of the header, and the Object value indicates the value of the header. Default value: None |
| bucketName | String | Explanation: Bucket name. Restrictions:
Default value: None |
| objectKey | String | Explanation: Object name. An object is uniquely identified by an object name in a bucket. An object name is a complete path that does not contain the bucket name. For example, if the address for accessing the object is examplebucket.obs.ap-southeast-1.myhuaweicloud.com/folder/test.txt, the object name is folder/test.txt. Value range: The value can contain 1 to 1,024 characters. Default value: None |
| etag | String | Explanation: ETag of an object, which is a Base64-encoded 128-bit MD5 digest. ETag is the unique identifier of the object content. It can be used to determine whether the object content is changed. For example, if the ETag is A when an object is uploaded and is B when the object is downloaded, the object content is changed. The ETag reflects changes only to the contents of the object, not its metadata. An object created by an upload or copy operation has a unique ETag. Restrictions: If an object is encrypted using server-side encryption, the ETag is not the MD5 value of the object. Value range: The value must contain 32 characters. Default value: None |
| versionId | String | Explanation: Object version ID. If versioning is enabled for the bucket, the object version ID will be returned. Value range: The value must contain 32 characters. Default value: None |
Code Examples
- The API for resumable upload, which is implemented based on multipart upload, is an encapsulated and enhanced version of multipart upload.
- The resumable upload interface helps save resources and improve efficiency by restarting an upload from the point of failure and concurrently uploading parts. You do not need to worry about internal service details, such as the creation and deletion of checkpoint files, division of objects, or concurrent uploads of parts.
- The default value of the enableCheckpoint parameter is false, which indicates that the resumable upload mode is disabled. In this case, this API degrades to the simple encapsulation of multipart upload, and no checkpoint file will be generated.
- checkpointFile and enableCheckSum apply only when enableCheckpoint is true.
- Due to HTTP coding restrictions, non-ASCII characters cannot be sent. If your request headers contain full-width characters, the SDK will URL encode these characters before sending the request. When you use a browser to access the data, the browser automatically decodes those encoded characters.
- If you do not need the SDK to decode for you, call UploadFileRequest.setIsEncodeHeaders(false) to disable auto encoding.
- Resumable upload currently cannot be paused or canceled.
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot