Help Center> ModelArts> FAQs> General Issues> How Do I Upload Data to OBS?
View PDF

How Do I Upload Data to OBS?

Before using ModelArts to develop AI models, data needs to be uploaded to an OBS bucket. You can log in to the OBS console to create an OBS bucket, create a folder, and upload data. For details about how to upload data, see Object Storage Service Getting Started.

  • ModelArts is deployed in CN North-Beijing1, CN North-Beijing4, CN East-Shanghai1, or CN South-Guangzhou. When creating an OBS bucket, ensure that the OBS bucket and ModelArts are in the same region.
  • You are advised to use OBS based on your service requirements and habits.
    • If your data volume is small (less than 100 MB) or the number of data files is small (less than 100), you are advised to upload data using the console. You do not need to download tools or perform unnecessary configurations when uploading data using the console, which is more convenient and efficient when you upload a small amount of data.
    • If your data volume is large or the number of data files is large, you are advised to upload the files using OBS Browser+ or obsutil. OBS Browser+ is a graphical tool that provides complete functions for managing your buckets and objects in OBS. You are advised to use this tool to create buckets or upload objects. obsutil is a command line tool for accessing and managing OBS resources. If you are familiar with command line interface (CLI), obsutil is recommended as an ideal tool for batch processing and automated tasks.
    • If you need to use APIs or SDKs to upload data, or you are accustomed to using APIs and SDKs, you are advised to use OBS APIs or SDKs to create buckets and upload objects.

    The preceding describes only the common usage methods and tools of OBS. For details about more OBS tools, see the Object Storage Service Tools Guide.

Creating a Bucket

A bucket is a container for storing objects in OBS. Before uploading an object, create a bucket. You can select different tools to create buckets in OBS according to your habits and service scenarios.

Table 1 Creating a bucket using different methods

Method of Access

How to Create a Bucket

OBS Console

Creating a bucket using OBS Console

OBS Browser+

Creating a bucket using OBS Browser+

obsutil

Creating a bucket using obsutil

SDK

Creating a bucket using SDKs. For details, see the section about bucket creation in the developer guide of each language.

API

Creating a bucket using APIs

Uploading an Object

After a bucket is created, you can upload files to the bucket in various ways. Then, OBS stores the files in the bucket as objects.

Table 2 Uploading an object using different methods of access

Method of Access

How to Upload an Object

OBS Console

Uploading an object using OBS Console

OBS Browser+

Uploading an object using OBS Browser+

obsutil

Uploading an object using obsutil

SDK

Uploading an object using SDKs. For details, see the section about object uploading in the developer guide of each language.

API

Uploading objects - PUT and Uploading objects - POST
Parent topic: General Issues