Updated on 2023-12-20 GMT+08:00

Process

Figure 1 shows the process of using OBS to decouple storage from compute in big data scenarios.

Figure 1 Process of using OBS to enable decoupled storage and compute
  1. Connect big data platforms to OBS. This step is the core, which makes OBS the unified data lake storage. This connection guide covers three mainstream big data platforms. For details, see Supported Big Data Platforms.
  2. (Optional) Connect open-source big data components to OBS. For details, Supported Big Data Components.
  3. (Optional) If your data is still stored in local HDFS, migrate it to OBS on Huawei Cloud. For details, see Migrating HDFS Data to OBS.