Help Center/ Cloud Data Migration/ Best Practices/ Simplified Migration of Trade Data to the Cloud and Analysis/ Analyzing Data
Updated on 2024-08-30 GMT+08:00
View PDF
Share

Analyzing Data

Use DLI to analyze the trade statistics stored in OBS buckets.

Prerequisites

When creating an OBS foreign table on DLI, the data storage format of the OBS table must meet the following requirements:
  • When you use the DataSource syntax to create an OBS table, the ORC, Parquet, JSON, CSV, Carbon, and Avro formats are supported.
  • When you use the Hive syntax to create an OBS table, the Text file, Avro, ORC, SequenceFile, RCFile, Parquet, Carbon formats are supported.

If the storage format of the raw data table does not meet the requirements, you can use CDM to import the raw data to DLI for analysis without uploading the data to OBS.

Procedure

  1. Log in to the DLI console and create a database by referring to Creating a Database.
  2. Create an OBS foreign table by referring to Creating an OBS Table, including the trade statistics database, trade detail record table, and basic information table.
  3. Develop SQL scripts on the DLI console for trade statistics analysis to meet service requirements.