Help Center > > Developer Guide> Data Export> Using GDS to Export Data to a Remote Server> Exporting Data In Parallel Using GDS

Exporting Data In Parallel Using GDS

Updated at: Sep 17, 2021 GMT+08:00

In high-concurrency scenarios, you can use GDS to export data from a database to a common file system.


Using foreign tables: A GDS foreign table specifies the exported file format and export mode. Data is exported in parallel through multiple DNs from the database to data files, which improves the overall data export performance. The data files cannot be directly exported to HDFS.
  • The CN only plans data export tasks and delivers the tasks to DNs. In this case, the CN is released to process other tasks.
  • In this way, the computing capabilities and bandwidths of all the DNs are fully leveraged to export data.
    Figure 1 Exporting data using foreign tables

Related Concepts

  • Data file: A TEXT, CSV, or FIXED file that stores data exported from the GaussDB(DWS) database.
  • Foreign table: A table that stores information, such as the format, location, and encoding format of a data file.
  • GDS: A data service tool. To export data, deploy it on the server where data files are stored.
  • Table: Tables in the database, including row-store tables and column-store tables. Data in the data files is exported from these tables.
  • Remote mode: Service data in a cluster is exported to hosts outside the cluster.

Exporting a Schema

Data can be exported to GaussDB(DWS) in Remote mode.

  • Remote mode: Service data in a cluster is exported to hosts outside the cluster.
    • In this mode, multiple GDSs are used to concurrently export data. One GDS can export data for only one cluster at a time.
    • The data export rate of a GDS that resides on the same intranet as cluster nodes is limited by the network bandwidth. A 10GE configuration is recommended.
    • Data files in TEXT or CSV format are supported. The size of data in a single row must be less than 1 GB.

Data Export Process

Figure 2 Concurrent data export

Table 1 Process description




Plan data export.

Prepare data to be exported and plan the export path for the mode to be selected.

For details, see Planning Data Export.


Start GDS.

If the Remote mode is selected, install, configure, and start GDS on data servers.

For details, see Installing, Configuring, and Starting GDS.


Create a foreign table,

Create a foreign table to help GDS specify information about a data file. The foreign table stores information, such as the location, format, encoding, and inter-data delimiter of a data file.

For details, see Creating a GDS Foreign Table.


Export data.

After the foreign table is created, run the INSERT statement to efficiently export data to data files.

For details, see Exporting Data.


Stop GDS.

Stop GDS after data is exported.

For details, see Stopping GDS.


Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?

Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel