Help Center/ MapReduce Service/ User Guide (Kuala Lumpur Region)/ Overview/ Components/ Loader/ Loader Enhanced Open Source Features
Updated on 2022-12-14 GMT+08:00
View PDF
Share

Loader Enhanced Open Source Features

Loader Enhanced Open-Source Feature: Data Import and Export

Loader is developed based on Sqoop. In addition to the Sqoop functions, Loader has the following enhanced features:

  • Provides data conversion functions.
  • Supports GUI-based configuration conversion.
  • Imports data from an SFTP/FTP server to HDFS/OBS.
  • Imports data from an SFTP/FTP server to an HBase table.
  • Imports data from an SFTP/FTP server to a Phoenix table.
  • Imports data from an SFTP/FTP server to a Hive table.
  • Exports data from HDFS/OBS to an SFTP/FTP server.
  • Exports data from an HBase table to an SFTP/FTP server.
  • Exports data from a Phoenix table to an SFTP/FTP server.
  • Imports data from a relational database to an HBase table.
  • Imports data from a relational database to a Phoenix table.
  • Imports data from a relational database to a Hive table.
  • Exports data from an HBase table to a relational database.
  • Exports data from a Phoenix table to a relational database.
  • Imports data from an Oracle partitioned table to HDFS/OBS.
  • Imports data from an Oracle partitioned table to an HBase table.
  • Imports data from an Oracle partitioned table to a Phoenix table.
  • Imports data from an Oracle partitioned table to a Hive table.
  • Exports data from HDFS/OBS to an Oracle partitioned table.
  • Exports data from HBase to an Oracle partitioned table.
  • Exports data from a Phoenix table to an Oracle partitioned table.
  • Imports data from HDFS to an HBase table, a Phoenix table, and a Hive table in the same cluster.
  • Exports data from an HBase table and a Phoenix table to HDFS/OBS in the same cluster.
  • Imports data to an HBase table and a Phoenix table by using bulkload or put list.
  • Imports all types of files from an SFTP/FTP server to HDFS. The open source component Sqoop can import only text files.
  • Exports all types of files from HDFS/OBS to an SFTP server. The open source component Sqoop can export only text files and SequenceFile files.
  • Supports file coding format conversion during file import and export. The supported coding formats include all formats supported by Java Development Kit (JDK).
  • Retains the original directory structure and file names during file import and export.
  • Supports file combination during file import and export. For example, if a large number of files are to be imported, these files can be combined into n files (n can be configured).
  • Supports file filtering during file import and export. The filtering rules support wildcards and regular expressions.
  • Supports batch import and export of ETL tasks.
  • Supports query by page and key word and group management of ETL tasks.
  • Provides floating IP addresses for external components.
Parent topic: Loader