FileSystem Source Table

Function

This section describes the definition of the FileSystem source table, parameters used for creating the source table, and sample code.

Prerequisites

To create a FileSystem source table, an enhanced datasource connection is required. You can set security group rules as required when you configure the connection.

For details about how to create an enhanced datasource connection, see Enhanced Datasource Connections in the Data Lake Insight User Guide.
For details about how to configure security group rules, see Security Group in the Virtual Private Cloud User Guide.

Important Notes

When you create a Flink OpenSource SQL job, set Flink Version to 1.12 in the Running Parameters tab. Select Save Job Log, and specify the OBS bucket for saving job logs.
For details about how to use data types, see section Format.

Syntax

    
         create table dataGenSource(
   amount int
) with (
   'connector' = 'filesystem',
   'path' = 'obs://longyuan/source-files',
   'format' = 'csv'
);

Parameters

**Table 1** Parameter description
Parameter	Mandatory	Default Value	Type	Description
connector	Yes	None	String	The value is fixed at filesystem.
path	Yes	None	String	OBS path
format	Yes	None	String	File format Available values are: csv and parquet