Updated on 2024-10-09 GMT+08:00

Restrictions on Using Hudi SQL

Hudi supports the DDL/DML syntax of using Spark SQL, making it easier for all users (non-engineers and analysts) to access and operate Hudi.

Constraints

  • You can use Spark SQL to operate Hudi on the Hudi client.
  • You can use Spark SQL to operate Hudi in JDBCServer of Spark2x.
  • The Spark2x client does not support Spark SQL operations. The Spark3.1.1 or later client support Spark SQL operations.
  • You cannot write data to Hudi tables or modify the Hudi table structure in Hive and Hetu engines. Only read operations are supported.
  • The default value of KeyGenerator in SQL is org.apache.hudi.keygen.ComplexKeyGenerator. Therefore, you need to set the KeyGenerator value to that of SQL when data is written in DataSource mode.