Updated on 2023-08-03 GMT+08:00

Constraints

Hudi supports the DDL/DML syntax of using Spark SQL, making it easier for all users (non-engineers and analysts) to access and operate Hudi.

Constraints

  • You can use Spark SQL to operate Hudi on the Hudi client.
  • You can use Spark SQL to operate Hudi in JDBCServer of Spark2x.
  • You can use Spark SQL to operate Hudi on the Spark3.1.1 or later client.
  • You cannot write data to Hudi tables or modify the Hudi table structure in Hive and Hetu engines. Only read operations are supported.
  • The default value of KeyGenerator in SQL is org.apache.hudi.keygen.ComplexKeyGenerator. Therefore, you need to set the KeyGenerator value to that of SQL when data is written in DataSource mode.