DLI Delta FAQ

When Executing insert into/overwrite table_name partition(part_key='part_value') select ..., Error DLI.0005: DeltaAnalysisException: Partition column 'dt' not found in schema [id, name] Occurs

Root cause analysis: The syntax insert into/overwrite table_name partition(part_key='part_value') is not supported.

When Executing SQL, Error DLI.0005: There should be at least one partition pruning predicate on partitioned table '777dd'.'test_delta_parts1' Occurs

Solution: Add the parameter spark.sql.forcePartitionPredicatesOnPartitionedTable.enabled set to false in the console settings.

When Using show create table to View the Table Creation Statement, Error DLI.0005: Operation not allowed: 'SHOW CREATE TABLE' is not supported for Delta tables Occurs

Root cause analysis: This syntax is not supported. You can run describe formatted to view the table structure.

When Executing Vacuum, Error DLI.0001: IllegalArgumentException: requirement failed: Are you sure you would like to vacuum files with such a low retention period? Occurs

Root cause analysis: The RETAIN period is too short (less than 168 hours). You need to check whether the data before this time can be cleaned, as you will no longer be able to view versions created before the specified data retention period. To confirm the cleanup, add the parameter spark.databricks.delta.retentionDurationCheck.enabled set to false in the console settings.

When Executing rename/drop column, Error DLI.0005: DeltaAnalysisException: Column rename is not supported for your Delta table... Occurs

Solution: Execute the following statements first, then perform the rename:

ALTER TABLE delta_perms1 SET TBLPROPERTIES (

'delta.columnMapping.mode' = 'name',

'delta.minReaderVersion' = '2',

'delta.minWriterVersion' = '5');