DLI Delta FAQ

Updated on 2025-01-09 GMT+08:00

View PDF

When Executing insert into/overwrite table_name partition(part_key='part_value') select ..., Error DLI.0005: DeltaAnalysisException: Partition column 'dt' not found in schema [id, name] Occurs

Root cause analysis: The syntax insert into/overwrite table_name partition(part_key='part_value') is not supported.

When Executing SQL, Error DLI.0005: There should be at least one partition pruning predicate on partitioned table '777dd'.'test_delta_parts1' Occurs

Solution: Add the parameter spark.sql.forcePartitionPredicatesOnPartitionedTable.enabled set to false in the console settings.

When Using show create table to View the Table Creation Statement, Error DLI.0005: Operation not allowed: 'SHOW CREATE TABLE' is not supported for Delta tables Occurs

Root cause analysis: This syntax is not supported. You can run describe formatted to view the table structure.

When Executing Vacuum, Error DLI.0001: IllegalArgumentException: requirement failed: Are you sure you would like to vacuum files with such a low retention period? Occurs

Root cause analysis: The RETAIN period is too short (less than 168 hours). You need to check whether the data before this time can be cleaned, as you will no longer be able to view versions created before the specified data retention period. To confirm the cleanup, add the parameter spark.databricks.delta.retentionDurationCheck.enabled set to false in the console settings.

When Executing rename/drop column, Error DLI.0005: DeltaAnalysisException: Column rename is not supported for your Delta table... Occurs

Solution: Execute the following statements first, then perform the rename:

ALTER TABLE delta_perms1 SET TBLPROPERTIES (

'delta.columnMapping.mode' = 'name',

'delta.minReaderVersion' = '2',

'delta.minWriterVersion' = '5');

Previous topic: Typical Delta Configurations

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.

Chatbot