How Do I Handle Special Characters in Hudi Partitioned Columns?
Question
In a Hudi partitioned table, if a partition column value contains special characters, for example colons (:), the write operation will fail. The following error information is displayed:
2026-04-23 15:13:48,615 | ERROR | task-result-getter-1 | Task 0 in stage 122.0 failed 4 times; aborting job | org.apache.spark.scheduler.TaskSetManager.logError(Logging.scala:76) 2026-04-23 15:13:48,621 | WARN | main | Closing write client | org.apache.hudi.HoodieSparkSqlWriterInternal.handleWriteClientClosure(HoodieSparkSqlWriter.scala:752) Job aborted due to stage failure: Task 0 in stage 122.0 failed 4 times, most recent failure: Lost task 0.3 in stage 122.0 (TID 717) (52-190-2-29 executor 4): java.lang.RuntimeException: org.apache.hudi.exception.HoodieException: org.apache.hudi.exception.HoodieException: java.lang.IllegalArgumentException: java.net.URISyntaxException: Illegal character in scheme name at index 3: par=aa:aa
Answer
When you create a Hudi partitioned table, the partition column must not contain special characters, such as colons (:), commas (,), hyphens (-), or question marks (?).
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot