Help Center> MapReduce Service> Component Operation Guide (LTS)> Using Saprk/Spark2x> Common Issues About Spark2x> What Should I Do If Recycle Bin Version I Set on the Spark Client Does Not Take Effect?

Updated on 2024-05-29 GMT+08:00

View PDF

What Should I Do If Recycle Bin Version I Set on the Spark Client Does Not Take Effect?

Symptom

The setting of fs.obs.hdfs.trash.version=1 on the Spark client did not take effect. After table was dropped, the path for storing files in the recycle bin remained unchanged.

If fs.obs.hdfs.trash.version is set to 2, the recycle bin path is /user/.Trash/${userName}/Current.
If fs.obs.hdfs.trash.version is set to 1, the recycle bin path is /user/${userName}/.Trash/Current.

Procedure

Log in to FusionInsight Manager and choose Cluster > Services > Hive, click Configurations > All Configurations, and select MetaStore (Role) > Customization. On the displayed page, set hive.metastore.customized.configs. Set fs.obs.hdfs.trash.version to 1, save the settings, and restart the Metastore instance.

Click to enlarge

After Hive Metastore is configured, the recycle bin path is correct.

Click to enlarge

Parent topic: Common Issues About Spark2x

Previous topic: How Do I Use Special Characters with TIMESTAMP and DATE?

Next topic: How Do I Change the Log Level to INFO When Using Spark yarn-client?

Feedback

Was this page helpful?

Helpful Not helpful

Provide feedback

Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.

The system is busy. Please try again later.

Which of the following issues have you encountered?

Content is inconsistent with the product UI

Unclear descriptions

Lack of examples or code

Incorrect steps

Can't find what I need

Lack of best practices

Feedback (optional)

0/500

Select at least one type of issue, and enter your comments or suggestions.

Enter a maximum of 500 characters.

Submit Cancel

For any further questions, feel free to contact us through the chatbot.