Why Do DistCp Commands Fail to Run in a Security Cluster and What Should I Do When Exceptions Are Thrown?
Question
DistCp commands fail to run in a security cluster and exceptions are thrown.
The following client exception is reported:
Invalid arguments:Unexpected end of file from server
The following server exception is reported:
javax.net.ssl.SSLException:Unrecognized SSL message, plaintext connection?
Answer
When a user uses webhdfs:// in a DistCp command, the preceding exceptions are thrown because the cluster uses HTTPS, that is, the dfs.http.policy value in the hdfs-site.xml file configured in Client installation directory/HDFS/hadoop/etc/hadoop is HTTPS_ONLY. To avoid this exception, replace webhdfs:// with swebhdfs://.
For example:
./hadoop distcp swebhdfs://IP:PORT/testfile hdfs://IP:PORT/testfile1
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot
