Help Center>
MapReduce Service>
FAQs>
Peripheral Ecosystem Interconnection>
How Do I Use PySpark to Connect MRS Spark?
Updated on 2023-10-19 GMT+08:00
How Do I Use PySpark to Connect MRS Spark?
Question: How do I use pyspark on an ECS to connect an MRS Spark cluster with Kerberos authentication enabled on the Intranet?
Answer: Change the value of spark.yarn.security.credentials.hbase.enabled in the spark-defaults.conf file of Spark to true and use spark-submit --master yarn --keytab keytabfile --principal principal command to specify the Kerberos authentication file.
Parent topic: Peripheral Ecosystem Interconnection
Peripheral Ecosystem Interconnection FAQs
- Does MRS Support Read and Write Operations on DLI Service Tables?
- Does OBS Support the ListObjectsV2 Protocol?
- Can a Crawler Service Be Deployed on Nodes in an MRS Cluster?
- Does MRS Support Secure Deletion?
- How Do I Use PySpark to Connect MRS Spark?
- Why Mapped Fields Do not Exist in the Database After HBase Synchronizes Data to CSS?
- Can MRS Connect to an External KDC?
- What Can I Do If Jetty Is Incompatible with MRS when Open-Source Kylin 3.x Is Interconnected with MRS 1.9.3?
- What Should I Do If Data Failed to Be Exported from MRS to an OBS Encrypted Bucket?
- How Do I Interconnect MRS with LTS?
- How Do I Install HSS on MRS Cluster Nodes?
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
The system is busy. Please try again later.
For any further questions, feel free to contact us through the chatbot.
Chatbotmore
