How Do I Use PySpark to Connect MRS Spark?

Question:

How Do I Use PySpark on an ECS to Connect to an MRS Spark Cluster with Kerberos Authentication Enabled on the Intranet?

Answer:

Change the value of spark.yarn.security.credentials.hbase.enabled in the spark-defaults.conf file of Spark to true and use the spark-submit --master yarn --keytab keytabfile --principal principal command to specify the Kerberos authentication file.