Help Center/ MapReduce Service/ User Guide (Kuala Lumpur Region)/ FAQs/ Big Data Service Development/ How Do I Connect to Spark Shell from MRS?
Updated on 2022-08-12 GMT+08:00
View PDF
Share

How Do I Connect to Spark Shell from MRS?

  1. Log in to the Master node in the cluster as user root.
  2. Run the following command to configure environment variables:

    source /opt/client/bigdata_env

  3. If Kerberos authentication is enabled for the cluster, authenticate the user. If Kerberos authentication is disabled, skip this step.

    Command: kinit MRS cluster user

    Example:

    • If the user is a machine-machine user, run kinit -kt user.keytab sparkuser.
    • If the user is a human-machine user, run kinit sparkuser.
  4. Run the following command to connect to Spark shell:

    spark-shell