Help Center/ MapReduce Service/ FAQs/ Kerberos Usage/ How Do I Access Spark in a Cluster with Kerberos Authentication Enabled?
Updated on 2022-12-12 GMT+08:00
View PDF

How Do I Access Spark in a Cluster with Kerberos Authentication Enabled?

  1. Log in to the master node in the cluster as user root.
  2. Run the following command to configure environment variables:

    source /opt/client/bigdata_env

  3. If the Kerberos authentication is enabled for the current cluster, run the following command to authenticate the user.

    kinit MRS cluster user

    Example:

    If the development user is a machine-machine user, run kinit -kt user.keytab sparkuser.

    If the development user is a human-machine user, run kinit sparkuser.

  4. Run the following command to connect to Spark Beeline:

    spark-beeline

  5. Run commands on Spark Beeline. For example, create the table test in the obs://mrs-word001/table/ directory.

    create table test(id int) location 'obs://mrs-word001/table/';

  6. Run the following command to query all tables. If table test is displayed in the command output, OBS access is successful.
    show tables;
    Figure 1 Returned table name
  7. Press Ctrl+C to exit Spark Beeline.
Parent topic: Kerberos Usage