Help Center/ MapReduce Service/ FAQs/ Client Usage/ How Do I Connect to Spark Beeline from MRS?
Updated on 2024-08-16 GMT+08:00
View PDF
Share

How Do I Connect to Spark Beeline from MRS?

  1. Log in to the master node in the cluster as user root.
  2. Run the following command to configure environment variables:

    source Client installation directory/bigdata_env

  3. If Kerberos authentication is enabled for the cluster, authenticate the user. If Kerberos authentication is disabled, skip this step.

    Run the kinit MRS cluster user command.

    Examples:

    • For a machine-machine user, run the kinit -kt user.keytab sparkuser command.
    • For a human-machine user, run the kinit sparkuser command.
  4. Run the following command to connect to Spark Beeline:

    spark-beeline

  5. Run commands on Spark Beeline. For example, create the table test in the obs://mrs-word001/table/ directory.

    create table test(id int) location 'obs://mrs-word001/table/';

  6. Query all tables.

    show tables;

    If the table test is displayed in the command output, OBS is successfully accessed.

    Figure 1 Returned table name
  7. Press Ctrl+C to exit the Spark Beeline.
Parent topic: Client Usage