Preparing a Spark Application Running Environment

Scenario

The operating environment (client) of Spark can be deployed on Linux only. Perform the following operations to prepare the operating environment.

Preparing a Running and Commissioning Environment

1. On the ECS management console, apply for a new ECS for application running and commissioning.
   • The security group of the ECS must be the same as that of the master node in an MRS cluster.
   • The ECS and the MRS cluster must be in the same VPC.
   • The ECS network interface controller (NIC) and the MRS cluster must be in the same network segment.

2. Apply for an EIP, bind it, and configure an inbound or outbound rule for the security group.
3. Download the client program. For details, see Downloading an MRS Client.
4. Log in to the client to download the target node and install a cluster client as user root.
   1. Run the following command to decompress the client package:

      tar -xvf /opt/MRS_Services_Client.tar

   2. Run the following command to verify the installation file package:
      sha256sum -c /opt/MRS_Services_ClientConfig.tar.sha256

      MRS_Services_ClientConfig.tar:OK

   3. Run the following command to decompress the installation file package:

      tar -xvf MRS_Services_ClientConfig.tar

   4. Run the following command to install the client to a specified directory (absolute path), for example, /opt/client. The directory is automatically created.

      cd /opt/MRS_Services_ClientConfig

      sh install.sh /opt/client

      Components client installation is complete.