Agent Management

If your data is stored in HDFS or a relational database, you can deploy an agent on the source network. CDM pulls data from your internal data sources through an agent but cannot write data into the databases.

Figure 1 Scenario

Figure 2 shows the process of using an agent.

Figure 2 Process

Prerequisites

You have created a cluster according to Creating a CDM Cluster.

Creating an Agent

  1. Log in to the CDM management console.
  2. In the left navigation pane, click Cluster Management. Locate the target cluster, choose Job Management > Agent Management > Create Agent, and configure agent parameters. See Figure 3.

    Figure 3 Creating an agent
    • IP Address: Set this parameter to the IP address of the server where the agent is deployed on the source network.
    • Port: port exposed by the agent. Recommended value range: 1024–65535.
    • Enable Compression: whether to compress data for transmission
    • Enable SSL: whether to enable two-way SSL authentication
    • Bandwidth Throttling: set the maximum downstream rate of the agent. By default, there is no throttling.

  3. Click OK. On the Agent Management page, view the created agent.

Downloading and Installing an Agent

  1. On the Agent Management page, locate the created agent. Click Download in the Operation column. See Figure 4.

    Figure 4 Downloading an agent

  2. Upload the downloaded agent package to the agent server.

    Agent running relies on Java 8. Before deploying an agent, ensure that Java 8 has been installed and Java environment variables have been configured.

  3. Decompress the installation package and run the following commands to install the agent:

    sh sbin/install.sh

    su Ruby

    sh sbin/start.sh

  4. After the installation is complete, run the netstat -an command to check whether listening is enabled for the port.

Connecting to an Agent

  1. On the Agent Management page, locate the created agent. Click Connect in the Operation column. See Figure 5.

    Figure 5 Connecting to an agent

  2. Select the agent in Link to HDFS and Link to Relational Databases.