Updated on 2023-03-02 GMT+08:00

Adding a Big Data Source

Add big data assets stored in CSS, DLI, and Hive.

Prerequisites

Procedure

  1. Log in to the management console.
  2. Click in the upper left corner of the management console and select a region or project.
  3. In the navigation pane on the left, click and choose Security > Data Security Center.
  4. In the navigation pane, choose Assets and click the Big Data tab.

    Figure 1 Big data assets

  5. In the upper left corner of the big data asset list, click Add Big Data Source.
  6. In the displayed dialog box, set parameters for adding a big data source. For details, see Table 1.

    Figure 2 Adding a big data source
    Table 1 Parameters for adding a big data source

    Parameter

    Description

    Example Value

    Asset

    Customized parameter

    N/A

    Region

    Region where the account is used for login

    N/A

    Big Data Type

    Type of a big data asset. The options are as follows:
    • When you select Elasticsearch, refer to Table 2 for descriptions about the parameters required.
    • When you select DLI, refer to Table 3 for descriptions about the parameters required.
    • When you select Hive, refer to Table 4 for descriptions about the parameters required.

    Elasticsearch

    Table 2 Parameters required for adding Elasticsearch big data source

    Parameter

    Description

    Example Value

    Elasticsearch Instance

    Elasticsearch instance

    N/A

    Version

    Version number corresponding to the big data type

    5.x

    Database Server Address

    IP address of the big data source server

    192.168.0.233

    Port

    Port number of the big data source server

    3306

    Index

    Index corresponding to the big data source

    N/A

    Username

    Username for accessing the big data server

    N/A

    Password

    Password for accessing the big data server

    N/A

    Table 3 Parameters required for adding DLI big data source

    Parameter

    Description

    Example Value

    Queue

    Select the queue from the drop-down list.

    default

    DLI Database

    Select the database in the queue of DLI.

    5.x

    Table 4 Parameters required for adding Hive big data source

    Parameter

    Description

    Example Value

    VPC

    Select a VPC from the drop-down list.

    N/A

    Subnet

    Select the subnet of the VPC.

    N/A

    Security Group

    Select an available security group from the drop-down list.

    N/A

    Database Server Address

    IP address of the big data source server

    192.168.0.233

    Port

    Port number of the big data source server

    3306

    Database

    Enter a database name.

    N/A

  7. Click OK.

    After the big data source has been added, the connectivity status becomes Checking to check whether DSC can access the added big data asset using the new username and password.
    • If DSC can access the added big data asset, the connectivity status is Succeeded.
    • If DSC cannot access the added big data asset, the connectivity status is Failed. Click Details to view the failure cause and enter the correct username and password for accessing the target big data asset.