Help Center/ Data Security Center/ User Guide/ Asset Center/ Adding and Authorizing Data Assets in DSC/ Adding and Authorizing Big Data Assets
Updated on 2026-08-19 GMT+08:00
View PDF
Share

Adding and Authorizing Big Data Assets

To identify sensitive data, perform static masking, or add/extract data watermarks for big data assets, authorize DSC to access the databases within your big data instances.

Prerequisites

Supported Big Data Source Types and Versions

The following table lists the big data source types and versions supported by DSC.

Data Source

Data Source Type

Version

Cloud Search Service (CSS)

ElasticSearch

5.x, 6.x, and 7.x

MapReduce Service (MRS)

Hive

1.0

MRS-Hive

3.x

-

Hbase

1.0

Adding a Big Data Asset

This section describes how to add a user-built big data assets to DSC for data management.

Adding a Big Data Instance

Instances of user-built big data types need to be manually added. This section uses Elasticsearch as an example to describe how to add instances of user-built big data types.

  1. Log in to the DSC console.
  2. Click in the upper left corner and select a region or project.
  3. In the navigation pane on the left, choose Asset Center > Asset Management.
  4. Click Elasticsearch and choose the ElasticSearch Instance tab.
  5. Click the Elasticsearch instance tab.
  6. Click Add in the upper left corner of the instance list. The Add Instance dialog box is displayed.
  7. Set the related parameters according to the Table 1, and then click OK.

    Table 1 Parameters for adding an instance

    Parameter

    Description

    ECS

    Select an ECS from the drop-down list box.

    Data Type

    Big data instance type to be added. In this case, select Elasticsearch.

    Security Group

    Select a security group from the drop-down list.

    Version

    Select a version from the drop-down list box. For details about the supported asset types and versions, see Constraints.

    Database Server Address

    Select a server address from the drop-down list box.

    Port

    Enter an integer from 0 to 65535.

    Index

    Enter an index name, which can contain only letters, digits, underscores (_), and hyphens (-).

    Username/Password

    Enter the username and password of the index.

    Asset

    Enter a user-defined asset name containing 4 to 255 characters.

  8. After an instance is added, if you need to identify and mask sensitive data in the databases or indexes of the instance, authorize access to the databases or indexes first. For details, see Authorizing Databases/Indexes Within Big Data Instances.

Authorizing Databases/Indexes

Before authorizing big data instance databases or indexes, ensure the following prerequisites are met: CSS services are enabled; assets exist within CSS; available IP address quotas are present in the respective subnet; and the Status of the instance is Successful.

Authorizing Databases/Indexes Within Big Data Instances

The Elasticsearch big data type is used as an example to describe how to authorize access to big data assets. To authorize access to other types of big data assets, click the corresponding big data type.

  1. Log in to the DSC console.
  2. Click in the upper left corner and select a region or project.
  3. In the navigation pane on the left, choose Asset Center > Asset Management.
  4. Click Elasticsearch and choose the ElasticSearch Instance tab.
  5. Click the Elasticsearch instance tab. Authorization can be performed in either of the following ways:

    • Method 1
      1. Locate the target Elasticsearch instance and click Authorize in the Operation column to go to the Elasticsearch index authorization page.
      2. Enter the Elasticsearch index name, asset name, username, and password.
        • The Elasticsearch index name can contain only letters, digits, underscores (_), and hyphens (-).
        • The asset name must contain 4 to 255 characters.
      3. (Optional) Select a group from the drop-down list. After selecting a group, you can view the group information on the asset group management page. If you do not select a group, the asset is displayed in default group list by default.
      4. Click Add to add multiple indexes for authorization at the same time.
    • Method 2
      1. Click the instance name/account name to go to the instance details page. Click Authorize in the Operation column for index authorization.
      2. Select multiple indexes or databases and click the button for batch authorization in the upper left corner.
      3. Enter the database name, asset name, username, and password.
        • The index or database name can contain only letters, digits, underscores (_), and hyphens (-).
        • The asset name can contain 4 to 255 characters.
      4. (Optional) Select a group from the drop-down list. After selecting a group, you can view the group information on the asset group management page. If you do not select a group, the asset is displayed in default group list by default.
      5. Click Add to add multiple indexes for authorization at the same time.

  6. Click the Index tab to view the connection status of authorized assets.

    After the asset authorization is complete, the Connectivity of the asset is Checking, which means DSC is checking the database connectivity.

Related Operations

  • Deleting an instance

    A big data instance can be deleted only when the big data instance is a user-built instance and the number of authorized databases or indexes in it is 0.

    Select multiple user-built instances and click Batch Delete in the upper left corner of the instance list to delete the instances. You can also click Delete in the Operation column of the instance list to delete a single instance.

  • Editing an instance

    You can edit the information about a user-built big data instance. Select a big data type, click the instance tab, locate the target instance, and click Edit in the Operation column to edit the instance information.

  • Editing a database, index, or namespace

    Select a big data type. On the database, index, or namespace tab page, click Edit in the Operation column to edit the corresponding information.

  • Retrieving the metadata of an instance
    • If the number of authorized databases in the MRS_Hive instance is greater than 0, click More > Refresh in the Operation column of the Hive instance list to automatically create a metadata task to obtain the database, table, and column information of the instance.
    • If you enable the function of automatically creating a metadata task when adding a Hive instance, the system automatically creates a metadata task to obtain all metadata of the instance after the instance is created. You can manually create a metadata task by referring to Creating a Metadata Scanning Task.
  • Creating an identification task

    In the Databases tab, locate the target asset and click Create Identification Task in the Operation column to classify and grade the asset. For details, see Creating an Identification Task.

References

Parent Topic: Adding and Authorizing Data Assets in DSC