Updated on 2024-05-29 GMT+08:00

Enabling the Hot-Cold Data Separation

You can modify the HBase configuration on FusionInsight Manager to enable hot-cold data separation. Cold data will be stored in OBS and hot data will be stored in HDFS.

Procedure

  1. Interconnecting the Guardian Service with OBS
  2. Log in to FusionInsight Manager, choose Cluster > Services > HBase, and click Configuration. Search for and modify the following parameters:

    • fs.coldFS: OBS file system name, for example, obs://OBS parallel file system name
    • hbase.fs.hot.cold.enabled: The default value is false. Set this parameter to true.
    • fs.obs.buffer.dir: Set this parameter to the directory of the locally mounted data disk, for example, /srv/BigData/data1/tmp/HBase/obs.

  3. Click Save.
  4. Click Dashboard and click More > Restart Service to restart the HBase service. After the service is restarted, hot-cold data separation is enabled.
  5. Set the cold and hot boundary for the table data. For details, see Cold-Hot Separation Commands.