Configuring the Connection Between HetuEngine and MemArtsCC

Scenario

MemArtsCC stores hotspot data in compute clusters to reduce the required bandwidth on the OBS server. With the local storage of MemArtsCC, hotspot data does not need to be accessed across networks, improving the data read efficiency of HetuEngine. This topic describes how to integrate MemArtsCC into HetuEngine tasks for a system where storage and compute are decoupled.

Prerequisites

• The Guardian service is running properly, and decoupled storage and compute have been used. For details, see Interconnecting Guardian with OBS.
• HetuEngine has been connected to OBS. For details, see Accessing OBS Using HetuEngine Through Guardian.
• Currently, HetuEngine can connect to MemArtsCC only on EulerOS and Kylin OS.

Modifying HetuEngine Configuration

1. Log in to FusionInsight Manager and choose Cluster > Services > HetuEngine, click Configurations and then All Configurations, and choose HetuEngine(Service) > OBS.
2. Set fs.obs.readahead.policy to memArtsCC.
3. Click Save. In the displayed dialog box, click OK to save the configuration. Click Dashboard and choose More > Service Rolling Restart to restart the HetuEngine service and perform a rolling restart on all compute instances.

Verifying the Configuration

1. Log in to FusionInsight Manager and choose Cluster > Services > MemArtsCC > Chart > Capacity.
2. View and record the number of shards in the cluster.
3. Use HetuEngine to create an OBS table and query table data. For details, see Accessing OBS Using HetuEngine Through Guardian.
4. Repeat 1 and 2. If there are more shards in the cluster than there were in 2, the interconnection is successful.