HetuEngine Interactive Query Overview
HetuEngine supports fast joint queries across multiple data sources, with easy GUI-based data source configuration and management. You can quickly add new data sources on the HSConsole page.
The following table lists the data sources supported by the current version of HetuEngine.
| HetuEngine Mode | Data Source | Data Source Mode | Supported Data Source Version |
|---|---|---|---|
| Security mode | Hive | Security mode | MRS 3.x and FusionInsight 6.5.1 |
| HBase | MRS 3.x and FusionInsight 6.5.1 | ||
| HetuEngine | MRS 3.1.1 and later | ||
| GaussDB | GaussDB 200 and GaussDB A 8.0.0 and later | ||
| Hudi | MRS 3.1.2 and later | ||
| ClickHouse | MRS 3.1.1 and later | ||
| IoTDB | MRS 3.2.0 and later | ||
| MySQL | MySQL 5.7 and MySQL 8.0 and later | ||
| Oracle | Oracle 12 and later | ||
| GBase | GBase 8a V950 and later | ||
| Normal mode | Hive | Normal mode | MRS 3.x and FusionInsight 6.5.1 |
| HBase | MRS 3.x and FusionInsight 6.5.1 | ||
| Hudi | MRS 3.1.2 and later | ||
| ClickHouse | MRS 3.1.1 and later | ||
| IoTDB | MRS 3.2.0 and later | ||
| GaussDB | Security mode | GaussDB 200 and GaussDB A 8.0.0 and later | |
| MySQL | MySQL 5.7 and MySQL 8.0 and later | ||
| Oracle | Oracle 12 and later | ||
| GBase | GBase 8a V950 and later |
Operations such as adding, configuring, and deleting a HetuEngine data source take effect dynamically without requiring a cluster restart.
A configured data source takes effect dynamically, and this function cannot be disabled. By default, data sources take effect within 60 seconds. You can change the interval to a desired one by changing the value of catalog.scanner-interval in coordinator.config.properties and worker.config.properties by referring to 4.e. See the following example.
catalog.scanner-interval =120s
HetuEngine supports query pushdown, enabling queries or partial queries to be executed directly on connected data sources. This means that special predicates, aggregate functions, and other operations can be pushed down to the underlying database or file system for processing. Query pushdown brings the following benefits:
- Improves the overall query performance.
- Reduces the amount of network traffic required between HetuEngine and connected data sources.
- Reduces the workload of remote data sources.
Whether HetuEngine supports query pushdown depends on the specific connectors and their underlying data sources or storage systems.
- The data source cluster and the HetuEngine cluster must use different domain names. Two data sources (Hive, HBase, and Hudi) that share the same domain name cannot be connected to HetuEngine simultaneously.
- Nodes in the data source cluster and the HetuEngine cluster can communicate with each other on the service plane.
What is your overall rating for this page?
Thank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot