Updated on 2024-04-02 GMT+08:00

Accessing Hive Data Sources Using HSFabric

This section describes how to use HSFabric to connect to HetuEngine, assemble SQL statements, and send the them to HetuEngine for execution to add, delete, modify, and query Hive data sources.

import jaydebeapi
 
driver = "io.XXX.jdbc.XXXDriver"
 
# need to change the value based on the cluster information
url = "jdbc:XXX://192.168.37.61:29903,192.168.37.61:29903/hive/default?serviceDiscoveryMode=hsfabric"
user = "YourUserName"
tenant = "YourTenant"
jdbc_location = "Your file path of the jdbc jar"
 
sql = "show catalogs"
 
if __name__ == '__main__':
    conn = jaydebeapi.connect(driver, url, {"user": user,
                                            "SSL": "false",
                                            "tenant": tenant},
                              [jdbc_location])
    curs = conn.cursor()
    curs.execute(sql)
    result = curs.fetchall()
    print(result)
    curs.close()
conn.close()

The following table describes the parameters in the preceding code.

Table 1 Parameter description

Parameter

Description

url

jdbc:XXX://HSFabric1_IP:HSFabric1_Port,HSFabric2_IP:HSFabric2_Port,HSFabric3_IP:HSFabric3_Port/catalog/schema?serviceDiscoveryMode=hsfabric

NOTE:
  • xxx: driver name, which is subjective to the real-world code you use.
  • catalog and schema indicate the names of the catalog and schema to be connected to the JDBC client, respectively.
  • HSFabric_IP:HSFabric_Port indicates the HSFabric URL. Use commas (,) to separate multiple URLs, for example, 192.168.81.37:29902,192.168.195.232:29902,192.168.169.84:29902.

    On FusionInsight Manager, choose Cluster > Services > HetuEngine and click Instance to obtain the service IP addresses of all HSFabric instances. On the Configurations page, search for gateway.port to obtain the port number of HSFabric.

user

Username for accessing HetuServer, that is, the username of the human-machine user created in the cluster.

tenant

Tenant resource queue for accessing HetuEngine compute instances

jdbc_location

Full path of the hetu-jdbc-XXX.jar package obtained in Configuring the Python3 Sample Project.

  • Example path in Windows: D:\\hetu-examples-python3\\hetu-jdbc-XXX.jar
  • Example path in Linux: /opt/hetu-examples-python3/hetu-jdbc-XXX.jar