Apache Hive Connection Parameters (Internal Test)
Parameter |
Mandatory |
Description |
---|---|---|
Data Connection Type |
Yes |
The value is fixed at Apache Hive. |
Name |
Yes |
Name of the data connection to create. Data connection names can contain a maximum of 100 characters. They can contain only letters, digits, underscores (_), and hyphens (-). |
Description |
No |
A description which can help identify the data connection more easily. It can contain a maximum of 100 characters. |
Tag |
No |
Attribute of the data connection to create. Tags make management easier.
NOTE:
The tag name can contain only letters, digits, and underscores (_) and cannot start with an underscore (_) or contain more than 100 characters. |
Applicable Modules |
Yes |
Select the modules for which this connection is available.
NOTE:
|
Basic and Network Connectivity Configuration |
||
Use Cluster Config |
Yes |
Select a cluster configuration you have created. You can use the cluster configuration to simplify parameter settings for the Hadoop connection. |
URI |
Yes |
This parameter is mandatory when Use Cluster Config is disabled. NameNode URI, for example, hdfs://nn1_example.com/ |
Hive Metastore |
Yes |
This parameter is mandatory when Use Cluster Config is disabled. Hive metadata address. For details, see the hive.metastore.uris configuration item. Example: thrift://host-192-168-1-212:9083 |
IP and Host Name Mapping |
No |
This parameter is mandatory when Use Cluster Config is disabled. If the Hadoop configuration file uses the host name, configure the mapping between the IP address and host name. Separate the IP addresses and host names by spaces and mappings by semicolons (;), carriage returns, or line feeds. |
KMS Key |
No |
This parameter is mandatory when Use Cluster Config is enabled.
KMS key used to encrypt and decrypt data source authentication information. Select a default or custom key.
NOTE:
|
Agent |
Yes |
This parameter is mandatory when Use Cluster Config is enabled. DataArts Studio cannot directly connect to non-fully managed services. An agent is required for DataArts Studio to communicate with non-fully managed services. A CDM cluster can function as an agent. If no CDM cluster is available, create one by referring to Creating a CDM Cluster. |
DataArts Migration Configuration |
||
HIVE Version |
HIVE_3_X |
This parameter is displayed when DataArts Migration is selected for Applicable Modules. Hive version Set it to the Hive version on the server.
NOTE:
Select HIVE_3_X for connections to Hive servers of version 3.x, and select HIVE_2_X for connections to Hive servers of version 2.x. If you select an unmatched connection version, the connection test may succeed, but the queried database table may be empty, or the job may fail. |
Hive Properties |
hive.storeFormat=textfile |
This parameter is displayed when DataArts Migration is selected for Applicable Modules. (Optional) Click Add to add the JDBC connector attributes of multiple specified data sources. For details, see the JDBC connector document of the corresponding database.
The following are some examples:
|
Hive JDBC URL |
No |
URL for connecting to Hive JDBC. By default, an anonymous user is used for the connection. To specify a user, add the hadoop.user.name configuration in advanced attributes. Example: SIMPLE:jdbc:hive2://example:10000; KERBEROS:jdbc:hive2://example:10000;principal=${Principle}. |
Data Source Authentication and Other Function Configuration |
||
Authentication Method |
Yes |
Authentication type:
|
Enable ldap |
No |
If LDAP authentication is enabled for an external LDAP server connected to Apache Hive, the LDAP username and password are required for authenticating the connection to Apache Hive. In this case, this option must be enabled. Otherwise, the connection will fail. |
ldapUsername |
Yes |
This parameter is mandatory when Enable ldap is enabled. Enter the username configured when LDAP authentication was enabled for Apache Hive. |
ldapPassword |
Yes |
This parameter is mandatory when Enable ldap is enabled. Enter the password configured when LDAP authentication was enabled for Apache Hive. |
Feedback
Was this page helpful?
Provide feedbackThank you very much for your feedback. We will continue working to improve the documentation.See the reply and handling status in My Cloud VOC.
For any further questions, feel free to contact us through the chatbot.
Chatbot