Help Center > > User Guide> MRS Cluster Component Operation Guide> Using Spark> Interconnecting Spark with OpenTSDB> Modifying the Default Configuration Data

Modifying the Default Configuration Data

Updated at: Sep 12, 2019 GMT+08:00

By default, connect the local TSD process of the node where the Spark executor resides with OpenTSDB. In MRS, use the default configuration.

Table 1 OpenTSDB data source configuration

Item

Description

Example Value

spark.sql.datasource.opentsdb.host

IP address of the connected TSD process.

Null (default value)

xx.xx.xx.xx indicates the IP address. Separate multiple IP addresses with commas (,).

spark.sql.datasource.opentsdb.port

Port number of the TSD process.

4242 (default value)

spark.sql.datasource.opentsdb.randomSeed

Whether to use the random seed when the spark.sql.datasource.opentsdb.host is configured with multiple addresses. If this parameter is set to false, all executors on the same node are connected to the same host. In this way, spark.blacklist.enabled=true can be used to implement task fault tolerance.

false by default

Example

Run the set statement in spark-sql and spark-beeline, and then run other SQL statements.

set spark.sql.datasource.opentsdb.host = 192.168.2.143,192.168.2.158;
SELECT * FROM opentsdb_table ;

Did you find this page helpful?

Submit successfully!

Thank you for your feedback. Your feedback helps make our documentation better.

Failed to submit the feedback. Please try again later.

Which of the following issues have you encountered?







Please complete at least one feedback item.

Content most length 200 character

Content is empty.

OK Cancel