Help Center/ Data Lake Insight/ FAQs/ Problems Related to Spark Jobs/ Job O&M Errors/ Why Can't I Find the global_temp Database in the Spark 3.x Job Log?
Updated on 2023-05-19 GMT+08:00

Why Can't I Find the global_temp Database in the Spark 3.x Job Log?

Symptom

I cannot find the global_temp database in the Spark 3.x job log.

Possible Causes

The global_temp database is the default built-in database of Spark 3.x and is Spark's global temporary view.

When a Spark job is registered with ViewManager, the system checks whether the database exists in Metastore. If it is, the Spark job fails to be executed.

If the Spark 3.x job log contains a record of accessing catalogs to query the database and a message indicating that the non-existence of the database is to ensure that Spark jobs can run properly, you do not need to perform any operations.