Updated on 2022-07-11 GMT+08:00

Privilege Control Mechanism of SparkSQL UDF Feature

Question

What are the privilege control mechanism for UDF in SparkSQL?

Answer

When the SQL statement unable to meet user scenarios, the user can use the UDF feature to do the operations on HDFS or HBase data.

To ensure data security, SparkSQL UDF can only be used by admin users, meanwhile the users must make sure those self-defined functions do not contain malicious codes.