'Can I see implementation of UDF function in Spark SQL?
As I discovered Spark SQL does not have hashing functions. In order to select specific hashed data I need to use custom/UDF function like this
sparkSession.udf.register("hashFuncWithSecret", (s: String) => myHashFunction(s, "my_very_secret_key"))
I want "my_very_secret_key" not be exposed and visible from other spark session or elsewhere in UI or other. I wonder if this is possible. Thank you!
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
