'Where is log log4j.properties in PySpark?
I am struggling to hide all the verbose coming from a PySpark pipeline I am making. I am looking for the log4j.properties file to turn it off but I cannot find it. I do not have a /spark/conf folder... in fact, I do not even have a /spark/ folder anywhere in my machine. Would anyone be familiar with this in PySpark?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|