'Spark SQL Configurations
What type of parameters we can set using SPARK SQL? My assumption is Spark accepts the parameters which are prefixed with spark.sql, and ignores any other parameters which do not start with spark.sql and others can be only be added during Spark session creation.
Let's say, spark.sql.autoBroadcastJoinThreshold, spark.sql.broadcastTimeout, etc. are accepted and spark.maxRemoteBlockSizeFetchToMem, spark.driver.memory, etc. are ignored. Let me know if my understanding is not correct.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|