'Avro 1.11.0 upgrade affecting Apache Spark 3.2.1 which is having avro 1.8.2
we are trying to remove foss voilations for avro1.8.2 this resulted us to adopt avro1.11.0. we are also having apache spark in our project as per latest release and previous release of spark, The spark uses 1.8.2 version of avro libraries. So after upgrade of avro schema .avsc to avro1.11.0 compatible changes and related java code. we are failing to start our spark module with dependencies of avro related items.
Is it a known fact that spark also need to take latest avro1.11.0 to support this kind of upgrade or we need to look depeer in our code to find the issue and resolve it, since both version of avro not compatible with each other due to removal of Joda DateTime. Need Suggestions
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|