'Azure Databricks - java.lang.IllegalStateException: dbfs:/mnt/delta_checkpoints/offsets/5 exists before writing
I have built a streaming pipeline with spark autoloader.
Source Folder is a azure blob container. We encountered a rare issue (could not replicate it). Below is the exception Message:
java.lang.IllegalStateException: dbfs:/mnt/delta_checkpoints/offsets/5 exists before writing
Please help on this with a resolution, as this looks like some known platform issue. Please let know if I need to attach the entire stacktrace.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|