'Using While Loop to Keep a Databricks Job Continually Running
My employers are trying to continually run a Databricks notebook or a Databricks Job using a While Loop. That is to say they intend to write a bunch of code and the encapsulate the code within a While Loop so that the entire Job/Notebook will run again after all of the code is executed.
Can someone let me know if that is a viable solution?
I should point out that they're trying to do streaming with Azure Service Bus, and because Databricks doesn't support streaming with Service Bus they're going for any solution that will keep the notebook running so as to continually read in Service Bus messages.
My personally view is that its' a terrible solution, but I'm interested to hear your comments.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
