'Delete a bigquery table after all the steps in dataflow job have completed
Is there a way to delete a bigquery table only after all the steps in a batch dataflow pipeline have succeeded?
Solution 1:[1]
You can use DataflowPipelineJob.waitToFinish(...) to wait for your job to finish, check that the returned state was DONE, and then use the BigQuery API to delete the table.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|---|
| Solution 1 | Drew |