'How to reset Apache airflow dag cache in the backfill?

I started a backfill job in airflow and ran into an issue with the dag definition half way through the backfill.

The code changed required a tiny tweak to an export file format in a python operator to include quotes.

No changes were made to the names or numbers of tasks.

When I resume my backfill, the old code is still being executed, however when I execute updates in present time the new dag code is used.

Is there a way I can have the backfill process use the new dag code too?



Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source