'how can i set an AIRFLOW dag to trigger every hour
here is the thing, i got an AIRFLOW dag who trigger every day(@daily) for collect markets datas, example : today is 2022-03-23 so he trigger at midnight but he minus 2 days then he collect the datas for monday: for making this happen my program need a startDate, so i use this as an arg in SparkSubmitOperator :
"{{ macros.ds_add(ds, -1) }}"
now i want it to trigger every hour for making the same delta as above but in hours
i try a lot of things but nothing works, i set the dag @hourly and everything but still doesnt work, i read the AIRFLOW documentation but there is nothing except some "ts" but it doesnt work, and last but not least im noob in python.
any thoughts ?
Thanks in advance.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|
