Skip to content Skip to sidebar Skip to footer

Unexpected Airflow Behaviour In Dynamic Task Generation

For reasons acceptable to me, I am trying to dynamically generate ExternalTaskSensor tasks with different execution_date_fn in each iteration. Callable provided to execution_date_f

Solution 1:

This has little to do with Airflow, it is a lambda issue:

>>> ls = [lambda: i for i in [1,2]]
>>> ls[0]()
2>>> ls[1]()
2

To know why it does that, I recommend reading that Stackoverflow post that will probably explains why better than I could

Post a Comment for "Unexpected Airflow Behaviour In Dynamic Task Generation"