Questions about airflow-taskflow
Read more about airflow-taskflow
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Airflow 2: Check if a task still exists or not with task_id
we have created a task for sensor operation, but the task name will be dynamically updated. i.e., f"{table_name}_s3_exists". We have a scenario where we have to check a table's location twic...
Santhosh
Votes: 0
Answers: 2
How do you access Airflow variables with task decorators using jinja templating?
I'm currently accessing an Airflow variable as follows:
from airflow.models import Variable
s3_bucket = Variable.get('bucket_name')
It works but I'm being asked to not use the Variable module and us...
Paul Chung
Votes: 0
Answers: 2
Airflow 2 taskflow logging
I'm creating a fairly complex task using the task-flow API (@task annotation) and I need to write some logs which will help me troubleshooting the runs during development and in the future.
I've resea...
cosenmarco
Votes: 0
Answers: 1
How to create TaskFlow DAGs dynamically in AirFlow 2.0?
I have a parameterized DAG and I want to programmatically create DAGs instances based on this DAG.
In traditional Airflow model, I can achieve this easily using a loop:
# Code sample from: https://git...
lifanxi
Votes: 0
Answers: 0