Questions about airflow
Read more about airflow
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
How to check if a DAG already exists?
I am trying to figure out- if it is possible to verify if a DAG already exists in the airflow. For example- if there is an existing DAG named as "dag_execution_1"; I would like to have some ...
Tanvir
Votes: 0
Answers: 2
Error when pulling private docker image from GitLab container registry using DockerOperator in Airflow 2.0
I've been struggling with pulling a private image from my GitLab container registry when running a DockerOperator in Airflow 2.0.
My DockerOperator looks as follows:
python_mailer = DockerOperator(
...
Maarten
Votes: 0
Answers: 1
Airflow 2: Check if a task still exists or not with task_id
we have created a task for sensor operation, but the task name will be dynamically updated. i.e., f"{table_name}_s3_exists". We have a scenario where we have to check a table's location twic...
Santhosh
Votes: 0
Answers: 2
Can't access the XCom on airflow "Error code: Out of Memory"
Well, for sure after trying my script sometimes, I forgot that the Airflow has a limit to load data and now I can't access the XComs to delete my data, is there a way to do that using the Ubuntu becau...
Tayzer Damasceno
Votes: 0
Answers: 0