Questions about airflow-2.x
Read more about airflow-2.x
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Airflow 2: Check if a task still exists or not with task_id
we have created a task for sensor operation, but the task name will be dynamically updated. i.e., f"{table_name}_s3_exists". We have a scenario where we have to check a table's location twic...
Santhosh
Votes: 0
Answers: 2
Can't access the XCom on airflow "Error code: Out of Memory"
Well, for sure after trying my script sometimes, I forgot that the Airflow has a limit to load data and now I can't access the XComs to delete my data, is there a way to do that using the Ubuntu becau...
Tayzer Damasceno
Votes: 0
Answers: 0
How to connect MWAA CLI that is hosted in a public subnet
I am trying to invoke airflow Cli from my local terminal and I have followed these instruction https://dnx.solutions/how-to-use-apache-airflow-cli-with-amazon-mwaa/
and created cli_token and executed
...
Xi12
Votes: 0
Answers: 0
Apache Airflow pass data from BashOperator to SparkSubmitOperator
I am trying to login into a server 100.18.10.182 and triggering my spark submit job in the server 100.18.10.36 from .182 server in Apache Airflow. I have used BashOperator (a shell script to ssh into ...
Hardik
Votes: 0
Answers: 0