python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Airflow 2: Check if a task still exists or not with task_id
we have created a task for sensor operation, but the task name will be dynamically updated. i.e., f"{table_name}_s3_exists". We have a scenario where we have to check a table's location twic...
Santhosh
Votes: 0
Answers: 2
How to connect MWAA CLI that is hosted in a public subnet
I am trying to invoke airflow Cli from my local terminal and I have followed these instruction https://dnx.solutions/how-to-use-apache-airflow-cli-with-amazon-mwaa/
and created cli_token and executed
...
Xi12
Votes: 0
Answers: 0
How to get reason for failure using slack in airflow2.0
How to get the reason for the failure of an operator, without going into logs. As I want to post the reason as a notification through slack?
Thanks,
Xi
Xi12
Votes: 0
Answers: 2
How to get exact reason for failure in EMR through slack?
I need to have a slack notification when my pyspark code/ bootstrap fails with the exact reason for failure in EMR.
I am using airflow 2.0, and I am using on_failure_callback=task_fail_slack_alert to ...
Xi12
Votes: 0
Answers: 1