Running Airflow 2.0 with Docker in 5 mins
Why Stack Overflow recommends it
Stack Overflow users cite it as the guide they followed to install Airflow with Docker, usually when they then hit setup or configuration problems.
Recommended by 0 people across 0 different months, 2021 to 2024.
What it is
A short screencast by Marc Lamberti (Data with Marc) showing how to run Apache Airflow 2.0 locally with the CeleryExecutor using the official docker-compose file. It walks through the setup so viewers can start exploring Airflow 2.0 features and DAGs.
What people said
Cites Aaron Mazie · 2021-08 · Stack Overflow · on “Failed to execute script docker-compose while setting up Apache Airflow”
I'm using Docker Compose to set up Apache Airflow and right when I use docker-compose up airflow-init I get this error: Traceback (most recent call last): File "urllib3/connectionpool.py", line 677, in urlopen File "urllib3/connectionpool.py", line 392, in _make_request File "http/client.py", line 1252, in request File "http/client.py", line 1298, in _send_request File "http/client.py", line 1247, in endheaders File "http/client.py", line 1026, in _send_output File "http/client.py", line 966, in send File "docker/transport/unixconn.py", line 43, in connect FileNotFoundError: [Errno 2] No such file or directory During handling of the above exception, another exception occurred: Traceback (mos
Cites Mangostino · 2024-03 · Stack Overflow · on “How to link Gmail with Airflow 2.8.2 running on a docker image”
I am struggling to connect my Gmail account to Airflow. I've followed ChatGPT suggestions and searched in this site for solutions but i haven't crossed upon one that addresses my context, and I don't know what else ask to chat gpt. I am working in Ubuntu 22.04.4 LTS jammy. I installed Airflow with docker following the instructions in this video [this video] . I can open the Airflow UI. I already generated App Password through Google, which I pasted in the Admin connections section at the Airflow UI. Specifically i have the following configuration: Conn Id = smtp_gmail_conn Conn Type = email Host = smtp.gmail.com Port = 587 Login = my email which I dont show here Password = the app password google
Cites Excentricitet · 2024-07 · Stack Overflow · on “Apache airflow: No module name 'airflow'. Task failed”
I installed Airflow by docker according to this video [this video] . (Windows+WSL+Ubuntu+Docker) I have my_dag.py file (replaced APIKEY): from airflow import DAG from airflow.operators.python import PythonOperator from datetime import datetime import pandas as pd def _read_api_data(): x1 = requests.get(' [LINK] ') x2 = requests.get(' [LINK] ') responses = [x1, x2] output_object = {"responses": []} for x in responses: json_object = x.json() output_object["responses"].append(json_object) json_str = json.dumps(output_object, indent=4) # Writing to weather_data.json with open("/tmp/weather_data.json", "w") as outfile: outfile.write(json_str) def _download_data(): with open('/tmp/weather_data.json') a