Hi all! I am Aditya, data engineer at Tunein. Look...
# welcome
c
Hi all! I am Aditya, data engineer at Tunein. Looking at Pants for managing our airflow/data-pipeline python codebase. Has anyone experience with pants + Airflow?
👋 3
b
There are github repos using pants and Airflow.
c
Thanks! My search got me this one: https://github.com/mingshi-wang/airflow-pants-example Its useful. The thing which is tricking me is testing. Basically, I have test like this:
Copy code
import pytest
from airflow.models import DagBag

def test_no_import_errors():
    dag_bag = DagBag(
        dag_folder="src/airflow-dags/tunein/dags",
        include_examples=False,
        read_dags_from_db=False
    )
    assert dag_bag.size() > 0, "Loaded dags"
    assert len(dag_bag.import_errors) == 0, "No Import Failures"
h
Welcome, happy to help with your evaluation. I believe several teams are using Pants with Airflow.
c
thanks! Currently navigating pants doc. Will post in #general for any issues I come across
👍 1