#apache-airflow

[ follow ]

Deploying Airflow on Kubernetes Using ArgoCD and Terraform: Modern GitOps approach | HackerNoon

Apache Airflow™ and GitOps are powerful tools for managing data manipulation workflows and operational management using Git repositories.
#data-engineering

Using OpenTelemetry to monitor Apache Airflow

Monitoring Airflow is vital for optimizing performance and reliability of data pipelines.

The Future of the Data Engineer

Maxime Beauchemin paved the way for data engineering with projects like Apache Airflow and Apache Superset, highlighting the importance of specialized engineers in scaling data science.

Using OpenTelemetry to monitor Apache Airflow

Monitoring Airflow is vital for optimizing performance and reliability of data pipelines.

The Future of the Data Engineer

Maxime Beauchemin paved the way for data engineering with projects like Apache Airflow and Apache Superset, highlighting the importance of specialized engineers in scaling data science.
moredata-engineering

Cost-Effective Cloud Data Lakes, 10 Must-Read AI Books, and the Free ODSC East Open Pass

Data masking is crucial for organizations to use data without privacy violations.

Oozie vs Airflow? Apple to Orange comparison or both are the same?

Apache Oozie is an open-source workflow scheduling system designed to manage Hadoop jobs.
Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring workflows.
[ Load more ]