Summary

• add an Airflow DAG that wires extraction through data quality, drift monitoring, and cleanup steps with explicit dependencies and SLAs
• include failure and SLA miss notifications via email and optional Enterprise WeChat webhook
• optimize storage through partition pruning/compression guidance and scheduled log cleanup with configurable retention

Testing

• python -m compileall airflow/dags/data_monitoring_pipeline.py

Codex Task