Building scalable, production-ready data platforms & pipelines 🚀
- 🔹 Senior Data Engineer with 8+ years of experience
- 🔹 Strong focus on modern Data Platforms & Lakehouse Architecture
- 🔹 Expertise in Databricks, Snowflake, Azure, Airflow, Python & SQL
- 🔹 Passionate about scalable pipelines, CDC, data modeling & governance
- 🔹 Based in the United States
- Streaming ingestion & CDC pipelines
- Delta Live Tables with SCD Type 1 & Type 2
- Auto Loader ingestion frameworks
- Idempotent & parameterized pipelines
- Medallion Architecture (Bronze/Silver/Gold)
- Metadata-driven design frameworks
- Schema evolution & validation
- Data quality & observability
- Azure Databricks
- Snowflake
- Apache Airflow
- dbt
- Python / PySpark / SQL
- Docker
End-to-end data pipelines with parameterization
- Auto Loader from cloud storage
- Bronze → Silver → Gold pipeline design
- Delta Live Tables with SCD2 logic
- Airflow orchestration & monitoring
- Data quality checkpoints
Data transformation workflow with dbt
- Automated schema deployment
- Modular dbt models & tests
- Incremental loading & performance tuning
- Data profiling & quality enforcement
- 🔗 LinkedIn: https://www.linkedin.com/in/sudhirvedula
- 📧 Email: [email protected]
⭐ Open to collaborations on Data Engineering & Data Platform projects.
