Converting mp4 videos to mp3 in a microservices architecture.
Production-grade observability implementation for a microservices-based video conversion platform running on Kubernetes.
This project is focused on learning and implementing modern observability practices for cloud-native applications:
- Metrics with Prometheus
- Dashboards with Grafana
- Distributed Tracing with OpenTelemetry
- Trace Visualization with Jaeger
- Kubernetes Monitoring
- Service Discovery using ServiceMonitors
- Kubernetes
- Amazon EKS
- Docker
- Helm
- Python
- RabbitMQ
- MongoDB
- PostgreSQL
- Prometheus
- Grafana
- OpenTelemetry
- OpenTelemetry Collector
- Jaeger
- kube-state-metrics
- node-exporter
✅ Prometheus Metrics
✅ OpenTelemetry Instrumentation
✅ Distributed Tracing
✅ ServiceMonitor Integration
✅ Grafana Dashboard
✅ Prometheus Metrics
✅ ServiceMonitor Integration
✅ Grafana Dashboard
⬜ OpenTelemetry Instrumentation
⬜ Distributed Tracing
⬜ Auth Service Instrumentation
⬜ Notification Service Instrumentation
⬜ Loki Logging
⬜ Alertmanager
⬜ Slack Alerts
⬜ SLO Dashboards
- Request Rate
- Error Rate
- Response Time
- P95 Latency
- Request Throughput
- Conversion Requests
- Conversion Duration
- Success Rate
- Failure Rate
- Processing Time
Gateway Service
↓
OpenTelemetry SDK
↓
OTel Collector
↓
Jaeger
- Verify ServiceMonitor
- Verify Service Labels
- Verify Endpoints
- Check Prometheus Targets
- Verify
/metricsendpoint - Check scrape status
- Validate ServiceMonitor selectors
- Verify OTel Collector
- Verify Exporters
- Check Jaeger
Through this project I am gaining hands-on experience with:
- Kubernetes Observability
- Prometheus Monitoring
- Grafana Dashboarding
- OpenTelemetry
- Distributed Tracing
- Service Discovery
- Kubernetes Troubleshooting
- SRE Practices
- Gateway Metrics
- Gateway Tracing
- Converter Metrics
- Converter Tracing
- Auth Service Metrics
- Notification Service Metrics
- Loki Integration
- Alloy Configuration
- Alertmanager
- Slack Notifications
- Tempo Migration
- SLO & Error Budget Tracking