A complete observability stack with Prometheus (metrics), Loki (logs), Jaeger (traces), and Grafana (visualization) deployed on AWS EC2 with GitHub Actions CI/CD.
- Real-time metrics collection with Prometheus
- Centralized logging with Loki
- Distributed tracing with Jaeger
- Beautiful dashboards with Grafana
- Automated CI/CD pipeline with GitHub Actions
- Infrastructure-as-Code using Docker Compose
- Sample Node.js application for demo purposes
- AWS EC2 instance (Ubuntu 22.04 recommended)
- Docker & Docker Compose installed
- GitHub account
- Clone the repository
git clone https://github.com/your-username/devops-observability-system.git cd devops-observability-system - **Configure GitHub Secrets
- SSH_PRIVATE_KEY: Your EC2 .pem key
- EC2_IP: Your EC2 public IP
- KNOWN_HOSTS: Output of ssh-keyscan <EC2_IP>
- ** Push to GitHub (auto-deploys via GitHub Actions)
git add . git commit -m "Initial commit" git push origin main
graph TD
A[Node.js App] -->|Metrics| B(Prometheus)
A -->|Logs| C(Loki)
A -->|Traces| D(Jaeger)
B --> E[Grafana]
C --> E
D --> E
F[GitHub Actions] -->|CI/CD| G[EC2 Instance]