Skip to content

Latest commit

Β 

History

10 Commits

Folders and files

NameName
Last commit message
Last commit date
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Microservices Monitoring & Load Testing Framework πŸŒ©οΈπŸ“ˆ

Kubernetes Observability Load Testing Cloud

πŸ“Œ Overview

This repository hosts a high-fidelity benchmarking and monitoring framework for hosting, observing, and stress-testing microservices applications across heterogeneous cloud topologies. Using the Google Online Boutique (11-tier microservice architecture), this project evaluates system behavior, throughput, CPU/Memory saturation, network latency, and resilience across Public Cloud (Azure), Private Cloud (IITD Baadal), Multi-Cloud (Azure + GCP Mesh), and Edge Computing (K3s).


πŸ—‚οΈ Project Repository Map

MicroService-Monitoring-System/
β”œβ”€β”€ README.md                                    # Master project documentation & index
β”œβ”€β”€ docs/                                        # Documentation, presentations, and guides
β”‚   β”œβ”€β”€ presentations/                           # Project slide decks (PDF & PPTX)
β”‚   β”œβ”€β”€ setup/                                   # Topology setup and deployment guides
β”‚   └── references/                              # Benchmark reference literature
└── results/                                     # Benchmark datasets, reports & metrics
    β”œβ”€β”€ private-cloud/                           # IITD Baadal Cloud benchmarks
    β”œβ”€β”€ public-cloud/                            # Azure Single-Node & Multi-Node benchmarks
    └── multi-cloud/                             # Azure + GCP Tailscale mesh benchmarks

πŸ“š Documentation & Presentations

Category File Description
Presentation Deck πŸ“Š Cornerstone Project Presentation (PDF)
πŸ“‘ Cornerstone Project Presentation (PPTX)
Initial project proposal and system design slides
Final Presentation πŸ“Š Cornerstone Final Presentation (PDF)
πŸ“‘ Cornerstone Final Presentation (PPTX)
Complete experimental findings and performance analysis
Setup & Guides πŸ› οΈ Cloud Topology Setups Guide (PDF) Configuration steps for Azure, Baadal Cloud, and Prometheus/Grafana
Edge Topology ⚑ Edge Deployment Guide (PDF) K3s nodeSelector topology for high-availability frontend microservices
Reference Literature πŸ“– HydraGen Benchmark Generator (PDF) Reference paper on microservice benchmark generation

πŸ“Š Summary of Experimental Benchmarks (at 200 Users)

Cloud Topology Avg Latency (ms) Throughput (RPS) CPU Saturation Memory Saturation Key Insight
Azure Public Cloud (Multi-Node) 148 ms 61.65 14.7% 43.1% Linear horizontal scaling; 76% latency reduction over single node
IITD Baadal (Private Cloud) 3,530 ms 29.57 69.5% 90.8% Hardware saturation under high concurrent user load
Multi-Cloud (Azure + GCP Mesh) 3,633 ms 34.10 45.5% 69.9% Tailscale VPN encryption overhead adds ~10x latency penalty

πŸ“ Experimental Findings & Benchmark Catalog

1. 🏒 Private Cloud Benchmarks (IITD Baadal Cloud)

Load Tier Locust Report Telemetry Datasets (CSV) Metric Screenshots
Low Load (10 Users) πŸ“„ Report PDF
🌐 Interactive HTML
πŸ“Š Requests CSV
❌ Failures CSV
⚠️ Exceptions CSV
πŸ–ΌοΈ Dashboard 1 β€’ Dashboard 2 β€’ Dashboard 3 β€’ Dashboard 4 β€’ Dashboard 5 β€’ Dashboard 6
Medium Load (50 Users) πŸ“„ Report PDF
🌐 Interactive HTML
πŸ“Š Requests CSV
❌ Failures CSV
⚠️ Exceptions CSV
πŸ–ΌοΈ Dashboard 1 β€’ Dashboard 2 β€’ Dashboard 3 β€’ Dashboard 4 β€’ Dashboard 5 β€’ Dashboard 6
High Load (200 Users) πŸ“„ Report PDF
🌐 Interactive HTML
πŸ“Š Requests CSV
❌ Failures CSV
⚠️ Exceptions CSV
πŸ–ΌοΈ Dashboard 1 β€’ Dashboard 2 β€’ Dashboard 3 β€’ Dashboard 4 β€’ Dashboard 5 β€’ Dashboard 6

2. 🌐 Public Cloud Benchmarks (Microsoft Azure)

πŸ”Ή Single-Node Architecture

Load Tier PDF Summary Interactive HTML Report
Low Load πŸ“„ PublicSingleNodeLowLoad.pdf 🌐 PublicSingleNodeLowLoad.html
Medium Load πŸ“„ PublicSingleNodeMedLoad.pdf 🌐 PublicSingleNodeMedLoad.html
High Load πŸ“„ PublicSingleNodeHighLoad.pdf 🌐 PublicSingleNodeHighLoad.html

πŸ”Ή Multi-Node Architecture

Load Tier PDF Summary Interactive HTML Report
Low Load πŸ“„ PublicMultiNodeLowLoad.pdf 🌐 PublicMultiNodeLowLoad.html
Medium Load πŸ“„ PublicMultiNodeMedLoad.pdf 🌐 PublicMultiNodeMedLoad.html
High Load πŸ“„ PublicMultiNodeHighLoad.pdf 🌐 PublicMultiNodeHighLoad.html

3. 🌐⚑ Multi-Cloud VPN Mesh Benchmarks (Azure + GCP via Tailscale)

Load Tier Locust Report Telemetry Datasets (CSV) Metric Screenshots
Low Load (10 Users) πŸ“„ Report PDF
🌐 Interactive HTML
πŸ“Š Requests CSV
❌ Failures CSV
⚠️ Exceptions CSV
πŸ–ΌοΈ Dashboard 1 β€’ Dashboard 2 β€’ Dashboard 3 β€’ Dashboard 4 β€’ Dashboard 5 β€’ Dashboard 6
Medium Load (50 Users) πŸ“„ Report PDF
🌐 Interactive HTML
πŸ“Š Requests CSV
❌ Failures CSV
⚠️ Exceptions CSV
πŸ–ΌοΈ Dashboard 1 β€’ Dashboard 2 β€’ Dashboard 3 β€’ Dashboard 4 β€’ Dashboard 5 β€’ Dashboard 6
High Load (200 Users) πŸ“„ Report PDF
🌐 Interactive HTML
πŸ“Š Requests CSV
❌ Failures CSV
⚠️ Exceptions CSV
πŸ–ΌοΈ Dashboard 1 β€’ Dashboard 2 β€’ Dashboard 3 β€’ Dashboard 4 β€’ Dashboard 5 β€’ Dashboard 6

πŸ› οΈ Tech Stack & Infrastructure Tools

  • Infrastructure & Hosting: Microsoft Azure (AKS/VMs), Google Cloud Platform (GCP), IITD Baadal Cloud.
  • Orchestration: Kubernetes (kubeadm), K3s Edge Kubernetes.
  • Networking Mesh: Tailscale VPN Mesh, Flannel CNI, Cloudflare Tunnels, Split-Horizon Proxy Bypass.
  • Observability & Monitoring: Prometheus, Grafana, Node Exporter, PromQL metric analytics.
  • Load Injection & Benchmarking: Locust (Distributed user workload simulation).

About

High-fidelity benchmarking & observability framework for 11-tier microservices across Public (Azure), Private (IITD Baadal), Multi-Cloud (Azure+GCP Mesh), and Edge (K3s) topologies using Prometheus, Grafana, and Locust. πŸŒ©οΈπŸ“ˆ

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages