Cloud Architecture2024 - 2025Lead Solution Architect

OmniScale Enterprise Cloud Gateway

High-Throughput Multi-Region API Router & Microservice Mesh

Request Throughput

50,000+ RPS

Sustained peak workload

P99 Routing Latency

< 8ms

Sub-millisecond Edge cache

Platform Uptime

99.99%

Zero single points of failure

Infrastructure Cost Savings

35%

Optimized resource allocation

Technology Stack & Tools Used

GoKubernetesAWS EKSEnvoyRedis ClusterTerraformPrometheusGrafana

Architectural Overview & System Boundaries

OmniScale functions as the unified ingress point for 40+ microservices across 3 AWS regions (us-east-1, eu-west-1, ap-southeast-1). Utilizing Envoy Proxy custom filters written in Go and backed by a global Redis cluster for dynamic rate-limiting and token verification, the architecture ensures resilient fault isolations through circuit breakers and rate limit quotas.

Core Engineering Challenges

1Cross-region data consistency during high-velocity tenant authentication bursts.

2Eliminating noisy-neighbor memory saturation in multi-tenant shared Kubernetes clusters.

3Seamless blue/green canary deployments without invalidating client session tokens.

Critical Architectural Decisions & Trade-Offs

Decentralized Auth Verification via Distributed JWT Validation

Centralized auth checks created an unacceptable bottleneck at 30k RPS. Moving key validation to edge proxies using asymmetric keys reduced auth latency by 82%.

Impact: Saved 18ms per API call and eliminated auth service overload during peak traffic.

eBPF-driven Observability Layer

Traditional sidecar logging injected a 4ms penalty. Implementing Cilium eBPF allowed network tracing directly at the Linux kernel level.

Impact: Achieved zero-overhead deep packet inspection and real-time distributed tracing.

### Background & Engineering Vision Modern enterprise workloads require seamless scale, multi-region fault tolerance, and strict SLAs. As Lead Solution Architect, I spearheaded the overhaul of legacy monolithic reverse proxies into a decoupled, Envoy-driven API Gateway. ### Core Architectural Blueprint 1. **Edge Routing**: Cloudflare Anycast CDN terminates TLS at the edge, routing requests to the nearest AWS EKS cluster. 2. **Ingress Mesh**: Envoy Gateway instances dynamically evaluate path routing, headers, and rate-limit budgets using a distributed Redis instance with local memory caching. 3. **Service Discovery & Fault Tolerance**: HashiCorp Consul syncs service endpoints across VPCs while automated circuit breakers gracefully fallback to cached responses during microservice outages. 4. **Automated Infrastructure**: 100% defined as code via Terraform modules with automated integration testing in GitHub Actions pipelines. ### Business & Operational Impact By implementing strict architectural boundary controls and proactive health checks, the client achieved 99.99% operational availability and saved over $180,000 annually in compute over-provisioning.

Back to Case Studies Consult on Similar Software Project

Ready to Build Your Project?

Let's Build Your Custom Web Application

Whether you need a full-stack web app, a Node.js REST API, a Next.js SaaS MVP, an admin dashboard, or performance optimization for an existing application — I am available for freelance projects in Kerala, India, and worldwide.

Fast WhatsApp & Email Response•Remote Worldwide & India•Fixed-Scope or Milestone Rates

Discuss Your Project Start a Project abinschandran1@gmail.com