Senior Software Engineer with 3+ years building and scaling high-throughput distributed systems, now focused on AI/ML infrastructure — model serving, MLOps pipelines, and production LLM/agent systems on Kubernetes.
- 🏗️ I architect Java Spring Boot microservices handling 50,000+ TPS with Redis caching, rate limiting, and SQS-based async processing.
- ☸️ I own production AWS EKS platforms end-to-end — HPA/Cluster Autoscaler, IRSA, blue-green & canary deployments, Terraform/CDK IaC.
- 🤖 I build production AI agents with AWS Bedrock AgentCore, Strands, LiteLLM, and RAG pipelines.
- 🏆 Recognized at India DevOps Show 2024 & 2025 for infrastructure management and cost-optimization initiatives.
- Model serving & inference infra — vLLM, Triton, KServe, Ray Serve on Kubernetes
- MLOps — MLflow, Kubeflow, pipeline automation & CI/CD for ML
- LLM systems — RAG, agent frameworks (LangGraph), evaluation & observability (Langfuse)
- GPU on Kubernetes — scheduling, autoscaling, and cost optimization for AI workloads
Tools and technologies I work with across backend, infrastructure, and AI/ML platforms
