Software Engineer — Cisco Systems
Third Party Software Compliance & Risk Management | Bengaluru, India | Feb 2020 – Present
- Architected and managed 7 AWS EKS production clusters orchestrating 100+ pods across 50+ microservices handling 1,000+ QPS, implementing RBAC, network policies, full observability (Prometheus/Grafana), and CI/CD automation — maintaining 99.9% uptime across globally distributed services.
- Built production LLM orchestration platform from scratch with custom agent executor using graph architecture, intelligent model routing via query complexity analysis (80% cost reduction), and multi-tier inference failover (Azure OpenAI → Bedrock/Llama) achieving <800ms TTFT.
- Engineered custom RAG infrastructure with hybrid retrieval (BM25 + semantic search via PostgreSQL/pgvector), metadata-injected chunking with reverse indexing, configurable reranking, and a comprehensive evaluation framework enabling A/B testing across prompts, models, and retrieval strategies.
- Designed and built data pipeline and query optimization layer for compliance data lake, reducing average response time from 8s to <1s (90% improvement) through SQL query optimization, multi-tier caching, and backend architecture refactoring.
- Architected Commercial Component Engine serving 2,000+ users processing 25,000+ annual compliance transactions through RESTful APIs, PostgreSQL backend, and React frontend.
- Built high-throughput event-driven service handling 70 req/s (14× improvement) by redesigning with asynchronous processing architecture.