A seasoned IT professional with expertise in machine learning, system and database architecture, and innovative technology solutions. Known for leading projects that integrate Generative AI technologies and delivering scalable, high-quality software solutions.
👋 Hi, I’m Kiran Kumar Ramanna
| **AI/ML Engineer | GenAI Integration Architect | Enterprise Solution Builder** |
| 📍 San Francisco Bay Area | ✉️ kiranramanna112@gmail.com |
🚀 Summary
- AI/ML engineer with 14+ years in enterprise software (9+ at ServiceNow), specializing in applied AI, GenAI/LLM integration, and system architecture.
- Designed and delivered enterprise-scale RAG pipelines, conversational AI solutions, and AI Search integrations across multiple business units.
- Strong at bridging engineering and customer adoption: translating “how/why/what” into working solutions, correcting anti-patterns, and ensuring production success.
- Proven architectural depth: designing APIs, microservices, and data pipelines; building evaluation harnesses, safety guardrails, and governance for AI systems.
- End-to-end delivery mindset: discovery → scoping → PoC → pilot → production with measurable business impact.
🧠 Core Skills
- GenAI & Applied AI: RAG pipelines, LLM orchestration, embeddings, agentic workflows (LangChain, LangGraph, LlamaIndex), evaluation harnesses, safety guardrails (PII/profanity filters)
- Conversational AI: Virtual Agent + NLU, dialog acts, multi-modal workflows
- Architecture & Systems: API design, microservices, scalable data pipelines, system migrations
- Engineering Stack: Python, Java, React/TypeScript, Spring, MongoDB, Oracle, ElasticSearch, AWS
- Enterprise Delivery: Customer-facing solution design, reference implementations, adoption enablement
🏆 Highlights
- Delivered Conversational RAG solutions at enterprise scale — citations, fallback strategies, and KG-enhanced retrieval for precision and trust.
- Architected & built AI Search + GenAI pipelines (retrieval → rerank → LLM inference) with safety guardrails & evaluation frameworks.
- Architected & built an agentic orchestration router for enterprise workflows using LangChain/LangGraph/LlamaIndex.
- Founding team member for Customer Service Management (CSM) and Agent Workspace at ServiceNow — redefining customer productivity with modern UX.
- Partnered directly with customers to scope requirements, fix broken implementations, and deliver successful production rollouts.
- Winner, Innovation Day 2024 and multiple Best Team Player awards.
📂 Selected Applied AI Projects
🔹 Conversational RAG for Enterprise
- Designed and deployed retrieval-augmented generation with safety guardrails (PII/profanity).
- Integrated across Virtual Agent + Portal, with continuous evaluation harnesses to monitor quality.
🔹 AI Search + LLM Integration
- Architected hybrid search pipeline: embeddings, retrieval, rerank, LLM-powered answers.
- Delivered improved self-service resolution and deflection rates for customer support.
- Led safety & observability reviews with product + customer teams.
🔹 Agentic Workflow Orchestration
- Built prototype orchestration router for enterprise task routing.
- Leveraged LangGraph/LangChain for multi-agent workflows integrated into ServiceNow platform.
🔹 Customer Service Management (CSM)
- Built foundational capabilities (case/interaction models, workspace UX, integrations).
- Shipped Agent Workspace, enabling contextual workflows and measurable agent productivity gains.
🔹 Apple Radar & MFi Projects
- Migrated monolithic systems into REST-based microservices.
- Implemented Oracle ↔ MongoDB synchronization with Kafka/Akka.
- Designed Elasticsearch search pipelines for faster internal tooling.
💼 Experience
-
Senior Staff AI Engineer – ServiceNow (2016–Present)
- AI Search, Conversational AI, RAG, LLM integration, and agentic workflows
- Designed architectures with safety, observability, and governance
- Partnered with product and customer teams to deliver scalable adoption
-
Senior Software Engineer – ENACT Systems (2016)
- Core contributor on multi-tenant SaaS platform with analytics and integration APIs
-
System Analyst – Apple (2014–2016)
- Microservices migration, search pipelines, data sync (Oracle ↔ MongoDB)
-
Software Engineer – Apple (2011–2014)
- Full-stack enterprise apps (iProject, WWCC), security hardening, UI/UX workflows
🎓 Education & Certifications
- M.S, Software Systems – BITS Pilani, India
- B.E., Electronics & Communication – VTU, India
-
🎓 Stanford AI Leadership UC Berkeley ML & AI Executive studies Certified Scrum Master