About Me
I'm Rohit Marathe, an AI Systems Engineer based in Atlanta, GA with 6+ years of experience building intelligent software systems.
Currently at Rocket Mortgage, I architect high-availability GenAI pipelines that handle millions of requests at 99.9% uptime. My day-to-day involves designing multi-agent orchestration frameworks, building self-healing incident resolution systems, and optimizing LLM infrastructure for production workloads.
What I Work On
- Multi-Agent Systems — Orchestrating specialized AI agents with AWS Bedrock for complex workflows like mortgage processing and property search
- LLM Orchestration — Building failover systems across Claude/GPT-4 with rate-limiting guardrails for peak concurrency
- RAG & Knowledge Systems — Developing retrieval-augmented generation pipelines with function calling and MCP servers
- AI Observability — Automated LLM-as-a-Judge pipelines using Langfuse and Dynatrace for continuous quality evaluation
Career Path
Rocket Mortgage (2024–Present) — Software Engineer I (AI & Fintech) Building the next generation of AI-powered mortgage experiences. Engineered multi-agent frameworks, self-healing agents, and AI quality evaluation systems.
Kore.ai (2020–2024) — Software Engineer Integrated 20+ conversational AI bots across banking and retail, built PDF extraction pipelines for Knowledge Graphs, and improved NLP accuracy by 11% through few-shot learning.
TIBCO Software (2017–2019) — Software Developer Optimized enterprise financial APIs with semantic caching (3X faster responses) and built fault-tolerant Java/JMS applications.
Education
- M.S. Computer Science (AI Specialization) — University of Central Florida, 2021
- B.E. Information Technology — University of Pune, India, 2017
Tech Stack
Python · Java · TypeScript · AWS (Bedrock, Lambda, DynamoDB) · LangChain · RAG · Docker · Kubernetes · Terraform · CI/CD