Why OCR Breaks Your RAG (And How ColPali Fixes It)
Why traditional text-only parsers destroy financial balance sheets and charts. Comprehensive comparison between VLM Markdown generation and native visual patch embeddings with ColPali.
Senior Applied Data Scientist @ Microsoft
Prajwal Rao
AI Engineer & Systems Tech Lead • Bengaluru, India
I architect autonomous multi-agent pipelines, enterprise LLM evaluation platforms, and high-precision hybrid retrieval engines (RAG). Currently leading AI/ML initiatives at Microsoft shipping to Fortune 500 customers across multi-agent sales automation and security threat classification. Previously built core ML platforms at Swiggy and American Express.
📚 Published Technical Articles & Research
View All Articles →
Evaluating RAG Beyond Vibe Checks: A Production Testing Playbook
Moving beyond vibes-based testing. Complete guide to decoupling Retriever ranking (Hit Rate@K, MRR, NDCG@10) from Generator Faithfulness with calibrated LLM-as-a-judge CI/CD gates.
The 1-Keyword Trap: Mastering Hybrid Search & Reciprocal Rank Fusion
Why pure vector embeddings fail on single-keyword deltas, how Reciprocal Rank Fusion ($k=60$) mathematically reconciles candidate lists, and how cross-encoders eliminate semantic collisions. Includes live interactive simulator!
When RAG Fails: Building Self-Correcting Pipelines with LangGraph
Moving beyond naive static chunking to stateful, self-evaluating retrieval loops. Features an autonomous document grader, query rewrite agent, and fallback decision trees using LangGraph.
Why Most Multi-Agent Swarms Fail in Production
Why monolithic God-prompt LLMs fail under complex workflows. How to architect hierarchical supervisors, peer swarms, and standardize tool execution via the Model Context Protocol (MCP).
Debugging Multi-Agent Systems: The 3 AM Runaway Loop
Emergent multi-agent bugs: circular ping-pong deadlocks and context drift. Complete guide to OpenTelemetry parent-child trace instrumentation and hard token circuit breakers.
Securing Autonomous Agents: Stopping the Confused Deputy Attack
The Trojan Resume exploit in production. How indirect prompt injections weaponize privileged tool execution agents, and how to enforce Bell-LaPadula information flow control and 3-tier capability sandboxing.
Human-in-the-Loop for AI Agents: Cryptographic Dual-Key Approvals
When autonomy must halt for irreversible actions. How to build durable state suspension, asynchronous approval queues, and cryptographic HMAC-SHA256 signature validation with LangGraph interrupts.
⚡ Selected Open-Source Systems
GitHub Profile →Murder Mystery Engine & Agent Arena
Autonomous multi-agent interrogation game. Every suspect is an isolated LangGraph node with stateful memory checkpointers, prompt injection defenses, and forensic ground-truth deduction evaluation.
PropAgent MCP: Multi-Agent Property Ops
Distributed multi-agent residential operations coordinating tenants, owners, and management via Model Context Protocol (MCP). Implements concurrency-safe mutex locks and automated digital gate passes.
CareerVault: Zero-Server Job Auto-Filler
100% local-first Chrome extension using in-browser vector search via transformers.js and IndexedDB to auto-fill custom job application forms in under 3 seconds with zero server egress cost.
Reciprocal Rank Fusion (RRF) Simulator
Interactive mathematical laboratory dynamically balancing dense vector similarity against sparse BM25 lexicons with live cross-encoder re-ranking.
🏢 Career & Engineering Leadership
View Full Profile on LinkedIn →
MICROSOFT
Senior Applied Data Scientist
AI & Multi-Agent Systems Tech Lead
Architecting autonomous multi-agent systems (15M+ msgs/wk across 200+ enterprise tenants) and automated SOC threat triage. Built reusable AgentEval framework reducing validation cycles by 60%, and elevated hybrid RAG retrieval NDCG@5 by 18%.
Azure OpenAI
LangGraph
Multi-Agent Swarms
LLM-as-a-Judge
RoBERTa
LoRA / DPO
SWIGGY
Machine Learning Engineer II
ML Platform & Distributed Inference
Maintained core ML platform powering 5,000+ feature jobs and ~100 models in production. Automated model failure turnaround from 1 day to <2 hours, cut AWS cluster costs by 25%, and engineered multi-headed TensorFlow distributed inference.
Scala
Spark
MLflow
TensorFlow
AWS
Databricks
AMERICAN EXPRESS
Big Data & ML Engineer
Merchant Intelligence & Algorithmic Clustering
Engineered 15TB distributed data pipelines using Spark GraphX, Bloom filters, and Levenshtein clustering for merchant entity resolution, speeding up execution time by 30%.
Spark GraphX
PySpark
Hadoop
BigQuery
Python
TECH MAHINDRA
Software Engineer
Cloud Analytics & Serverless Pipelines
Built 100+ GB network telemetry extraction pipelines for British Telecom and PepsiCo global infrastructure. Developed serverless cloud functions on AWS Lambda (Node.js) for voice AI skills.
AWS Lambda
Node.js
Python
Telemetry
🛠️ Technical Arsenal & Education
LLMs, Agents & Evaluation
LangGraph
Copilot Studio
Model Context Protocol (MCP)
Semantic Kernel
LLM-as-a-Judge
Fine-Tuning (LoRA, QLoRA, DPO)
Hybrid RAG (BM25 + Dense)
ColPali
vLLM
Machine Learning & MLOps
PyTorch
TensorFlow
RoBERTa
Scikit-learn
Qdrant
Spark / PySpark
MLflow
Databricks
SQL
Cloud, Backend & Platforms
Azure (OpenAI, ML Studio, Functions)
AWS
GCP (Data Engineer)
FastAPI
Docker
Python 3.12
Scala
🎓 Education: Post Graduate Diploma in Data Science — IIIT Bangalore (2018–2019) • B.Tech in Electrical & Electronics — Dayanand Sagar University (2013–2017)
📜 Certifications: Google Cloud Professional Data Engineer • Databricks Certified Associate Developer for Apache Spark (Scala) • DeepLearning.AI NLP & TensorFlow Specializations