Pavan Dangeti
Pavan Subramanyam Sai Kumar Dangeti
LLM Engineer: extraction and retrieval systems evaluated on held-out data
AI/ML Engineer Intern at Sacha Global · Final-year B.Tech, Pragati University
I build services, ML models and LLM systems, and publish how each one was measured, including when the simple baseline wins.
Looking for Software Development Engineer (SDE), LLM Engineer and AI/ML Engineer roles: full-time from 2027, and internships. India, open to relocation and remote.
LLM Engineer
LLM
An LLM Engineer turns language models into products people can rely on, owning model choice, prompts, retrieval and output quality in production. The best ones treat evaluation as part of the product: held-out test sets, guardrails enforced in code, and latency and cost kept under control.
How I work in this role
Turns Slack and email into a verified list of who owes what by when. Built for startup founders.
Extracted commitments at 0.981 item F1 on 80 held-out synthetic messages (0.734 on a harder outsider-written set) by verifying every LLM output against an exact quote.
LLMShipped
- Item F1, held-out test
- 0.981
- Baseline: Offline rules 0.848
- GLM 5.3 Flash on 80 held-out synthetic messages, items matched one-to-one, 95% CI 0.950–1.000 by seeded bootstrap. On a harder set written by two outsiders it scored 0.734
Answers questions about long technical handbooks with citations it has checked, for technicians and students.
Answered 19 of 22 development questions correctly (0.86, a small set) by combining hybrid retrieval, reranking and a refusal when a quoted span isn't in the retrieved text.
LLMShipped
- Answer accuracy
- 0.86
- 19 of 22 questions on the development answer set, Gemini 3.5 Flash-Lite, judged by script (results/answer_eval.json); 22 questions is a small set
Lets people who don't write SQL ask a database questions in plain English, with safe, read-only queries.
Built a plain-English-to-SQL service that runs only read-only SELECTs on the chosen dataset, enforced by a sqlglot AST guard and a separate read-only SQLite authorizer.
LLMSDEShipped
No measured results yet: problem, plan and design only.
All projects
Software Development Engineer (SDE)
SDE
A Software Development Engineer designs, builds and runs the services a product depends on, and owns their correctness, latency and cost from design review to production. The best ones build systems that stay correct and fast at scale and under failure, and prove it with tests and measurements rather than assumptions.
How I work in this role
AI/ML Engineer
AI/ML
An AI/ML Engineer takes a model from raw data to production, owning the features, training, evaluation, serving and monitoring. The best ones measure against a simple baseline on leakage-safe splits, ship what actually wins, and notice drift before users do.
How I work in this role
