Pavan Dangeti

LLM projects

Each project leads with its outcome, says how it was measured and states its limits. 3 projects.

An LLM extractor that drops any task it can't quote from the message

Turns Slack and email into a verified list of who owes what by when. Built for startup founders.

Extracted commitments at 0.981 item F1 on 80 held-out synthetic messages (0.734 on a harder outsider-written set) by verifying every LLM output against an exact quote.

LLMShipped

Item F1, held-out test
0.981
Baseline: Offline rules 0.848
GLM 5.3 Flash on 80 held-out synthetic messages, items matched one-to-one, 95% CI 0.950–1.000 by seeded bootstrap. On a harder set written by two outsiders it scored 0.734
The cos run command printing a prioritised table of action items from a synthetic Slack and email sample, with owner, due date, source and the reasons for each priority

Question answering over long technical documents that refuses rather than fabricates

Answers questions about long technical handbooks with citations it has checked, for technicians and students.

Answered 19 of 22 development questions correctly (0.86, a small set) by combining hybrid retrieval, reranking and a refusal when a quoted span isn't in the retrieved text.

LLMShipped

Answer accuracy
0.86
19 of 22 questions on the development answer set, Gemini 3.5 Flash-Lite, judged by script (results/answer_eval.json); 22 questions is a small set
The SpecPilot demo page, with a question box and example questions about FAA handbooks