Answers from a PDF manual, with page citations by Jago WesterduinAnswers from a PDF manual, with page citations by Jago Westerduin

Answers from a PDF manual, with page citations

Portfolio project
Jago Westerduin
An assistant that answers questions from a PDF manual. It quotes the manual word for word and cites the page. If the manual does not cover the question, it says so instead of guessing.
The demo document is the virsh manual (libvirt), printed to a 105-page PDF and split into 1,868 page-numbered passages.
It searches whole sections, maps everyday words to the manual's own (guest becomes domain), and scores how much of the question the best section actually covers. Words the manual never uses count against the match, so below the threshold the answer is "not in this manual".
Measured on 30 questions that were written and frozen before the first test run. The right page was cited for 60% of the 20 answerable questions, all 10 off-topic questions were refused, and 73% were correct overall.
Known limit, stated up front. Keyword search misses questions that share no words with the manual. A semantic retriever is the next step, and the same frozen test set measures whether it helps. 12 automated tests, including a check that passages really are on the page they cite.

0 likes · 0 views · Nov 21, 2026

Answers questions from a 105-page PDF manual with page citations, and refuses when it is not covered. Held-out test: right page 60%, off-topic refused 100%.

Tags