Checking AI-Hallucinated References with Pi


I have just co-authored, along with my Pi agent, a new Pi extension: pi-citecheck, used for checking one paper — or a directory of papers — for potential AI-hallucinated references.

It is well known that even the latest generation of large language models can hallucinate citations, and pi-citecheck is designed to convert each PDF paper, extract the references section, and — rather conservatively — check them online using Pi’s native-web-search skill.

Installation is simple:

pi install https://github.com/baochunli/pi-citecheck

Then, inside Pi (assuming that references are in page 10):

/citecheck --refs-page 10 --yes /folder/to/pdfs

The extension will report the current status every 30 seconds.