Claude Code checks a prompt-injection literature review
Lune reports a Claude Code session that searched prompt-injection defenses, compared five papers and caught unsupported numerical and generalisation claims.
Original prompt
Shared by the source author. See source notes for context.
Survey prompt injection defenses for LLM agents published since 2024.
Reach people exploring AI agents
See placements →What happened
Lune reports a Claude Code session that searched prompt-injection defenses, compared five papers and caught unsupported numerical and generalisation claims.
Reported by Lune Research / Retrograde LabsHow the agent did it
- Connect Claude Code to the Lune research plugin.
- Search several angles on prompt-injection defenses.
- Follow citations to identify papers missing from the initial search.
Where a person stepped in
The author designs the review and tests deliberate mistakes. Returned evidence supports inspection; corpus coverage and interpretation remain review responsibilities.
Lune Research documents a completed Claude Code literature-review session about prompt-injection defenses, using its own research plugin. Four search angles returned 15 papers from selected computer-science venues. Following citations from StruQ found relevant papers missed by the initial sweep, demonstrating why one keyword search was insufficient.
The agent then read full text through research tools and constructed a five-paper comparison table covering mechanisms, training requirements, results and limitations. A claim-checking pass tested four sentences. It rejected a claim that StruQ reduced one attack's success below ten percent because the cited evaluation reported 58 percent. It also rejected an overgeneralisation about fine-tuned defenses, and a further check found that results for a detection method differed under a newer attack.
The author intentionally inserted some mistakes to exercise verification, so these checks are a worked demonstration, not an independently evaluated reliability score. The corpus also excludes workshops, journals and fresh preprints outside its indexed venues; the agent must use other sources for those gaps. The useful workflow is to search several angles, follow citations, compare methods using full text, and check each retained claim against the evidence. The reported result is a traceable review draft with corrected claims, rather than proof of exhaustive coverage.
Prompt
Original prompt
Source: Blog · Lune Research / Retrograde Labs
Frequently asked questions
What mistake did the checker catch?
A claim that StruQ reduced GCG attack success below ten percent was rejected because the evaluation reported a reduction to 58 percent.
Why follow citations after searching?
A citation pass found relevant papers that none of the four initial search angles returned.
Does the corpus cover every paper?
No. The stated corpus covers selected computer-science venues; workshops, journals and fresh preprints outside it require other searches.
More details
Remaining steps
- Read full text and create a method comparison table.
- Verify draft claims and record unsupported statements and corpus gaps.
About this account
Claude Code selects research tools, follows citations, extracts comparable findings and checks statements against retrieved paper text.
Firsthand account by Lune Research / Retrograde Labs; original publication date verified against Published October 1, 2026; separately updated October 6, 2026. Outcomes are the author’s reports, not independently reproduced. Original literature-review prompt excerpt from the primary worked example; not the complete prompt.
Credit: Lune Research / Retrograde Labs
Source published 1 Oct 2026
Source checked 14 Oct 2026
Tools and topics
Claude Code · Lune MCP · Paper search · Claim verification
Literature review · Citation coverage · Claim checking
Editorial completeness: 100/100. Measures documented fields, not agent performance or verified outcomes.