Paper Data Auditor
Audit research paper tables and images for statistical inconsistencies and data integrity issues.
Installation
- Make sure Claude is on your device and in your terminal.
Skills load from
~/.claude/skills/when Claude Code starts up — so you need it on your machine first. If you don't have it yet, install it once with the command below, then runclaudein any terminal to verify.One-time setupnpm i -g @anthropic-ai/claude-codeAlready have it? Skip ahead.
- Paste into Claude Code or into your terminal.
This copies the whole skill folder into
~/.claude/skills/paperconan-zixixr/— the SKILL.md plus any scripts, reference docs, or templates the skill ships with. Safe default: works for every skill.Faster alternative (instruction-only skills)
Skips the clone and grabs only the SKILL.md file. Don't use this if the skill ships Python scripts, reference markdowns, or asset templates — they won't be downloaded and the skill will fail when it tries to load them.
Quick install (SKILL.md only)Sign up to copy - Restart Claude Code.
Quit and reopen Claude Code (or any other agent that loads from
~/.claude/skills/). New skills are picked up on startup. - Just ask Claude.
Skills auto-activate when your request matches the skill's description — no slash command needed. Trigger phrases live in the skill's own frontmatter; you can read them in the “What this skill does” section above.
Prefer to read the source first? Open on GitHub.
When Claude uses it
Use when auditing a paper's source-data tables and figures for statistical red flags — interprets paperconan scan output, reviews images for inconsistencies, drafts cautious research-integrity notes, and fetches open supplementary data from a DOI or title.
What this skill does
paperconan
paperconan scans paper source-data tables and can register local image assets for external Agent review. Treat every hit as signal, not verdict: report locations and patterns, never intent or personal accusation. PaperConan does not manage model keys or provider SDKs and does not perform autonomous semantic judgment.
Tool repository: https://github.com/zixixr/paperconan
Core Workflow
- Ensure the CLI is available before scanning: run
paperconan --version. If it is missing and pip works, install once withpip install "paperconan[all]"(ask first if a virtualenv or non-global install is preferred). If Python/pip is unavailable, ask the user to install and run locally — never invent output. - Confirm what the user supplied:
- Local source-data directory: run
paperconan <input-dir>. - DOI or title: run
paperconan fetch "<DOI or title>", choose a matched tabular dataset, download it, then scan the downloaded directory. - Only an existing audit: read
audit/scan.jsonand useaudit/report.htmlas the evidence browser to triage — then give an adjudicated answer. Do not hand the rawreport.htmlover as "the result" (see Report Positioning below).
- Local source-data directory: run
- Prefer the real CLI. Do not invent findings from eyeballing tables.
- Parse
scan.json, then load the reference file needed for the task. - Open the original table when describing a serious finding as worth follow-up. If the original data is unavailable, say the finding is unverified.
- Answer cautiously: explain the anomaly, plausible benign explanations, and what human context is needed.
Adaptive Image Review
Use this workflow when the user requests image review or the source directory contains figures that should be reviewed with the numeric material:
- Run
paperconan <input-dir> --images; add--image-diagnosticsonly when deterministic hints are useful. - Read every entry in
image_assets; deterministicimage_findingsare hints and never the complete review set. An emptyimage_findingslist does not mean that every image question was resolved. Deterministic pair hints compare two regions within one registered asset only; they do not compare assets. - Confirm the current Agent can open local images.
- If yes, inspect the whole image first, then use a native-pixel crop for small panels or unresolved detail.
- If no, set
image_review.statustounavailable_no_multimodal, continue numeric review, and state that image semantic review was not completed.
- For every asset, record exactly one coverage outcome in
reviewed_asset_ids,unresolved_asset_ids,unreadable_asset_ids, ordeferred_asset_ids.image_review.status: "completed"means coverage accounting is complete; it does not mean every image question was explained. - Check figure labels, channels, processing steps, shared controls, insets, before/after layouts, figure legends, and Methods before escalating an image similarity signal.
- The external multimodal Agent is responsible for cross-asset comparison and
may create an image finding using
image_refseven whenimage_findingsis empty. Such Agent-only image findings belong in the verdict, not in deterministicscan.json. - Put numeric and image findings in the same
verdict.json findings[], then generate a single unified report withpaperconan report.
PaperConan supplies registered local assets, bounded report previews, and optional deterministic hints. The external multimodal Agent is responsible for capability detection, semantic review, coverage accounting, and cautious contextual interpretation.
Review Modes
Choose the lightest mode that satisfies the user request:
- Single-paper scan: fetch/scan if needed, open the source table for serious findings, check labels/legend/Methods when available, then give a concise answer using references/report-templates.md only if a report is requested.
- Single-paper formal review: after scan and source-table verification, load references/adjudication-tiers.md and references/report-templates.md. Use Tier labels only as review priority / innocent-explanation difficulty, never as author-intent conclusions.
- Batch review: use references/batch-workflow.md. Keep deterministic paperconan output separate from agent judgment. Preserve DROP reasons because repeated false positives can guide future filters.
- Adversarial review: for Tier 1/Tier 2, PubPeer drafts, public-facing claims, or filter changes based on alleged false positives, load references/adversarial-review.md and try to refute the concern before confirming it.
Do not write a full eight-section report for ordinary scan summaries. Use the full report only for Tier 1/Tier 2 KEEP, PubPeer-style drafting, formal research-integrity notes, or when the user explicitly asks for it.
Report Positioning
The pipeline is scan → agent triage/judgment → adjudicated report. Keep the two report artifacts distinct:
audit/report.html(from the bare CLI) is a deterministic detector / evidence browser — a triage worklist. It is false-positive-heavy by design and represents no judgment. It is an intermediate artifact, not the user-facing deliverable. Never present it as "the audit result".- The user-facing deliverable is always agent-adjudicated, produced only
after you triage
scan.json, open the source tables for serious findings, and weigh benign explanations: a short adjudicated summary for ordinary cases, or the eight-section report (paperconan report scan.json --verdict verdict.json --out …) for Tier 1/Tier 2 KEEP and formal/public writing.
So the raw report.html is what you read to triage; the adjudicated summary or
eight-section report is what the user receives. A plain CLI user who only runs
paperconan <dir> has no agent in the loop, so they see only the raw browser —
tell them the findings still need human/agent triage before they mean anything.
Install And Run
pip install paperconan
pip install "paperconan[image]" # image assets, PDF page rendering, optional hints
pip install "paperconan[all]" # includes PDF / Word table extraction
paperconan --version
paperconan <input-dir>
Default output:
<input-dir>/audit/scan.json
<input-dir>/audit/report.html
Useful variants:
paperconan <input-dir> --out /tmp/audit-X
paperconan <input-dir> --md
paperconan <input-dir> --no-html
paperconan <input-dir> --profile forensic
paperconan <input-dir> --images
paperconan <input-dir> --images --image-diagnostics
paperconan report /tmp/audit-X/scan.json --verdict verdict.json --out adjudication.html
If Python or package access is unavailable, tell the user to run the command locally. A manual review may be offered only as a non-authoritative hint and must not be presented as paperconan output.
Fetching Data
Use fetch only when the user gives a DOI/title instead of local files:
paperconan fetch "<DOI or title>"
paperconan fetch "<DOI or title>" --json
paperconan fetch "<DOI>" --download <id> --out data/
paperconan fetch "<DOI or title>" --auto --images --out data/
paperconan data/
paperconan data/ --images
Prefer candidates with doi_in_related: true. Repository search can return unrelated deposits, so report weak matches honestly and do not imply "no data found" means "paper is clean". Do not bypass paywalls or scrape publisher sites.
Profiles
--profile {review,forensic,triage} changes what you see in scan.json:
reviewis the default. It keeps likely false positives visible but may demote them tolow.forensicpreserves raw detector severity. Use it before saying a concerning hit was only low severity under the raw detector.triagehides likely false positives.
When a finding has profile_action: "demoted" or profile_action: "hidden", the active profile changed the visible severity. Use prefilter_reason, prefilter_flags, and false_positive_context to explain why, then decide whether the filter reason actually fits the table context.
For deterministic image hints, profile_action: "kept" is informational.
Image hints do not pass through the numeric prefilter and are not demoted or
hidden by review, forensic, or triage.
Reference Routing
Load references only when needed:
- references/output-schema.md: read before parsing
scan.jsonor explaining fields such asprofile_action,prefilter_reason,value_sample,col_a_sample, orcross_sheet_findings. - references/detectors.md: read when interpreting a detector kind and its common false positives.
- references/judgment-rubric.md: read before ranking findings, judging within-column signals, or drafting PubPeer/research-integrity language.
- references/interpretation.md: read when composing the final user-facing answer or handling requests to accuse, expose, or escalate.
- references/adjudication-tiers.md: read before assigning
Tier 1/2/3,KEEP,DROP,NEEDS_HUMAN, orimpact_scope. - references/report-templates.md: read before writing a formal report, PubPeer draft, research-integrity note, or batch verdict JSON.
- references/adversarial-review.md: read before confirming Tier 1/Tier 2, public-facing concerns, or proposed filter changes.
- references/batch-workflow.md: read when reviewing multiple papers or organizing candidate queues.
- references/case-patterns.md: read for synthetic calibration patterns only; do not treat them as real case precedents.
Judgment Discipline
- Never convert
severityinto an author-intent conclusion. Severity means anomaly strength after the active profile, not author intent. - Never convert
Tier 1/2/3into an author-intent conclusion. Tier means follow-up priority and difficulty of innocent explanation after context review. - Inspect cross-sheet reuse and cross-column transforms before weaker single-column patterns.
- Prefer benign structural explanations first: shared controls, re-plots, unit conversions, formulas, indices, ratios, normalized values, model outputs, detection floors, and bounded scoring scales.
- Treat
within_col_*findings as false-positive-heavy by default. Do not strongly reportn < 10, categorical/index labels, derived columns, fixed-denominator ratios, rounded grids, floors/ceilings, or repeated fill values. - Use "needs human context" when you cannot confirm row independence, raw measurement status, formula generation, Methods/legend meaning, or original-table provenance.
- For PubPeer-style writing, provide concrete file/sheet/column evidence and questions for the authors; do not accuse authors or state an intent conclusion.
- Do not use real papers as public calibration examples unless the user has explicitly asked to prepare a specific public note and the evidence has been checked against source data and paper context.
Output Shape
A normal scan summary should include:
- What was scanned and whether any files failed to parse.
- The highest-priority findings after manual/field-level triage, grouped by file.
- Concrete evidence snippets: detector kind, location,
rule,n, and a small value sample when useful. - Plausible benign explanations and what would resolve them.
- A pointer to
report.htmlfor highlighted table context.
For batch or agent-to-agent workflows, an optional verdict JSON may use:
verdict, suspicion_tier, impact_scope, tier_why, drop_reason,
innocent_explanation, needs_author_data, report_md, review_status, and
finding_refs (selectors naming which scan finding(s) the verdict adjudicated,
so the rendered report scopes its evidence panel to them). When a paper has
more than one distinct finding, use a paper-level object with a findings
array (each entry adjudicated on its own tier/status with its own
finding_ref); the report then renders one self-contained block per finding.
See references/adjudication-tiers.md and
references/report-templates.md.
For adaptive image review, scan.json image_assets[] is the complete registered
asset inventory while image_findings[] contains only optional deterministic
hints. Add Agent conclusions as finding_type: "image" entries with
image_refs, and add top-level image_review coverage. Numeric and image
entries, including Agent-only cross-asset observations, all remain in the same
findings[] and the single unified report; do not create a separate image
verdict or a second user-facing report.
When a verdict JSON already exists, paperconan report <scan.json> --verdict <verdict.json> --out <html> renders a separate adjudicated report. Do not
confuse this with the default deterministic audit/report.html; the
adjudicated report is only as reliable as the human/AI verdict and source
context behind it.
If the user asks for an author-intent conclusion, answer that paperconan cannot determine that. The next step is to verify the original data and, if concerns remain, ask for clarification through PubPeer, the journal, or a research integrity office.
Related skills
Claude API Helper
anthropics
Build, debug, and optimize Claude API applications with caching and model migration support.
Customer Health Scorer
alirezarezvani
Analyze customer accounts to predict churn risk and identify expansion opportunities.
Adaptyv Protein Lab
foryourhealth111-pixel
Submit protein sequences for automated lab testing and validation experiments.
CLAUDE.md Optimizer
daymade
Optimize your CLAUDE.md file for clarity, efficiency, and maintainability.