Academic Experiments
Audit and verify experimental evidence for research papers with reproducibility checks.
Installation
- Make sure Claude is on your device and in your terminal.
Skills load from
~/.claude/skills/when Claude Code starts up — so you need it on your machine first. If you don't have it yet, install it once with the command below, then runclaudein any terminal to verify.One-time setupnpm i -g @anthropic-ai/claude-codeAlready have it? Skip ahead.
- Paste into Claude Code or into your terminal.
This copies the whole skill folder into
~/.claude/skills/academic-experiments-joshua-zyy/— the SKILL.md plus any scripts, reference docs, or templates the skill ships with. Safe default: works for every skill.Faster alternative (instruction-only skills)
Skips the clone and grabs only the SKILL.md file. Don't use this if the skill ships Python scripts, reference markdowns, or asset templates — they won't be downloaded and the skill will fail when it tries to load them.
Quick install (SKILL.md only)Sign up to copy - Restart Claude Code.
Quit and reopen Claude Code (or any other agent that loads from
~/.claude/skills/). New skills are picked up on startup. - Just ask Claude.
Skills auto-activate when your request matches the skill's description — no slash command needed. Trigger phrases live in the skill's own frontmatter; you can read them in the “What this skill does” section above.
Prefer to read the source first? Open on GitHub.
When Claude uses it
Audit, run, or verify experimental evidence for CS/AI/ML papers. Produces Evidence Inventory with evidence_type annotations (newly_run/preexisting_artifact/user_claim) and Protocol Risk assessments. Use when: checking if experiment results are reproducible, auditing existing experiment artifacts, running minimal reproducible commands, evaluating checkpoints without full retraining, documenting protocol risks like data leakage or missing baselines. Triggers on: 复核实验, run experiments, 实验结果, experiment evidence, verify results, 实验验证, evidence inventory, protocol risk, 跑实验, check results, reproduce experiments, 实验审计.
What this skill does
Academic Experiments
将此 skill 视为"实验取证代理",目标是建立最短且可信的证据链,而不是尽量多跑实验。
Router Protocol
- Read
manifest.yaml. It declaresalways_loadfiles,axes, andreferences.on_demand. - Read every file listed under
always_load. These are the skill's binding rules — not reference material. - Apply the loaded material as constraints:
stance.mddefines non-negotiable rules, evidence type semantics, failure degradation, and scope.red-lines.mddefines absolute prohibitions. Do not negotiate these.output-contract.mddefines deliverables per mode and claim-readiness classification.anti-patterns.mddefines known failure modes and their correct alternatives.
- Detect the mode using the manifest's
modeaxis:experiment-evidence-pass,evidence-inventory-only, orminimal-reproducible-run. Align evidence type semantics to../shared/core/evidence-policy.md. - Echo the selected mode to the user before executing.
- Reach for
references/only when the manifest'sreferences.on_demandcondition is satisfied.
Modes
| Mode | Use when |
|---|---|
experiment-evidence-pass | Full audit: inventory + run + record + risk analysis |
evidence-inventory-only | Inventory existing artifacts only, no execution |
minimal-reproducible-run | Execute minimal reproducible command (e.g. eval existing checkpoint) |
Agent Dispatch
agents/experiment_agent.md is dispatched by academic-paper-writer orchestrator at Step 4. The agent may run experiments but must not modify project source code or data files, nor write paper prose independently.
Independent Use
| Input | Mode | Priority | Behavior |
|---|---|---|---|
repo_path + no run mode | experiment-evidence-pass | 2 (path trigger) | Full audit: inventory → env → minimal run → risk |
repo_path + "inspect only" | evidence-inventory-only | 1 (explicit) | Inventory only, no commands |
repo_path + specific command | minimal-reproducible-run | 1 (explicit) | Verify env → execute → record |
No repo_path | — | 3 (no input) | Ask path, or auto-detect entry files |
| Scenario | Recommended |
|---|---|
| Just auditing/reproducing evidence | This skill (standalone) |
| Writing results into paper prose | academic-paper-writer orchestrator |
| Draft results need verification | This skill → academic-reviser |
Related skills
Claude API Helper
anthropics
Build, debug, and optimize Claude API applications with caching and model migration support.
Customer Health Scorer
alirezarezvani
Analyze customer accounts to predict churn risk and identify expansion opportunities.
CLAUDE.md Optimizer
daymade
Optimize your CLAUDE.md file for clarity, efficiency, and maintainability.
Phase Knowledge Quiz
rohitg00
Test your understanding of AI Engineering from Scratch course phases.