Installation
Copy the prompt below and send it to your AI assistant (e.g. Claude Code) — it will follow the instructions and install automatically.
Install the "ab-test-analysis" skill by following the instructions at https://skill123.me/install/ab-test-analysis.
Run in your terminal — downloads and installs to ~/.claude/skills/.
curl -fsSL https://skill123.me/install/ab-test-analysis.sh | bash
Download the zip and extract it into your skills directory (e.g. ~/.claude/skills/), then restart your session.
⬇ Download v1.0.0 · 2 KBAbout this skill
Overview
Analyze A/B test results with statistical significance, sample size validation, confidence intervals, and ship/extend/stop recommendations. Use when evaluating experiment results, checking if a test reached significance, interpreting split test data, or deciding whether to ship a variant.
Source
- Repo: https://github.com/phuryn/pm-skills
- Path: pm-data-analytics/skills/ab-test-analysis
Evaluation
AI-evaluated 2026-09-03: Sound statistical checklist with sample-size formula, SRM check, guardrail review, a decision table, and an output template, though it asks the agent to generate Python ad hoc and hardcodes p<0.05 without multiple-comparison nuance. A/B analysis is a common PM need with no setup prerequisites, and the workflow is read-only.
