StealIt
Corey HainesClaude skill for marketing

A/B Testing

ab-testing

When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics. For page-level conversion optimization, see cro.

Install

Run this in your project folder. It works with Claude Code, Cursor, Codex and dozens of other agents.

$ npx skills add coreyhaines31/marketingskills --skill ab-testing

Needs Node.js. Add -g to install for every project, or -a claude-code to skip the agent picker.

How to use A/B Testing

Once it's installed, Claude reads this skill on its own whenever a request matches what it's for, so you don't have to mention it by name. In Claude Code you can also run it directly by typing /ab-testing.

It contains no scripts, only instructions and reference files, so it can't run code on its own.

What the instructions cover

  1. 1Initial Assessment
  2. 2Core Principles
  3. 3Hypothesis Framework
  4. 4Test Types
  5. 5Sample Size
  6. 6Metrics Selection
  7. 7Designing Variants
  8. 8Traffic Allocation
  9. 9Implementation
  10. 10Running the Test
  11. 11Analyzing Results
  12. 12Documentation

Section headings from the skill's SKILL.md file.

What's inside · 4 files

  • SKILL.md
  • evals/evals.json
  • references/sample-size-guide.md
  • references/test-templates.md

More from Corey Haines

See all →

CopywritingTop pick

When the user wants to write, rewrite, or improve marketing copy for any page, including homepage, landing pages, pricing pages, feature pages, about pages, or product pages. Also…

Marketing & SEOCorey Haines58k

Ad Creative

When the user wants to generate, iterate, or scale ad creative — headlines, descriptions, primary text, or full ad variations — for any paid advertising platform. Also use when…

Marketing & SEOCorey Haines58k

Ads

When the user wants help with paid advertising campaigns on Google Ads, Meta (Facebook/Instagram), LinkedIn, Twitter/X, or other ad platforms. Also use when the user mentions…

Marketing & SEOCorey Haines58k

AI SEO

When the user wants to optimize content for AI search engines, get cited by LLMs, or appear in AI-generated answers. Also use when the user mentions 'AI SEO,' 'AEO,' 'GEO,'…

Marketing & SEOCorey Haines58k

More Claude skills for marketing

See all →

SEOTop pick

Comprehensive SEO analysis for any website or business type. Full site audits, single-page analysis, technical SEO (crawlability, indexability, Core Web Vitals with INP), schema…

Marketing & SEOAgrici Daniel27k

Last 30 Days

Research what people actually say about any topic in the last 30 days. Pulls posts and engagement from Reddit, X, YouTube, TikTok, Hacker News, Polymarket, GitHub, and the web…

Marketing & SEOmvanhorn67k

SEO Agentic

Audit and fix agent readiness: the Lighthouse Agentic Browsing fraction, accessibility tree for agents, robots.txt and Content-Signal for AI agents, WAF treatment of agent…

Marketing & SEOAgrici Daniel27k

SEO Audit

Run a full-site SEO audit and return a scored, prioritized report. Use only for site-wide checks; use seo-page for one URL or seo-technical for a technical-only review.

Marketing & SEOAgrici Daniel27k