Skip to content
Download Longwave

A/B testing skill

A/B testing is part of Corey Haines' marketing skills. Its job is to design experiments with a real hypothesis and a sample size that can answer it. It loads on its own when a request matches its description, and you can also call it by name.

Add to Longwave Source

When the agent reaches for it

The agent keeps every installed skill's description in view and loads the full instructions when a request matches. This is the description it reads:

When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this," "which version is better," "test two versions," "statistical significance," "how long should I run this test," "growth experiments," "experiment velocity," "experiment backlog," "ICE score," "experimentation program," or "experiment playbook." Use this whenever someone is comparing two approaches and wants to measure which performs better, or when they want to build a systematic experimentation practice. For tracking implementation, see analytics. For page-level conversion optimization, see cro.

What the instructions cover

The sections of its SKILL.md, in order.

  • Initial Assessment
  • Core Principles
  • Hypothesis Framework
  • Test Types
  • Sample Size
  • Metrics Selection
  • Designing Variants
  • Traffic Allocation
  • Implementation
  • Running the Test
  • Analyzing Results
  • Documentation
  • Growth Experimentation Program
  • Common Mistakes
  • Task-Specific Questions
  • Related Skills

What ships with it

Besides SKILL.md, the folder carries these. The agent opens them only when a step in the instructions calls for one.

  • evals/ 1 file · 8 KB
  • references/ 2 files · 14 KB

Install the A/B testing skill

For Claude Code, run this in a terminal. It comes from the publisher's own instructions.

terminal 
npx skills add coreyhaines31/marketingskills --skill ab-testing -a claude-code

License: MIT.

In Longwave, add Marketing Skills from the marketplace. It installs all 50 of its skills, and your Claude Code, Codex and OpenCode threads can use them.

Questions people ask

How do I install the A/B testing skill?

For Claude Code, run npx skills add coreyhaines31/marketingskills --skill ab-testing -a claude-code in a terminal. In Longwave, add Marketing Skills from the marketplace, and its skills reach your Claude Code, Codex and OpenCode threads.

When does the agent use the A/B testing skill?

When a request matches its description. The agent keeps only the name and description of each installed skill in view, and reads the full instructions when a task fits. You can also ask for it by name.

Use your skills in every harness.

Longwave installs a skill collection once, and your Claude Code, Codex and OpenCode threads can all use it.

Download Longwave