ab-testing
This skill provides a framework for planning, designing, and managing A/B tests and growth experimentation programs. It guides users through hypothesis generation, statistical rigor, metric selection, traffic allocation, and result analysis.
Is ab-testing safe to install?
Safe to install: our audit of ab-testing's source files found 0 shell commands, 0 external URLs, file reads and writes (low risk). Every command and URL listed appears verbatim in the skill's source. The skill reads local files such as .agents/product-marketing.md for context, but it does not execute shell commands or make external network requests.
How we audit skills: our security review methodology.
Who is this skill for?
Product managers, growth marketers, and developers responsible for conversion optimization and experimentation.
What can you do with it?
- Designing A/B, A/B/n, MVT, and split URL tests
- Formulating hypotheses using a structured framework
- Prioritizing experiments using the ICE scoring method
- Calculating sample sizes for statistical significance
- Building and maintaining an experiment playbook
- Analyzing test results and interpreting statistical confidence
How good is this skill?
Quality score: 5/10. The skill is well-structured, provides clear frameworks for experimentation, and includes specific instructions for context-aware operation.
What does the skill file contain?
# A/B Test Setup You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results. ## Initial Assessment **Check for product marketing context first:** If `.agents/product-marketing.md` exists (or `.claude/product-marketing.md`, or the legacy `product-marketing-context.md` filename, in older setups), read it before asking questions. Use that context and only ask for information not already covered or specific to this task. Before designing a test, understand: 1. **Test Context** - What are you trying to improve? W...
Frequently asked questions
Does this skill automatically run tests on my website?
No. The skill provides guidance, frameworks, and checklists for designing and analyzing tests. It does not connect to or control external testing platforms.
How does the skill use my product marketing context?
The skill checks for the existence of .agents/product-marketing.md, .claude/product-marketing.md, or product-marketing-context.md and reads them to provide tailored advice based on your specific company context.
What statistical method does the skill recommend for sample sizes?
The skill recommends pre-determining sample sizes to avoid peeking and stopping early. It provides reference tables and links to external calculators by Evan Miller and Optimizely.
Related skills
copywriting
123.0KUsers who need to write or improve marketing copy for web pages and require a structured, conversion-oriented approach
The copywriting skill provides a framework for generating and refining marketing copy for websites, including homepages, landing pages, and product pages. It guides the agent to gather product marketing context from local files, apply conversion-focused writing principles, and structure content for clarity and persuasion.
marketing-ideas
81.2KSaaS founders, marketers, and product teams seeking growth strategies and marketing inspiration
This skill provides a structured library of 139 marketing ideas for SaaS and software products. It guides users through selecting strategies based on their product stage, budget, and resources.
community-marketing
29.0KProduct managers, community managers, and founders seeking to drive growth and brand loyalty through community-led initiatives
The community-marketing skill provides strategic guidance for building, launching, and growing online communities. It assists users in defining community identity, designing engagement loops, selecting platforms, and managing ambassador programs.
analytics
17.3KMarketing professionals, product managers, and developers responsible for setting up or improving analytics tracking and measurement
The analytics skill provides a framework for planning, implementing, and auditing marketing and product tracking. It guides users through defining business requirements, establishing event naming conventions, configuring GA4 and GTM, and validating data quality.