Design an A/B Test and Statistical Plan

Example prompt to use in ChatGPT or Gemini

Updated September 15, 2025

Prompt

Design an A/B test to validate the impact of '{{change_description}}' on {{product_name}}. Provide: 1) clear hypothesis; 2) primary and secondary metrics with definitions; 3) baseline values and Minimum Detectable Effect (MDE); 4) sample size and traffic allocation calculations with assumptions; 5) experiment duration estimate; 6) segmentation and guardrail metrics; 7) analysis plan (statistical tests, significance thresholds, correction for multiple comparisons); and 8) rollout recommendation based on potential results. Explain assumptions and risks.
Recommended for: gpt-4o

Time Saved

30-45 minutes

How to use this prompt

1

Copy the prompt above by clicking the "Copy Prompt" button

2

Paste it into your preferred AI tool (ChatGPT, Claude, Gemini, etc.)

3

Customize any variables or context as needed for your specific situation

4

Submit and chat!

More Product Manager Prompts

Explore other professional prompts for product managers.