Round 1
Let's begin!
🎯
STANDALONE

A/B Testing Competition

Test your decision-making skills against AI opponents

How to Play

1
Analyze Experiments

Review A/B test results including metrics, statistical significance, and potential issues.

2
Make Three Decisions

Evaluate trustworthiness, choose an action, and determine next steps.

3
Advance Through Rounds

Get 2 of 3 experiments correct to advance. Beat AI opponents on cumulative impact.

Decision Framework
  • Trustworthy? — Is the data reliable? Watch for SRM, data loss, or suspicious patterns.
  • What to do? — Keep Base, Keep Variant, or Keep Running based on significance.
  • Next steps? — Celebrate wins, iterate on learnings, validate or rerun if needed.
What is CPD?

CPD = Conversion Points Delta — your cumulative impact on conversion rate. Ship a real winner with +8% uplift? You gain +0.08 CPD. Ship a fake winner (trap)? You might gain 0 or go negative. The player with higher CPD wins!

Your Best Score Round 0 • 0 CPD