> ## Documentation Index
> Fetch the complete documentation index at: https://docs.b2bsignals.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# A/B tests

> Test versions of a message or an invite, see the results per version, and know when a winner is picked for you and when it isn't.

An A/B test sends different versions of a step, so you can see which works better. Each person gets one version. Results show on the step itself.

There are two kinds, and they behave differently.

| | Versions of your own text | AI versions |
| - | - | - |
| **What differs** | The text people read | The instructions AI writes from |
| **Where you set it** | **Versions**, on the step | **A/B test (AI prompt variants)**, on the **Canvas** |
| **How a version is chosen** | At random | At random, or in turn |
| **Is a winner picked for you?** | No. You keep the text you prefer. | Yes, when the numbers allow it |

Both are judged on the same number: accepted invites for an invite step, and replies for any other step. As the step says: "You see how each version does. We pick a winner only for AI versions, never for your own text."

## Test your own text

**1. Pause if it's running**

Steps can't change while a campaign runs. Click **Pause & edit**.

**2. Open More options on the step**

The step has to use **Write it myself**.

**3. Add a version**

Under **Versions**, click **Add version** and write it. You can have up to five.

**4. Resume or launch**

Each person gets one version, picked at random.

**Versions** isn't offered on an invite with no note, because there's nothing to compare, or on a comment step. It opens after your first launched campaign, or earlier with **Show all options** in **My account**.

## Test AI instructions

**1. Pause the campaign and open the Canvas**

On a campaign that has launched, the **Canvas** opens only while it is paused.

**2. Turn on the test**

On a message step that uses AI, turn on **A/B test (AI prompt variants)**.

**3. Write the instructions**

Under **Variant prompts**, write one per version, such as "Lead with their hiring signal". Under **Variant strategy**, choose **Random** or **Round-robin**.

Once it's set up, the step form shows "This step tests different instructions, set up on the Canvas".

### How a winner is picked

We check AI tests once a day. Counts are across all versions of the step.

| Sends so far | What happens |
| - | - |
| Fewer than 100 | Still testing. Nothing is picked. |
| 100 or more, and the leader is clearly ahead of the runner-up | The leader wins. |
| 300 or more | The leader wins, even if it's only slightly ahead. |

When a version wins, it goes to everyone new. People who already have a version keep it. If you change the instructions after a win, the win is cleared, because the old numbers belong to the old text, and the test can pick again.

## Read the results

Under **So far**, each version shows its sent, replied and accepted counts.

![Versions block with Version B and the So far counts for versions A and B](https://mintcdn.com/b2-b-signals-llc/u5yYe4FZtFc5vtD_/images/campaigns/ab-versions.png?fit=max\&auto=format\&n=u5yYe4FZtFc5vtD_\&q=85\&s=f861cb6f0148a8fa3bf4f074012270b0)

Versions of your own text on a message step, with So far.

| What you see | What it means |
| - | - |
| "Nothing has gone out yet" | There's nothing to compare. |
| "Too early to tell which is better" | Fewer than 100 sends across the versions. Look again after more people have received each one. |
| "Keep the text you prefer" | Your own text, with enough sends to compare. We never pick one for your own text. |
| "more sends before one can be picked" | An AI test past 100 sends with no clear leader. It says how many are left until the leader wins at 300. |
| "Still testing" | An AI test, with nothing picked yet. |
| "Version A won and now goes to everyone new" | An AI test with a winner. |

Differences on small numbers can be chance. Wait for the counts before you change anything.

## Related

> [card] [Steps and messages](https://docs.b2bsignals.ai/campaigns/steps-and-messages.md)
>
> AI text, your own text and step options.

> [card] [Safety pauses](https://docs.b2bsignals.ai/campaigns/safety-pauses.md)
>
> What happens when few people accept.

> [card] [Reports](https://docs.b2bsignals.ai/workspace/reports.md)
>
> Results across campaigns.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.