All questions

With several experiments live at once, can I isolate replays for just one?

Asked by Sven Olsen on

SOSven Olsen

we run multiple concurrent experiments on different slots, and a single visitor can land in more than one of them at the same time.

When I open Clarity I want to pull the replays for exactly one experiment without sessions from the others muddying the pool. Is that possible, given the overlap?

Was this helpful?

2 answers

KMKofi MensahAccepted answer

Yes. Each session carries the experiments it participated in and the variants it was assigned, sent across from Croct. So in Clarity you filter by the specific experiment and you get only the sessions that belonged to it, isolated from everything else running at the same time.

The dimension is per-experiment, so concurrent tests do not collapse into one blob. Pick experiment X and you see experiment X sessions.

Was this helpful?
YTYuki Tanaka

To your overlap worry specifically: a visitor being in more than one experiment does not confuse the filter. The session simply carries all the experiments it was part of, and each one is a distinct dimension, so the same visitor shows up under experiment A when you filter for A and under experiment B when you filter for B, cleanly separated. Croct also keeps the per-experiment results separate and unsampled on its own side. The thread on running concurrent experiments on different slots covers how the overlap is handled upstream.

Was this helpful?
Still have questions?