Can I watch Clarity session replays split by which A/B variant each visitor saw?
We just moved our testing off VWO and I saw the new Clarity integration go up. We already lean on Microsoft Clarity for recordings, so my dream setup is being able to open Clarity and watch only the replays of people who saw variant B, instead of eyeballing everything and guessing who got what
Is that actually possible now that the integration exists, or am I hoping for too much
2 answers
Not hoping for too much, that is basically what the integration is for. We made the same VWO move earlier this year. Once you connect Clarity, Croct streams into your Clarity project what each visitor actually experienced, the audiences they fit, the experiences that touched them, the experiments they joined and the variants they got assigned. That data lands on the sessions, so you can filter recordings down to exactly the variant you care about.
honestly after we dropped VWO, being able to pull up replays filtered to the exact variant each visitor saw was the thing that finally sold the whole team on the switch. No more guessing who was in which bucket.
If you also want the numbers side, Croct keeps its own experiment results Bayesian and unsampled, so you are not stuck reconstructing conversion rates from replays.
One thing that surprised me coming from VWO: there is no per-session tracking code to bolt on. It is a one-time no-code connection of your Clarity project and then the variant, experiment and audience dimensions just start showing up on the recordings. Same idea as the GA4 side, there is a thread on how Croct data gets into GA4 with no extra tracking code that helped me understand the model. And if you ever want the funnel view instead of replays, breaking a GA4 funnel down by variant works off the same exported dimensions.
This is exactly what I needed, thank you both. Connecting the project now