Do users keep the same variant when they switch from phone to laptop?
Testing an experiment before rollout. Expected behavior: a logged-in customer sees the same variant everywhere. Actual behavior: my test account saw variant B on mobile, then I opened the site on my desktop and got variant A on the landing page, before logging in. After login desktop also showed B.
Is assignment supposed to be sticky across devices or not? Want to confirm whether this is a bug before I file anything
1 answer
What you observed is the expected behavior, not a bug.
Variant assignment is sticky per user. For identified users, meaning users your application has identified via croct.identify, the assignment follows the user, so they get the same variant on every device and browser.
Anonymous visitors are a different case. Before identification there is nothing linking the browser on your phone to the browser on your desktop, so each one is treated as a separate anonymous user and can receive a different variant. That is why your desktop session showed variant A while you were still logged out.
Once you signed in on the desktop, the profile was identified and the assignment became consistent with mobile, which matches what you saw: variant B on both devices after login. No bug report needed.