Answers about analytics
Questions and answers from the Croct community about analytics.
How do we measure A/B test results on a Hydrogen store?
Our first Croct experiment on Hydrogen went live yesterday, a two-variant test on the homepage hero with checkout starts as the goal. I read the Croct guide…
Analyzing Hydrogen experiment funnels in GA4
Our wider ecommerce team lives in GA4, all the checkout funnel reports are built there. We just launched our first Croct experiment on our Hydrogen storefront…
Which storefront events does the Hydrogen SDK track out of the box?
hey folks, coming from React Native so web analytics plumbing is newish to me. We are setting up Croct on a Hydrogen store and I want to build a few audiences…
Where do Storyblok Experiments results actually live? I cannot find a stats view
Expected: launch a native Storyblok experiment, come back a week later, see exposures, conversions, and some significance reading in a results view. Actual:…
Storyblok native Experiments makes us push results through the Management API, is everyone doing this?
We prototyped Storyblok's native Experiments feature last sprint. The variant modeling in the CMS is fine, but the data side surprised me. As far as I can…
Croct experiment conversions vs Shopify analytics orders, why the gap?
I am reconciling a finished experiment before presenting the results internally. Same window, Feb 2 to Feb 15: Shopify analytics: 1,412 ordersCroct…
Where do I see results for experiments started from Storyblok?
Just launched my first test through the Optimize app in Storyblok. The setup went fine but now I am unsure where the results actually live. Do I need to wire…
Can we run Croct analytics without collecting personal data?
Good morning. I coordinate data protection at a publisher and I am assessing whether we can operate personalization and experiment analytics strictly on…
Are experiment results sampled, and do bots pollute conversion numbers?
Two questions before we commit to running experiments here. Are results computed on sampled sessions above some quota? Previous tool we used sampled…
Tagging every Croct event with our release version, is eventMetadata the right tool?
I tag everything we ship with the release version so regressions can be correlated with deploys. I want the same for Croct events: every event annotated with…
Segmenting GA4 funnels by Croct variant for our Sanity experiments
We run experiments on Sanity-fed landing pages and I want to split our existing GA4 acquisition funnels by variant instead of maintaining a parallel…
Enabled bot filtering and my conversion rates jumped, which numbers were right?
Upgraded to Growth last week, turned on bot traffic filtering. Before/after on our main signup experiment: Visitor counts dropped ~20%, conversion rates rose.…