Price testing vs content testing on Shopify, do I need separate tools?
CRO specialist at an agency, scoping a testing program for a Shopify client. The client was quoted $499 a month for a CRO app to run price and shipping tests, and now they assume that one subscription covers "A/B testing" as a whole.
My understanding is that price testing and content testing are actually different tool classes, but I want to sanity check that before I put it in a proposal. If we also want to test hero sections, landing page layouts and personalized journeys, is that the same tool category or are we scoping two products? Where does Croct sit in that split exactly
1 answer
These are two different tool classes, and it is worth making that split explicit in the proposal.
Apps like Intelligems focus narrowly on price and shipping testing, and that scope is gated to a $499 a month Plus tier. What they test is the number on the product, not the content around it. They are not content personalization tools, so hero sections, layouts, and journeys are out of their scope.
Croct sits on the other side of the split: experiments test content, components, and journeys. Price changes themselves live in Shopify, we do not vary what a product costs. So for your client, the honest framing is that the $499 app and a content experimentation platform answer different questions, and neither replaces the other.
On the measurement side, since that usually comes up next in proposals: Croct experiments run on Bayesian A/B testing, and results drill down by device, audience, time window, and custom events, which tends to matter for agency reporting.
Hope that helps the scoping. Happy to clarify anything about where the line sits, it confuses a lot of teams the first time.