Countdown bars, free planInstall
Analytics

How to test bar messages using FlexiBar analytics

FlexiBar has no built-in A/B test. Compare bar versions one change at a time, over equal periods, using views, clicks and CTR in FlexiBar analytics.

4 min readUpdated

Applies to: Free and Pro plans (custom date ranges on Pro)

FlexiBar does not have a built-in A/B test. It does not split visitors between two versions of a bar. You can still compare versions fairly: run one version for a set period, change one thing, run the new version for the same length of time, and compare the results in Analytics.

Before you start

  • Pick one number to judge by. For most bars, use Average CTR. For a Selling Bar, use the open rate on Bundle Opens (for message or button changes) or the add rate on Bundle Adds (for offer changes).
  • Pick one thing to change. For example, the message wording, the Button Text, the button colour, or the Countdown block on or off. If you change two things, you cannot tell which one made the difference.
  • Pick a period. On the Free plan, 7 days fits the Last 7 days range. On Pro you can use Custom range for any two equal periods.

Run the comparison

  1. Publish version A and leave it unchanged for your chosen period.
  2. At the end of the period, open Analytics, choose the bar in the bar filter and the matching date range. Write down the views, clicks and CTR, or click Export CSV.
  3. Edit the bar and change only the one thing you chose. Click Save & Publish.
  4. Leave version B unchanged for the same length of time.
  5. Check Analytics again with the same bar and an equal date range. On Pro, use Custom range to set the exact dates for each version.
  6. Compare the number you picked. Keep the version that did better, then test your next change.

Each overview card also shows a change 'vs last period', which can give you a quick signal. Writing down the numbers for each version, or exporting them, is still the most reliable record.

Another way: two bars

You can also build version B as a separate bar with a clear name, such as 'Free shipping v2'. Unpublish version A with Unpublish Now and publish version B with Publish Now. Then use the bar filter in Analytics to see each bar on its own. This works on the Free plan, where only one bar can be published at a time.

Do not publish both versions at the same time and compare them. Both bars would be shown to the same visitors, so the results would not be a fair test.

Keep the test fair

  • Compare periods of the same length that cover the same days of the week.
  • Avoid periods where something else changed, such as a sale, a holiday, a new ad campaign or an email send.
  • Wait until each version has a good number of views. A difference of a few clicks on a small number of views can easily be chance.
  • Keep the same targeting on both versions, such as Targeted Device, Pages and Countries.
  • Do not rename a bar during a test. The bar filter in Analytics finds results by bar name.

Good to know

  • FlexiBar does not pick a winner for you or calculate statistical significance.
  • A rotating Multiple Message bar (Pro) shows several messages in one bar. It is not a test, because every visitor can see every slide.
  • On the Free plan, views stop being recorded if the 3,000 monthly page views are used up, which can cut a test short.

Questions

Does FlexiBar have A/B testing?
No. FlexiBar does not split traffic between bar versions. You can compare versions one after another, over equal periods, using the Analytics page.
How long should each version run?
Run each version for the same length of time and cover the same days of the week. On the Free plan, 7 days matches the Last 7 days range.
Can I run two bars at once to compare them?
Not for a fair test. On Pro you can publish several bars at once, but the same visitors would see both, so the results would mix together.
Learn moreAnalytics features

Still need help?

Chat with us in the FlexiBar app or email support@shopiment.io. Free human support is included on every plan.

Don't have FlexiBar yet?

FlexiBar has a free plan. Pro is $9.99 a month with a 14-day free trial.

Install FlexiBar - Free Plan