Skip to main content
Conversion
5 min readPublished on January 11, 2026Updated on September 09, 2026

A/B Testing for SMEs 2026: A Pragmatic Way to Start

Simon Heistermann

Simon Heistermann

Owner

This article was written with AI assistance and editorially reviewed.

Most A/B tests run by small and mid-sized businesses measure noise, and the outcome gets presented as a finding anyway. Collect a few dozen conversions per variant, then declare a winner, and you have tossed a coin and printed the minutes. Systematic testing is not the right tool for every website - but the alternative is not gut feeling, it is a different method.

In short

A/B testing only pays off past a certain traffic threshold. Below it, qualitative methods like heatmaps and user interviews give you more reliable insight than a statistically undersized test.

Why testing beats gut feeling

Decisions about headlines, imagery or button copy get made on personal taste in many companies - and taste rarely lines up with what actually persuades your specific audience. A test replaces that guess with an observation of how your real visitors actually behave. Small, repeated improvements to the same core elements compound over time more reliably than a single large redesign.

The real value lies less in any one test result and more in the habit of testing at all. A company that regularly checks small hypotheses learns over time what kind of change actually moves its own audience - and which changes are pure matters of taste with no effect on behaviour. That knowledge doesn't come from a single workshop; it only builds up through repeated observation of real behaviour.

When a classic test is even worth running

An A/B test needs enough cases per variant for an observed difference to be more than chance. As a rough guide, that means several hundred conversions per variant before a result becomes reliable - and correspondingly more visitors if your baseline conversion rate is low. Fall short of that regularly, and you're testing noise, not effect.

The reason lies in the statistics behind it: a test compares two samples, and the smaller a sample is, the bigger a real difference has to be before it stands out from chance. With only a few dozen conversions per variant, an apparent winner can look identical to pure noise - both show up the same way in the results. Deciding anyway is deciding by coin flip, not by data.

Test duration matters just as much. A test should run for at least two full weeks even if the required sample size seems to arrive sooner: weekday behaviour differs noticeably from weekend behaviour in many industries, and a test cut short may just be measuring that difference instead of a genuine effect of the variant.

What still works without much traffic

Below that threshold, qualitative methods are the more reliable path. Heatmaps show where visitors actually click and where they drop off. Session recordings show the same journey as video and surface friction points that pure numbers hide. Short, structured interviews with existing customers add the reason behind the behaviour - something a number alone never explains. None of this replaces a statistical test, but at low traffic it gives more reliable signal than an undersized A/B test.

  • Set up a heatmap and recording tool that can run GDPR-compliant without a consent requirement for pure aggregate data
  • Ask your last five to ten customers about their decision process on the site
  • Identify drop-off points in your existing form or funnel before planning a test at all

What's worth testing first

Not every element carries the same weight. Early on, test the elements with the biggest likely effect, not the ones that are easiest to change:

  • Hero headline wording
  • Main button text and colour
  • Hero image, for example with or without a visible person
  • Position of the first call-to-action
  • How the offer or price is presented
  • Where trust signals sit on the page

We cover how these elements fit into a working landing page structure in Landing Page Structure. The reason for this order is simple: an element every visitor sees immediately affects a hundred percent of your traffic. An element further down the page only reaches visitors who scroll that far - so the maximum possible effect of a test on it is smaller from the start. Testing the most visible elements first gets you the biggest possible insight per test.

Concrete steps for the next 90 days

  • Days 1-30: set up a heatmap tool, observe existing traffic for three to four weeks, document drop-off points
  • Days 31-60: with enough traffic, run your first test on headline or main button; with low traffic, run customer interviews instead
  • Days 61-90: evaluate the test, roll out the winning variant, decide the next element to test

Conclusion

Start by checking how many conversions your site collects in a month. If that is enough for several hundred per variant, test systematically on the headline, the main button and the hero image. If it is not, skip the testing tool and put a heatmap, session recordings and five customer conversations first - that is not a fallback, at this volume of data it is simply the more accurate method. We cover which principles are worth testing in the first place in Converting Websites. What ongoing support costs with us is on our pricing page.

Want to know where your website loses visitors?

Get in touch

Frequently asked questions

Simon Heistermann

Simon Heistermann

Owner

Heistermann Solutions is the web studio run by Simon Heistermann. We build custom websites for small and medium-sized businesses that want to achieve more online.

Every article grows out of day-to-day project work and is reviewed editorially before publication.

Get it for free

Enter your email address. You'll immediately receive a confirmation link - after clicking it the checklist is available right away.

Let's talk about your project

Free introductory call