A/B Testing

With this plugin, you can conduct A/B tests using the widget on the front end. This allows you to run two themes side by side and determine which one delivers the best results.

Create / Edit Test

To create a new test, click the green "Create" button. You’ll be taken to the same (pre-filled) form if you want to edit an A/B test. To do so, simply click the green pencil icon next to the test.

Here you can select which theme should be displayed and at what frequency. For example, you can initially show a new theme to only a few visitors to test how well it works.

Important: If you want to test two themes against each other, you must also disable the “Widget-Cache” in the “Developer-Settings” menu item.

The relative frequency is entered as a percentage in the corresponding “Frequency” fields. The test becomes active only when you toggle the “Activate” switch. Only one test can be active at a time. If you activate a test while another is already active, the previous one will be deactivated.

Evaluation

If you click the blue button with the curve in the overview, you’ll be taken to the test evaluation. Here, the data for the two variants are displayed side by side. A winner is automatically determined based on the higher click-through rate.

In the right-hand column above the graph, you can see the change history of the test—that is, which changes were made to the two themes and when.