May 22, 2025

A/B Tests Analytics

Wooxy makes your data digestible, providing you with the valuable information you need to improve your campaigns. It’s easy to monitor trends, track your performance over time, understand the preferences of your audience, and see how you stack up against the competition.

A/B Test Analytics - A/B Testing is useful for optimizing campaigns as it allows you to analyze different campaign components and identify the most effective ones for your business. Campaign data analytics will help in identifying the most effective sending components, such as: Templates, Sender Name, Template Subject, Campaign launch time, and other parameters.

To open Overview Report:

Navigate to A/B Test Analytics page (Menu -> A/B tests -> Analytics). (Заменить линк)
Filter necessary data by period During the test period or During the entire duration.
If needed, you can export analytics for a specific A/B test in PDF or EXCEL format.

A/B Test Analytic parameters

Section	Parameter	Displays for	Description
The A/B Test detailed information	Channel & Status	All channels and test components.	Shows the A/B Test Campaign channel and its status at the moment of the Analytics checkup.
	Name	All channels and test components.	The name of the A/B Test Campaign.
	Test components	All channels and test components.	The tested key element of the Campaign (Content, Subject, From name, Launch time).
	Template	All channels and test components except for the “Content” component.	The Template that undergoes A/B Testing.
	Template A, B, C	All channels but “Content” test component only.	The names of the Templates that are undergoing A/B Testing.
	Email subject	Email Channel. For the “From name”, and “Launch time” components only.	The subject line of the A/B Test email Campaign.
	Email subject A, B, C	Email Channel. For the “Content” and “Email subject” components only.	The subject lines of the emails that are undergoing the A/B Testing.
	From name	Email channel. For all test components except the “From Name” component.	The provided name that is displayed in your recipient’s inbox.
	From name A, B, C	Email channel. For the “From name” component only.	The From names that are undergoing A/B Testing.
	From email	All components of the Email channel.	The email address from which the A/B Test Campaign is sent.
	Reply-to email	All components of the Email channel.	The email address to which your client can send the reply.
	Reply-to name	All components of the Email channel.	The name to which your client can apply for the reply.
	Sender Name	All components of the Viber channel.	The selected Sender Name that your contacts saw when they received a Viber message from your company through the Wooxt.com platform.
	Tags	All channels and test components.	The list of Tags of the A/B Test.
	TTL (Time to live)	All test components of the WebPush and Viber channels.	The defined duration of the push service attempts to deliver the notification or Viber service to deliver the message.
	Telegram bot	All test components of the Telegram channel.	The name of the selected Telegram bot.
	Contact list	All channels and test components.	The name of the selected Contact List.
	Segments	All channels and test components.	Information about the selected Segments that determined the A/B Test Target group.
	Exclude segments	All channels and test components.	Information about the filter, that excluded contacts from the Target group.
	Filtered by	All channels and test components.	Information about the temporarily created segment.
	Excluded by filter	All channels and test components.	Information about the one-time filter, that excluded contacts from the Target group.
	Launch time	All channels. For all test components except the “Launch time” component.	The A/B Test starting time.
	Launch time A, B, C	All channels. For the “Launch time” component only.	A/B Test start time for each variant.
	Criterion	All channels and test components.	Defined criteria for choosing the winning message.
	Duration	All channels and test components.	A/B Test Campaign duration. The winner is determined based on the data for the specified time frame.
	Winning message send time	All channels and test components.	The winner sending date and time. Displayed only for the “send the winning message automatically” option.
The export report button	Excel	All channels and test components.	Downloads all data from the Results table in tabular form (no graphs) in XLSX format on your device. `NOTE` The most comfortable way for the downloaded file to read is to open it via Google Sheets.
The export report button	PDF	All channels and test components.	Downloads data and graphs the way they appear on the page in PDF format.
Winner determination	Winner variant	All channels and test components.	Displays information if the winner is not determined yet: NO WINNER YET- the test is still running; NO WINNER YET – The process of sending to the winner has been halted. Displays the name of the winner – the variant that outperformed all other variations. When the “Content” component was tested, then the displayed Template name of the winner will be clickable.
	Criteria for choosing the winning message	All channels and test components.	Previously defined criteria for choosing the winning message: By open rate – based on unique opens. By click rate – based on unique clicks. By unsubscribe rate – based on the quantity of unsubscribed contacts after the test variants are sent.
	Test duration	All channels and test components.	The specified time frame, during which the winner is determined: 30 minutes 1 hour 3 hours 6 hours 12 hours 18 hours 24 hours
	Winning message send time	All channels and test components.	Appears after the winner is already determined. Displays the date and time when the winning variant will be sent to the rest of the Target group.
	Test components	All channels and test components.	The list of Test components that are objects of the A/B Testing: Content (the names of the Templates are clickable) Email subject From name Launch time
Chart overview	Test components and Final dispatch	All channels and test components. NOTE: Appears only if the duration of the Test is three or more hours. NOTE: Reflects hourly-based metrics dynamic, accordingly to the criterion selected earlier to determine the winner. Each bullet displays a data summary for the last hour.	Horizontal lines show you the dynamics of Test variants and the winner. By hovering the cursor on the bullets the following information is displayed: The Test time frame which has already passed. Test components. The number of contacts that have met the conditions of the winner determination as a result during the previous hour time frame. The Test group percentage for the particular Test variant. You also can view separately only one of the indicators – “Variant A”, “Variant B”, “Variant C”, or “Final dispatch”. Just click on the corresponding field to exclude the parameters view.
Statistic type	During the test period	Al channels and test components.	This option is selected by default. The table below will show you only the data related to the test period.
Statistic type	During the entire duration	All channels and test components.	Select this option from the drop-down menu if you want to display all the data from the very beginning till the moment you check the Analytics.
Results table Reflects all the parameters that occurred during the Test period or during the entire duration.	Variant	All channels and test components.	The list of the tested variants and the winning message. The winner is shown with an icon after being determined.
	Recipients	All channels and test components.	The number of contacts who received test variants and the remaining contacts who received the winning message.
	Delivered	All channels and test components.	The status is assigned as soon as Wooxy has sent a message and it has been accepted by the server of the receiving provider.
	Open Rate	All test components of the Email, Telegram, and Viber channels.	The “Unique opens” is the number of recipients who have opened the A/B Test a unique number of times.
	Opens	All test components of the WebPush channel.	The percentage of viewers who saw your Web Push notification.
	Click Rate	All channels and test components.	The “Unique clicks” is the number of recipients who have clicked the A/B Test a unique number of times.
	Unsubscribed	All test components of the Email channel.	The percentage of recipients who clicked on the unsubscribe link.
	Soft bounces	All test components of the Email channel.	This is an email that couldn’t be delivered because of a temporary reason. Common reasons an email may soft bounce include: The mailbox is full. The message is too large. The server timed out.
	Hard bounces	All test components of the Email channel.	This is an email that couldn’t be delivered for a permanent reason. Common reasons an email may hard bounce: Fake email address. The email address no longer exists. Invalid email address. Email blocked by recipient’s server.
	Marked as spam	All test components of the Email channel.	Indicates the total number of users that have marked your Email Campaign as spam in their inbox.
	Reject	All test components of the Email and Viber channels.	The message was refused due to Wooxy account restrictions: The daily limit for sending emails has been exhausted. An attempt was made to send an email to a contact that is blacklisted. An anti-spam trigger has been triggered.
	Failed	All test components of the WebPush and Viber channels.	The telegram message wasn’t delivered (if the contact unsubscribed from the bot through “stop and block bot” function). This status also typically occurs when the Viber message cannot be delivered to the recipient for various reasons: The recipient is unavailable. If the recipient has blocked your Viber account, messages from your account will not be delivered.
	Expired	All test components of the WebPush and Viber channels.	The Viber messages and WebPush notifications weren’t shown due to TTL (Time to live).