The A/B testing secret that grew conversions by 101%

Get more from your A/B tests with dynamic heatmaps. As one Lucky Orange user discovered, understanding the customer behavior side of A/B tests can lead to big improvements. 

In Conversion XL’s 2019 State of Conversion Rate Optimization report, A/B testing was the second most effective website optimization tool of respondents, second behind digital analytics. According to Forrester, better user experience (UX) design driven by A/B testing can increase a company’s conversion rate by 400%.

Even former U.S. presidents have used A/B testing to raise more donations.

Back in 2010, the analytics team for the Barack Obama 2008 presidential campaign turned to A/B testing to evaluate call to action (CTA) buttons and different media combinations on his campaign website. This led to $60 million in donations and 288,000 more volunteers.

A/B testing has done amazing things for many businesses. When it’s combined with conversion technology like heatmaps, businesses have new access to deeper insights, better analysis and more conclusive results.

That’s just what Celerity India Marketing Services, a digital marketing and content generation agency, discovered as it coupled Lucky Orange dynamic heatmaps with A/B testing. This perfect combination of testing and analytics provided its team with a closer look at customer behavior that guided them to make effective, data-based updates.

Over a two-month campaign, this winning blend of A/B testing and dynamic heatmaps quadrupled a client’s ROI.  The client was ecstatic about the opportunities to engage with new clients and increased its ad spend with Celebrity India Marketing Services.

Goal: Amplify A/B testing to maximize outputs

Rishi Kalapi, marketing manager at Celerity India Marketing Services, knew he needed more insight. He had a client – a new B2B software company – that wanted to run ads for its niche market.

Rishi’s team launched landing pages for the client’s ad campaign. As the campaigns took off and data trickled in, Rishi needed a way to combine A/B testing results with visitor behavior.  Without a historical analysis available for this new company, Rishi and his team realized it would be vital to do more than look at the data points.

It wasn’t enough to just know which version had more conversions or pageviews

The A/B tests could show that Version A was more successful than Version B, but it didn’t explore what visitors were really thinking.

Why did visitors prefer one landing page over the others?
What concrete data would show how the landing pages were successful?
How could they show the client where customers were interacting with the pages?

Rishi and his team sought out potential options when they learned about Lucky Orange. Similar products were harder to navigate and work with, but Lucky Orange was the perfect fit.

Setting it up on the client’s landing pages took just a few minutes.   As data began to trickle in, Rishi became fascinated by the unique feature set and insight he could gain.

Rishi had everything he needed to dive further into the A/B test results:

Simple user interface? Check!
Dynamic heatmaps? Check!
Budget-friendly subscription cost? Check!
Responsive customer support? Check!

“The features were definitely the closing factor for me,” Rishi said. “I zeroed in on Lucky Orange and decided to go for the free trial. I was extremely happy to see immediate results and decided to go for the subscription because I saw the value it provided.”

Having never used heatmaps before, Rishi was fascinated by the insights it and other Lucky Orange features provided. Lucky Orange’s dynamic heatmaps provided an intuitive, interactive method of understanding how visitors were really using his client’s website.

He could see where they clicked, where they didn’t click, how they scrolled and what they were doing while on the website.

Rishi now had the technology to dig into his client’s A/B tests for actionable, data-driven conclusions.

He said:

“Lucky Orange is a powerhouse of analytics data. Behavioral analysis can be absolutely pivotal to gaining deeper insights into the user’s mind.”

Unleash new opportunities

Rishi wasted no time in putting Lucky Orange to work for his clients.

With the ad campaign underway, Rishi combined A/B testing with dynamic heatmaps. Because the two technologies were working in tandem, he could see visitor behaviors and compare them across the different variations to determine a winner based on more than conversions.

The A/B tests on the landing pages showed that Variant A had more conversions than Variant B. But what about the rest of the digital story?

Rishi and his team were on a search to find out, and Lucky Orange helped them find the answer.

The team wanted to find why Variant A had higher conversion rates, which wasn’t understood fully from the A/B tests. This information could help them build strategies and more effective landing pages in the future.

Using dynamic heatmaps, the team looked at three elements to explore further than the A/B tests: Call to action buttons, headlines and product features:

CTAs
Rishi with Celerity India Marketing Service used Lucky Orange to analyze a landing page's A/B test on CTA buttons.

Recommendation: Rishi’s team suggested changing Variant B’s CTA button to “Claim your FREE 30-day trial,” the more successful CTA from Variant A.

Results: Conversions on Variant B’s CTA button increased by 25% virtually overnight.

Headlines

Lucky Orange helped Celerity India Marketing Team analyze headlines on landing pages.

Recommendation: Rishi updated the headline copy on Variant B to focus on the popular keywords indicated by the dynamic heatmap data.

Results: After making this change, Rishi noticed an improvement in the number of incoming leads.

He said, “visitors responded to the changes made as the new aesthetic and messaging resonated with them and made them want to know more.”

Product features

Lucky Orange helped Celerity India Marketing Services analyze feature popularity.

Recommendations: The team changed the order of features promoted on the page to match the popularity shown in the dynamic heatmaps. Rishi also used it to refocus this client’s marketing efforts such as highlighting the features that their potential customers would be more interested in.

“This helped position the product in such a way that was more appealing to customers. with the unique selling propositions ringing out clearly to ensure the product’s key differentiator being evident,” Rishi explained.

Results: Restructuring the landing page resulted in more responses on the lead generation form and consequently more demos for the client.

Additionally, the marketing campaigns resonated well with customers. Compared to previous campaigns, the campaign driven on Lucky Oranges’s insight had 50% more conversions.

Rishi didn’t stop there.

From dynamic heatmaps, Rishi could jump immediately to session recordings to watch what happened before, during and after an element or part of the website was clicked. He also had easy access to examine form analytics reports.

Session recordings

Having the ability to watch what people were doing through recordings helped Rishi’s team understand which CTA was performing better and where the customers spent time reading based on the movements of the mouse pointer and how far down the page they scrolled.

It also helped understand that the CTA at the bottom of the page was seldom clicked.

As Rishi explained, “We received valuable insights into which sections of the landing page visitors spent most of their time on. It helped us create a new campaign around the feature they showed the most interest in, generating more leads.”

Form analytics

Rishi needed to evaluate how customers engaged with his client’s forms. Using form analytics, he was able to understand how customers interacted with the forms and identified form fields that could be changed or moved further into the sales funnel.

“Form analytics helped us to understand that the more text fields the form had, the less likely it was for a lead to complete it,” Rishi explained. “As a result, we reduced the number of mandatory fields to one, and it helped lower the drop-offs.”

Combined with heatmaps, these new insights from Lucky Orange showed the team that the client’s niche audience often strayed from landing page’s most important information. Based on this, the team provided changes that had a positive impact on conversions.

They looked at:

  • Where on the page audiences were spending the most time
  • Which features they were hovering over with their mouse
  • What form fields has the highest abandonment rates and took the longest to fill out

Rishi added, “We tightened the overall aesthetic of the page and focused all the important information above the fold. Also, with the negligible interest in the CTA at the bottom of the page, we added a button action to scroll back to the top and enter the information in the form above.”

Since using Lucky Orange, Rishi has made changes that more than doubled his client’s leads.

When he saw a dip in the lead generation, he turned to Lucky Orange to direct the next changes. From this, he generated 101% more leads in less than a week and quadrupled the client’s return on ad spend.

Advice for fellow digital marketers

Based on his experience with Lucky Orange, Rishi has five steps for his fellow marketers to get more from their A/B testing results and incorporate it with client reports:

Heatmap advice from Rishi Kalapi with Celerity India Marketing Services

For Rishi and his team at Celerity India Marketing Services, their Lucky Orange story doesn’t end here. It’s just the beginning.

Whether you’re working with a client or on your own website, finding new insight into customer behavior can make a world of difference for your A/B tests, design updates and strategies. To help you get started, we have an exclusive offer for a 100% free extended (14 day) trial — no credit card required.

What are you waiting for? Get started today.

Leave a Reply

Your email address will not be published. Required fields are marked *