How Sequential A/B Testing Works in SplitMetrics

sequential A/B testing in SplitMetrics

SplitMetrics is excited to announce that our A/B testing platform has switched from the classic approach to the sequential one. From now on, you can test and discover the winning variations of your assets while having an opportunity to:  

  • Spend less time on an experiment;
  • Reduce traffic expenses;
  • Bring down the number of required conversions;
  • Cut the minimal required conversion difference between variations;
  • Decrease false results. 

Read more

ASO checklist

Improve your ASO with the World's Most Ultimatest App Store Optimization Guide!

7 App Store Optimization Tips and Tricks for Early 2020

app store optimization tips and ASO best practices

Non-Trivial Insights and App Store Optimization Tips to Help You Boost Your App Downloads.

With mobile riding the waves, mobile apps are often the first to introduce the latest technologies. But what about platforms where mobile apps are placed? App stores are rapidly evolving as well. For the success of your app, you need to keep abreast of all Google Play and Apple’s App Store innovations, test new concepts and adapt to changes. To make your life a little bit easier, we have drawn together updates, insights and tips for app store optimization that are worthy of your attention right now and will remain relevant in early 2020.
Read more

App Store Optimization: Why You Can’t Optimize Forever

app store optiimization

Many clients turn to us with the same question: can we do anything more to optimize keywords and other metadata on the App Store and Google Play? They are already pretty good, but the sky is the limit, right?

However, the truth is that you cannot optimize app store product page metadata again and again, and expect a big boost in organic downloads.

Read more

Sequential A/B Testing: Workflow and Advantages over Classic Experiments

Comparing classic and sequential A/B testing

When it comes to A/B tests, anyone has a natural desire to get trustworthy results without spending a heap of money on traffic. Alas, it’s not always possible with classic A/B testing which requires enormous sample sizes at times. 

Is there a better way? Sure, there is!

Sequential A/B testing might become a robust alternative. Such experiments don’t only optimize necessary traffic volumes but also reduce the likelihood of mistakes. If you feel like exploring how it works in our platform, read on SplitMetrics sequential A/B testing principles.

Nor, let’s take a closer look at this method theoretically and learn how it differs from the classic A/B testing flow.

Read more

10 Ways to Use Mobile A/B Testing in Pre-Launch: from Ideas Validation to Product Page Refinement

mobile A/B testing in pre-launch

Nowadays, winning users hearts is not an easy task it used to be at the dawn of major app stores. The industry matured and the competition is enormous. Judge for yourself, there are approximately  2.1 million Android apps in the Play Market and almost 1.8 iOS apps available in the App Store.

There’s no use developing a random app in the hope of overnight success. You have to play it smart and validate every single idea before bringing it to life. The best possible way of doing it is an app pre-launch marketing plan.
Read more

Case: Lab Cave Achieves 45.8% Conversion Boost by A/B Testing App Store Screenshots

lab cave app store screenshots

It goes without saying, the two major app stores have different layouts, although the product page elements are quite the same. The differences were evident to the ASO experts at Lab Cave, a mobile growth company providing ASO and Ad Mediation services. After having tested their Play Store visuals, the company made a sensible decision to optimize their App Store screenshots.

Discovering what works better for different app stores was a strong reason, but the main one, however, was to identify what boosts the conversion rate from page visits to installs.
Read more

Guide to Mobile A/B Testing: Proven Strategies, Professional Tips, and App Store Optimization Best Practices

mobile A/B testing guide by SplitMetrics

Mobile A/B testing has been around for quite a while and for a good reason. It can be widely used for marketing purposes: from getting data on the behavior of the target audience to user acquisition on major app stores.

If you understand the value of data-driven decisions, mobile A/B testing might become your go-to solution as it lets you get beyond the guesswork. Splitmetrics teamed up with Apptimize and created a comprehensive guide to App Store and in-app A/B testing which will help you grow your mobile business.

Read more

All You Need to Know about A/A Testing – from Goal Setting to Results Interpretation

A/A testing is the tactic of using a testing tool to test two identical variations against each other. Whether it is worth to conduct A/A testing and, if so, for what purposes are the questions that invite conflicting opinions.

In this post, we explore why some users of testing tools like SplitMetrics practice A/A tests and dwell on the things they need to keep in mind while performing this sort of tests.
Read more

Category and Search A/B Tests: How to Improve App Store Search Ranking

category and search A/B test

Ever thought how category and search ranking affects your app’s conversion rate? Taking into consideration that about 65% of downloads are the result of a search in the App Store, the most successful mobile marketers never disregard the optimization of their apps for competitive surrounding.

If you aim to improve App Store search ranking, a consistent mobile A/B testing strategy is a must. Search and category split tests should become an integral part of such strategy and today we’ll discuss how to run this kind of A/B experiments to guarantee the best possible results.
Read more

Advancing Mobile A/B Testing with Bayesian Multi-Armed Bandit

A/B Testing with Multi-Armed Bandit

In the course of an A/B experiment, the correct calculation of a sample size is one of the key success ingredients. Yet, sometimes the amounts of traffic necessary for statistical significance of tests put app publishers off. Indeed, a required sample size can be large that means a test lasts longer than you’d like.

However, this obstruction is not that dramatic if you run your A/B tests with help of SplitMetrics. The thing is the platform can apply an alternative approach called Bayesian Multi-armed Bandit (MAB), which can solve the above-mentioned drawback without even bothering you.

A Bayesian Multi-armed Bandit test allows choosing an optimal variation of the two or more. Unlike a classic A/B test, which is based on statistical hypotheses testing, a Bayesian MAB test proceeds from Bayesian statistics. In this post, we’ll learn more about the principles behind it.
Read more