Determining Sample Size for A/B Testing: Method Based on Statistical Hypothesis Testing

Sample Size calculations with SplitMetrics

One of the most popular questions app publishers ask is how much traffic they need to run valid A/B tests. Unfortunately, there is no answer with a magic number that will fit every single experiment. An optimal traffic volume is individual and depends on such factors as a traffic source, app’s conversion rate, and targeting.

However, we can get to the bottom of sample size calculations for А/В tests. It’s really important to have a full understanding of it as sample size has a considerable effect on checking the significance of the observed difference in variations performance.

In this post, we’ll also review one of sample size measuring methods which is widely used and helps to make a statistically valid decision based on the results of your A/B test.
Read more

ASO checklist

Improve your ASO with the World's Most Ultimatest App Store Optimization Guide!

Facebook Pixel Integration with SplitMetrics: Benefits, Detailed How-To Guides, Custom and Lookalike Audiences

Facebook Pixel guide a_b testing splitmetrics main

The latest report of Social Media Examiner states that Facebook is still in the lead of ad channels for both B2C and B2B marketers. 72% of B2C companies use Facebook Ads as their primary social advertising channel. With more than 2.2 billion monthly active users, this ad platform offers incredible targeting options.

The high quality of this ad channel makes it a perfect traffic source for A/B tests. SplitMetrics decided to help publishers to extend their Facebook Ads experience even further introducing  Facebook Pixel integration which helps to increase conversion rate and lower CPI.
Read more

Mobile app tracking platforms: How to choose and set up?

mobile app tracking guide search ads hq main

Enhancement of user acquisition activities is impossible without systematic tracking of mobile ad campaigns efficiency.

These analytics data assists in crafting ad content and optimizing your app store page which is likely to boost mobile apps downloads and installs. Implementation of such analytics eliminates guesswork in the course of planning, budgeting, optimization of mobile app marketing and choosing right user acquisition channels.

Mobile app tracking platforms provide data on user events (such as repeat app launches, level completions, in-app purchases) and a source of app downloads and installs. However, there always comes a question regarding attribution methodology. The specific character of app stores excludes usage of cookies or other PC Web technologies to identify the channel which predetermined app installs.
Read more

Designing Screenshots: A Guide On How To Achieve a 32% Conversion Lift

13 high converting app store screenshots splitmetrics

With our case study from Bubble Birds 4, we tried to show what exact things you can change in your efforts in designing screenshots that will convert and engage users in the best possible way.

In their test, developers wanted to check if a personal approach in designing screenshots will influence the conversion rates of their app page. The following changes have been applied and, as a result, delivered significant performance:

1) The main character overlaid on each screenshot. This way, a bird acts as a storyteller that speaks to users and represents what to expect from the game. Additionally, the character becomes the main element of the screenshot which helps in catching user attention and raises interest.

Read more

The Secret to Winning in Search: How To Run Category Split Tests

Ever thought about how category and search ranking affects your app’s conversion rate? ASO hackers are using a new type of split tests that can precisely tell you all about it.

Many mobile publishers are testing icons, screenshots and descriptions via Google Play experiments or with advanced tools like SplitMetrics. Screenshot tests lead the way here; icons come next. App page design matters – we’ve seen amazing results with Angry Birds, Paper by Fifty Three, Fresh Planet, and hundreds of other publishers.

However, before people get to your app store page, they first make a choice between dozens of similar apps. Category tests empower marketers to optimize conversion beyond the app store page, providing context to collect data on the whole visitor journey.

Interested to learn more? Let’s dive in.

Read more