This guide to mobile A/B testing with SplitMetrics will cover the following aspects:
For instance, if you want to perform mobile a/b testing in the US store, here are the examples of relevant URLs:
Note: 1 App means 1 localization. If you want to perform mobile a/b testing for different localizations, please, Add New App for each.
Note: all information for a live App is uploaded automatically. For App on pre-launch, you should upload Icon and fill in all gaps manually.
Well done! Your App is added. Let’s move to Experiment Creation.
Note: landing pages for phones and tablets are different and you should run separate tests for them. Make sure you’re sending iPhone users only to an iPhones experiment when you set up a campaign. Otherwise, we will filter out all ‘wrong devices’.
The same principles are applied with Android phones and Android tablets mobile A/B testing.
With ‘Go to custom link’ option, you will be able to add a tracking link on the 3rd step of the experiment if you want to track the number of installs in the real store (after the redirect from the experimental page to your real app store page).
Note: we have integration with AppsFlyer, so the tracking is activated when your experiment is published.
However, even if your App is in the pre-launch phase, you can choose “Go to custom link” and on the 3rd step put absolutely any link you want users to be redirected to, e.g. a page with a list of your other apps, main store page, your website and so on.
Some elements, such as subtitles, video and featured banner are always uploaded manually. Apple API doesn’t allow us to upload these from the store.
Videos for a 6.5″ display (will be used for 6.5”, 6.1”, 5.8” displays):
Videos for a 5.5″ display (will be used for 5.5” displays and smaller):
8. At this step, we add/delete/edit variations for further mobile A/B testing. We recommend to create 3-4 variations and test one variable at a time.
The display sizes have different specifications for screenshots. Make sure that you upload two different sets of screenshots that fall under the following requirements:
Screenshots for a 6.5″ display (will be used for 6.5”, 6.1”, 5.8” displays):
Screenshots for a 5.5″ display (will be used for 5.5” displays and smaller):
Custom Install URL is for the link generated inside your tracking partner to track the number of actual installs after the redirect to your real App Store page. You generate a link for each variation inside Adjust, Tune, Kochava, etc.
Note: SplitMetrics is integrated with AppsFlyer, so you don’t need to insert the tracking links on the 3rd step of the experiment. The integration is activated inside the Running experiment.
Congratulations! You’re a master of experiment creation at SplitMetrics.
If you need any help getting started with mobile A/B testing, use the in-app help button found on the bottom right and we’ll arrange a demo or walkthrough.
If you want to delete an App from your dashboard and add another one, you have to delete all experiments for this App as well.
There are 3 experiment statuses at SplitMetrics: Draft, Running and Finished:
Note: you’re allowed to delete only Draft and Finished experiments. Thus, if you want to delete Running experiment, you should finish it first.
When all experiments were deleted, on your dashboard, you should Tap on the App you plan to delete. Then, double check that there is no experiment and in the bottom right-hand corner Tap “Delete” button.
So, you successfully deleted the App.