AliExpress is a leading online marketplace, offering millions of products worldwide across diverse categories at competitive prices.
As a global e-commerce leader, AliExpress depends on strong app store performance to deliver a great user experience. To achieve this and make data-driven improvements, the team relies on A/B testing.
However, A/B testing tools on Google Play and the Apple App Store come with limitations that slow down progress and make decision-making harder. Key challenges include:
For AliExpress, these bottlenecks highlighted the need for a more efficient testing solution to drive better results during critical periods.
AliExpress shifted its focus to leveraging organic traffic on its mobile website (Msite) to address the high cost of paid traffic and its differences from organic traffic. The Msite includes features like a Smartbanner and hotspot areas in discount channels to encourage app downloads. Visitors who browse or purchase on the site often install the app for a better shopping experience, making organic traffic an ideal test pool for ASO.
To maximize this traffic, internal download links were upgraded with multidimensional redirect capabilities. These updates allowed specific traffic segments to be directed to SplitMetrics Optimize experiments based on the following conditions:
By running small-scale A/B tests, AliExpress was able to generate reliable results within days and finalize optimized app store pages for launch.
Empowered A/B testing helped us accelerate our ASO strategy iterations and enrich the use cases for our internal download links.
This use case showcases AliExpress’s approach to testing visuals for high seasons like 11.11, Black Friday, and Christmas. The focus was on testing multiple seasonal variations tailored to each event.
Empowered A/B testing unlocks the black box with a scientific approach.
Double 11 (Global Shopping Festival)
Double 11 is AliExpress’s largest annual promotion. For this event, tailored A/B testing strategies were developed for different countries and regions, focusing on optimizing the campaign’s key visuals.
Test results offered clear guidance for display strategies, such as how information was highlighted. Variation B outperformed the other designs, achieving a 13.6% improvement in conversion rates.
Black Friday
For Black Friday, the AliExpress tested various visual elements, including the primary color, background color, screenshot sequence, and text display methods.
The results identified the most effective design, which significantly boosted the conversion rate. Different concepts resonated with users in different regions, achieving improvements of up to 14% in conversion rates. This highlights the importance of tailoring designs to regional preferences for maximum impact.
Christmas and New Year
During the holiday season, a gift theme was incorporated into the in-app screenshot designs. However, different regions had unique perceptions of gift-related colors and designs. Based on these insights, the team developed multiple hypotheses and experimental designs.
Each set of experiments used a controlled variable approach, adjusting product selection, screenshot order, and interest points to align with user preferences. Both variations achieved significant improvements, with Variation B delivering the highest performance:
Additionally, similar concepts tested in other storefronts demonstrated improvements of up to 24%.
The scientific design methodology, as well as the quantitative results, help us better grasp the design strategies and get closer to the users in different countries/regions through the path of rationality.
With SplitMetrics Optimize, AliExpress achieved major success in app store optimization during key promotions and daily operations:
These results highlight the effectiveness of A/B testing in driving app performance and enhancing user engagement across global markets.