Blog
Free
Consult
Engagement
— 5 min read

App Onboarding Experiments Analytics: A Guideline

Properly built end-to-end analytics are the foundation of conducting reliable tests. There are many approaches to building such systems, but one of the most common ones is proven to be the most effective.

<p-l>We are talking about building analytics on the product side and taking the first launch of the product by the user as a starting point.<p-l>

<p-l>Let us dive deeper and see what the taxonomy of the onboarding events should look like to conduct reliable tests. Take this Guideline and adjust it based on your product context. As a member of the Applica team, I am happy to provide these insights and conduct a personal audit if needed.<p-l>

<p-l>Now, we are talking business: methodology and events taxonomy, onboarding monetization, and non-monetization experiments.<p-l>

<step-margin-l>——————————<step-margin-l>

<article-h2>Onboarding monetization experiments<article-h2>

<step-margin-l>——————————<step-margin-l>

<article-h3>Main Metrics and Concepts<article-h3>

<step-margin-s>——————————<step-margin-s>

<p-l>Average Revenue Per User (ARPU) is one of the most important metrics for every product, and Onboarding is the epic where we can impact a product’s ARPU hugely by conducting monetization experiments. Most of them take place on the so-called payment screen, where the user is offered to buy a subscription for the first time.<p-l>

<p-l>Onboarding ARPU is created on the payment screen, but really consists of 3 other metrics:<p-l>

<step-s>1<step-s><p-l-b>Conversion to payment screen — the number of users who opened the app for the first time and saw the payment in the onboarding.<p-l-b>

<step-s>2<step-s><p-l-b>Conversion to purchase — the number of users who reached the payment screen and actually purchased the subscription.<p-l-b>

<step-s>3<step-s><p-l-b>The average revenue per paying user (ARPPU) — what is the average price of a purchase?<p-l-b>

<p-l>What is more, if the monetization model of the product includes a trial period offer of any kind, these two factors affect the APRU:<p-l>

<step-s>1<step-s><p-l-b>Share of the trial activations in total purchases (if applicable);<p-l-b>

<step-s>2<step-s><p-l-b>Conversion from the trial period to the actual purchase (also called trial to purchase, or T2P).<p-l-b>

<step-margin-l>——————————<step-margin-l>

<article-h3>The Analytics You Require<article-h3>

<step-margin-s>——————————<step-margin-s>

<p-l>There is a fairly classic taxonomy of events used to measure onboarding monetization experiments:<p-l>

<step-s>1<step-s><p-l-b>first_session (as a separate event or as an event property of the start_session event) — an event that is sent when the user launches the app for the first time. It is usually used as the first event that initializes the user in analytics. It is also often equated to application installation due to the fact that there are no normal data connectors between the Apple Store and other analytics environments.<p-l-b>

<step-s>2<step-s><p-l-b>payment_screen_open — an event that is sent when the user has reached the payment screen in the onboarding flow. It can be reused for the analytics on non-onboarding payments, but additional event properties will be required.<p-l-b>

<step-s>3<step-s><p-l-b>payment_screen_click — an event that is sent when the user interacted with the screen in some way. Actions are specified as event properties, but the purchase event should be implemented separately.<p-l-b>

<step-s>4<step-s><p-l-b>purchase — an event that should be used for all purchases on all payment screens in the app. Usually, this event has many properties:<p-l-b>

  • origin — on which screen purchase was made;
  • status — whether the purchase was successful;
  • product — what product the user bought;
  • price — what was the price of the product;
  • is_trial — whether this product offers a trial period;
  • trial_length — what is the length of the trial;
  • Other properties such as show_day (on what day of the user’s existence in the app the purchase was made), show_count, etc.

<step-s>5<step-s><p-l-b>ab_test_name — user property that indicates the cohort the user belongs to. It enables you to compare average metrics such as ARPU and I2P (install to purchase) of different test cohorts.<p-l-b>

<p-l>The task is to calculate the amount of revenue per installation in this cohort (ARPU), the number of those who saw the ad and decided to buy, and define the general structure of purchases. The described events should be enough to cover these needs.<p-l>

<step-margin-l>——————————<step-margin-l>

<article-h3>Onboarding Monetization Test Types<article-h3>

<step-margin-s>——————————<step-margin-s>

<p-l>Onboarding monetization tests can be divided into two main types of experiments:<p-l>

<step-s>1<step-s><p-l-b>Optimizing the APRU by changing the layout (design) of the payment screen;<p-l-b>

<step-s>2<step-s><p-l-b>Optimizing the APRU by changing the products (subscription packages). This includes experimenting with pricing, and subscription and trial periods.<p-l-b>

<p-l>It is vital to track all of the metrics described above for both types. However, keep in mind that the layout tests focus on the conversion to purchase and APRU, and pricing (products) tests focus on the structure of the purchases and ARPU.<p-l>

<step-margin-l>——————————<step-margin-l>

<article-h2>Non-Monetization Onboarding Experiments<article-h2>

<step-margin-l>——————————<step-margin-l>

<p-l>Not only Onboarding allows you to optimize the APRU, it also drives other important metrics. We have prepared a list of metrics that are worth conducting non-monetization onboarding experiments on:<p-l>

<step-s>1<step-s><p-l-b>Conversion to onboarding finish — the number of users who launched the app for the first time, and completed the onboarding. Onboarding completion is crucial because it is the end of the onboarding funnel. The better the onboarding is, the more it will activate the users to complete it and start getting the product value.<p-l-b>

<step-s>2<step-s><p-l-b>Conversion into a permit for notifications — the number of users who allowed notifications. Local and push notifications are powerful drivers of the app’s retention. Therefore, optimizing for the said share of users is a must. This metric is especially important for IOS since, on Android, notifications are allowed by default.<p-l-b>

<step-s>3<step-s><p-l-b>Conversion into sign-up — the number of users who registered and/or allowed to include them in the mailing list. Registering users does not only improve their UX in the long run, but it also affects their retention. Products that engage in email marketing significantly drive retention and ARPU, and additionally optimize for users to allow emails to be sent to them.<p-l-b>

<step-s>4<step-s><p-l-b>Conversion into product features activation (applicable only if product features use the user’s answers gathered during onboarding) — the number of users who performed certain actions during the onboarding, which led to their activation in certain product features. For example, for your app to remind your user of their birthday, the user needs to answer the birthday question in the onboarding first.<p-l-b>

<p-l>Thus, by following this guideline’s tips, you should be able to get solid results. If you are looking for a more personalized approach, please contact the Applica team.<p-l>

<step-margin-l>——————————<step-margin-l>

If you found this blog post useful, subscribe to our newsletter to get even more articles and case studies.

Continue Reading

Activation
— 10 min read

First-time User Experience (FTUE)

Discover
Acquisition
— 8 min read

How to Make a Mobile Marketing Strategy for an App

Discover
Monetization
— 8 min read

A Guide to Building Your App's User Personas

Discover
Monetization
— 10 min read

Customer Journey Map Tutorial for Apps (So You Don't Get Lost)

Discover
Retention
— 9 min read

In-App Notifications & User Retention

Discover
Activation
— 8 min read

How to Build Product Walkthroughs for Your App

Discover
Monetization
— 10 min read

Guide to Product-Led Growth with Examples

Discover
Monetization
— 7 min read

Why You Need a Product Growth Manager

Discover
Activation
— 12 min read

Onboarding UX: Provide a Better UX Experience

Discover
Retention
— 10 min read

How to Find Your Aha Moment and Optimize It

Discover
Monetization
— 10 min read

Applica’s Experiment History Review Framework

Discover
Retention
— 7 min read

Customer Retention Strategies Examples for Apps

Discover
Activation
— 5 min read

What is User Activation in Mobile Apps?

Discover
Acquisition
— 5 min read

Best Practices for App Metadata

Discover
Activation
— 5 min read

How to Find User Activation Metrics for an App

Discover
Engagement
— 6 min read

Top Strategies for Mobile App Re-engagement

Discover
Monetization
— 8 min read

Mobile Paywall Examples that Convert

Discover
Monetization
— 6 min read

Difference between ARPU & LTV

Discover
Acquisition
— 8 min read

Fix Your Customer Lifecycle Funnel in 5 Steps

Discover
Acquisition
— 7 min read

How to Reduce User Acquisition Costs for Mobile Apps

Discover
Monetization
— 9 min read

Mobile Paywall Design Best Practices

Discover
Acquisition
— 13 min read

User Acquisition Strategy for Apps 101

Discover
Monetization
— 8 min read

Mobile Product Monetization Strategies

Discover
Monetization
— 11 min read

App Monetization Strategies for Android

Discover
Monetization
— 7 min read

LTV Modeling Your App Deserves

Discover
Acquisition
— 6 min read

User Acquisition Strategies for Mobile Games

Discover
Engagement
— 6 min read

Best Mobile Attribution Tools in 2023

Discover
Activation
— 5 min read

User Activation in Mobile: 5 Easy Steps

Discover
Monetization
— 8 min read

Best Subscription Paywall Solutions for Apps

Discover
Monetization
— 13 min read

How to Monetize Your App: 13 Strategies

Discover
Activation
— 7 min read

Perfect Prompt: How to Make an ATT Prompt That the User Will Accept

Discover
Monetization
— 8 min read

App Growth Strategy: Why You Need It, Action Plan to Build One

Discover
Monetization
— 9 min read

Fake Door Testing: Reduce Risks, Build Efficiently

Discover
Activation
— 4 min read

5 Tips to Boost User Activation

Discover
Monetization
— 7 min read

13 App Growth Metrics We Track, and So Should You

Discover
Acquisition
— 8 min read

App Funnel Strategies in 2023: a Step-by-Step Guide

Discover
Monetization
— 10 min read

Future-Proof Mobile App Growth Strategies for 2023

Discover
Monetization
— 8 min read

How to Kick Off Your Subscription Optimization

Discover