#AFtalks: Choosing the Right App Monetization Strategy

AFtalks is a series of chats conducted on Twitter where we discuss building and selling apps. We’ve got a different topic/expert every week, and everyone is welcome to join the conversation.

Welcome to our #AFtalks recap!

This week we talked app monetization with Curtis Herbert. From the differences between monetization models to how some models affect the app’s. When it comes to monetization, one size doesn’t fit all.

Curtis is the creator of Slopes for iOS, and an avid Apple enthusiast. We asked him to share his insights on this topic with the questions below. Included are his answers, as well as some of our favorite insights from the community:

Q1: What is your current monetization strategy and why?

A: Monetization has been something I’ve had to experiment a lot with over the course of shipping Slopes and I think I’m finally happy with the current strategy. I’m on my third iteration, since shipping my 1.0 in Sept 2013, of how I charge for Slopes at this point. My current approach looks like this: Slopes is a free download and you get access to high-level data about your day skiing or snowboarding for free. Things like your top speed, distance, time spent on lifts vs in the lodge vs going downhill, etc. All the sweet stuff, like great-looking maps and detailed stats + a 3D replay for each run you took, require some form of Slopes Pass. These passes are sold as either a yearly subscription (think a season pass at a resort), or a consumable unlock for one-day or one-week (akin to the day-passes you buy when going to a resort).

Follow-up: At what stage of the development did you start thinking about monetization?
To be honest I didn’t really start thinking hard about monetization until my big 2.0 in winter of 2015. But with that 2.0, monetization was my main focus. I rebuilt so much of Slopes around my new strategy.

Q2: How did you approach researching monetization strategies for your user base?

A: Since Slopes is a companion to an existing hobby, skiing and snowboarding, most of my research centered around how people were already spending money in the niche. My first iteration, being a paid up front app, was very akin to how people pay for gear. But unfortunately people in general don’t like the paid upgrade model, so convincing them to pay for a 2.0 or 3.0 isn’t as easy as tempting them on some awesome new snowboard.

When I was planning my 2.0, I realized season passes at resorts are basically subscriptions, and that got me to start down the path I’m on today. My focus was to find ways for recurring revenue, and the Slopes Pass model started to make sense to me. You pay for access at a resort, based on how much you go, so why not approach the app like that? You aren’t buying the app, you’re buying access to the services it provides.

Q3: How has your current strategy changed since the app was launched (if it has)?

A: Before that big 2.0 re-work, I just charged up front for Slopes — I didn’t give monetization much thought at the time as I was so focused on building the features I wanted to see. In some ways being paid up front helped because it kept Slopes’s audience small as I built up a really compelling set of features. I honestly don’t think I could have launched with an IAP in my original 1.0.

But even my 2.0 wasn’t quite right, I hadn’t envisioned the one-day and one-week passes at the time. I was just focused on subscriptions with 2.0. But pretty quickly I realized I was missing out on a whole class of my niche: those that can only go on one big ski trip a year. There was no way they’d pay $20/yr for Slopes. So in 2.3 I added one day and one week consumables, to live along side my yearly subscription.

I’m really glad I took the time to re-think things that third time because those consumable passes now account for 50% of my revenue.

Q4: Have you ever experimented with your current monetization model?

A: Since arriving on the consumable/subscription hybrid in 2016 I haven’t tweaked the formula much. Instead what I have been experimenting on (although not as much as I’d like) is pricing in different regions. Turns out the cost of skiing in America is a lot higher than in other parts of the world, so when I moved from a paid up front app to my more expensive subscription option I lost paying users in countries located in Europe and other regions. Fortunately Apple has made this easy to play with, at least with subscriptions (not consumable IAPs), so I started playing with that a little this last winter. I think I need to do a lot more to find the prices that work for Slopes in other parts of the world.

Follow-up: Has that caused any issues with users?
So far none have complained when I experiment! And the bigger move from paid up front to IAP was pretty painless, too, but I attribute that to the fact I grandfathered 1.0 users a lot of stuff to make sure I take care of them. They were my early customers and I felt it was only right to make sure the app they paid up front for kept working as expected, even if some of the features they enjoyed now cost more money for new users. I used to be super paranoid about playing with my pricing (I dreaded the day when as a paid up front app I went from $3.99 -> $7.99. Spoilers: no one noticed, and revenue went up) but now I’ve learned as long as you aren’t doing things to break the trust of users, they largely don’t notice.

Q5: How has your current monetization strategy effected the design of your app?

A: Where I used to focus so much on the design of features (I still do), I find myself spending almost as much time focusing on things like finding the right opportunities to educate and up-sell users the premium Slopes Pass features. I spend a lot more time thinking through what the context of the user likely is on any given screen and look for the right opportunities to prove the value Slopes can provide them. I also spend a lot of time trying to balance what I give away for free, and what I charge for. That’s the downside to being a freemium app: that formula is tough. I need to make sales, but I also need to make sure my free mode has enough to keep people around (and try to convert them in the future).

Q6: What’s the one thing you wish you knew about monetizing before you started this app?

A: I wish I knew how much experimentation it would take to find what worked best for my business, so I could have started much earlier! I wasted two years as a paid up front app, afraid to mess with the model, and that really held me back in many ways.


Check out the rest of the insights we heard today on the #AFtalks hashtag

A huge thanks to Curtis and to all those that were part of today’s discussion! Join us for our weekly Twitter chat every Tuesday at 1pm ET (and bring your friends!). See you all next week where #AFtalks about the business side of apps.

Resources:

Push Notifications for New Reviews and Sales Reports

Since rolling out Alerts last year we’ve sent more than a million emails and Slack messages. Our members love them, and use them to stay on top of their reviews without having to constantly be looking at their reports.

With the latest update to our iPhone app, Alerts for new reviews and sales reports can now be sent directly to your device as push notifications.

Real time alerts for app reviews from Appfigures

Enabling alerts from within the app lets you select the type and the frequency (real-time, or daily). Our goal was to keep the setup simple, and in the future we’ll bring more flexibility for filtering.

We’re already hard at work on new alert types that will go beyond reviews, which we’ll be rolling out in the near future to the site as well as the app. If there’s a specific type of alert you’d like to see please let us know.

This update also includes a few other improvements:

  • Force Touch support, so you can quickly peek at (and pop) reports.
  • Sharing a review now shares a direct link to its card.
  • Simplified login with Touch ID, password manager support, and the ability to login with your Google account.
  • Support for iBooks.

Get the update. Not tracking with us yet? Start your free trial →

We Now Support JSON Feed

A popular feature built into the reviews report is the ability to create custom RSS feeds for new reviews. Set relevant filters, press a button, and get a unique RSS feed you can import into your favorite reader or your own code.

Today we’re excited to release a small but fundamental enhancement to our reviews feeds: JSON Feed support.

We have a lot of technical members and we know they like to integrate app reviews into their existing tools and workflows in creative ways. If you’re still reading, you’re probably one of them.

RSS feeds are great for consuming content and also for working with data programmatically. Our API gives full access to reviews, but sometimes you just want something simple to hack on. The advantage of using the RSS feed is that it doesn’t require an authentication step and is super simple to set up right from the reviews report. The downside from a programmer’s point of view is that XML can be a bit of a hassle to parse with modern tools.

JSON Feed, co-authored by long time Appfigures member Manton Reece, provides a format that’s very similar to RSS but uses JSON instead of XML. For example, here is a JSON feed that’ll show you the latest reviews for our iPhone app:

https://appfigures.com/reports/reviews/json/10193:lzkbrYQos50pkfoMV03TOQ/?sort=-date&products=41308333846

We think this is pretty neat, and hope this new format makes it even easier to consume data. Porting our existing RSS feed into a JSON one was actually quite simple as well. It probably took more time to write and edit this blog post.

For us, supporting JSON Feed serves two purposes. In the long run, we’re doing our part to help replace XML with JSON, and in the short run we’re giving our more technical users a simple way to interact with their data.

Login to generate your own feed. Don’t have an account yet? Sign up for a free trial →

#AFtalks: Plan, Develop, Ship–Advice for App Makers

AFtalks is a new series of chats conducted on Twitter where we discuss the business side of building and selling apps. We’ve got a different topic/expert every week, and everyone is welcome to join the conversation.

Welcome to our #AFtalks recap!

This week’s discussion revolved around the process of making an app–from planning an app to the actual development stage, to launching and keeping it successful. We hope that first-time developers get useful insight as they take on their new projects, and that seasoned developers can share their experiences and maybe even learn new tricks on how to improve their process.

To kick off our very first twitter chat, we invited our CEO + Co-Founder, Ariel Michaeli, to share his insights on this topic with the questions below. Included are his answers, as well as some of our favorite insights from the community:

Q1: What kind of problem were you trying to solve with your app?

A: We wanted our app to simplify analytics so that our users can get a high level overview quickly but also dig in deeper. Once we started designing we realized this is much harder to accomplish if we just “port” the way the site works.

Here’s an example of thinking outside-the-box to solve a problem with an app:

Q2: Did you go native, or cross platform?

A: Native all the way! If you’ve seen/used the app you know it’s very interactive and full of animations. All of that required native code, and a few components built from scratch (like charts). However… that was two years ago, and for a very specific reason. Non-native is much more popular today. One good example of this is Unity, which is now being used to build 45% Android games.

Q3: What advice would you give to a first time app developer when making design decisions on their app?

A: Don’t be afraid to throw out your entire design, even if you invested a lot of time into it. Little known fact, we designed and built a whole app, then didn’t like it and threw it away before shipping. It cost us quite a while, but ultimately resulted in an app that’s much easier to use.

Q4: What tips can you share for having a stress-free app submission process to the stores?

A: Read and follow the guidelines! When we first submitted the app we got a metadata rejection immediately for having a link somewhere we shouldn’t. A silly reason for a launch delay. Also, plan extra time to go through review, so there won’t be a rush to launch on time.

Q5: Your app is approved! What would you do next?

A: We celebrated for a bit, then turned over to marketing and promotion. We got a good amount of traction early on from journalists, ProductHunt and from our member mailing list, and it was important to concentrate all at once. Then it was all about the numbers. We focused on downloads, active users, session length, and how they all work together.

Q6: What is your go-to marketing channel for promoting your app?

A:We’ve had a lot of success with our mailing list and Twitter ads. I’ve heard very different answers though from others. IMO the key is to map out all the channels you can use and pick the ones where the audience is most receptive. For example, a post in the right sub reddit might have a higher return than a paid Facebook ad.

Q7: What are the most important metrics you pay attention to in order to keep your app successful?

A: We look at a combination of things, starting with downloads and usage, and compare them to internal metrics like first-time logins, and how users engage with the app. Our latest update added real-time notifications, so tracking active users has been our focus. Recently 7-day retention is another important metric for developers, but depends a lot on your app. We spend a lot of time looking at the relationship between metrics and conversion rates over time.


Check out the rest of the insights we heard today on the #AFtalks hashtag

A huge thanks to our guest and to all those that were part of today’s discussion! Join us for our weekly Twitter chat every Tuesday at 1pm ET (and bring your friends!). See you all next week where #AFtalks about Monetization Strategies.

Resources:

Image sources: Canva

App Store Cleanup Continues – 50,000 Apps at Risk

Apple is getting serious about cleaning up the App Store. The first wave came in the fall of last year and resulted in thousands of “abandoned” apps being removed from the App Store. Apple is at it again, this time targeting apps that mention their price in their name.

We analyzed more than 2.2M free and paid iOS apps, looking for apps that use their price in their name. 

The Gist

  • More than 50,000 apps and games mention “free” in their name.
  • About 2% of those aren’t even free.
  • Games are the largest group both in absolute number of apps (a tad over 33,000) and as a percentage of total apps in the category (7.5%).
  • Spotify, Disney, Zynga, and EA Games are among the popular developers that use “free” in the name of at least one of their apps.

We started our analysis by looking for apps that mention their price in their name. Although Apple didn’t single out a specific term, running a few queries showed “free” has the most hits and is most likely the term Apple dislikes the most. This analysis focuses on it.

Offending Apps by Category

Let’s jump in. Here’s a category breakdown of the apps we identified. 

Games, as you probably could have guessed, are the largest offending category by far. More than 30,000 games use the term “free” in their name. While most use it once (kind of ok?), we came across quite a few that use “free” twice and even three times. 

Although it’s the largest category, it’s not the only category. Education and Entertainment follow games, with Utilities and Photography right behind them.

Not All “Free” Apps Are Actually Free

You’d expect apps that mention the term “free” in their name to actually be free. But they’re not always. In our analysis we found that roughly 2% of apps are actually paid, and about 40% that use in-app purchases.

The Impact

Continuing on this thread, let’s look at the number of offending apps as a percentage of all apps in their category to gauge the impact this cleanup has.

7.5% of all games are currently in violation of this new rule. The Photography and Entertainment categories could be thinned by about 3%, with Music, Education, and Reference standing to lose more than 2% of apps. Lifestyle, the category with the most apps, stands to lose the least — just under 1%. 

Why Is Apple Doing This?

On the App Store, apps rarely show without their price, so adding the price in the name isn’t really helping the customer. Instead, developers are primarily using this technique as an optimization for search results. It’s obvious why Apple wouldn’t be thrilled about that.

In addition to ASO, it’s also making the App Store look bad. While many developers use the terms gracefully, in our analysis we came across a few that weren’t. Those developers were stuffing their — otherwise simple and customer-friendly — names with two or three instances of the word free making them much harder to read and much less customer friendly.

Who’s Doing It?

You’re probably thinking this technique is something less popular developers are using to gain an edge. We thought so too, but in our analysis we found apps from several well ranking developers that do this, including: Spotify, Disney, EA Games, Zynga, Big Fish Games.

Not a Sweep. Yet.

Unlike the last clean-up, Apple isn’t actively removing apps from the store but rather rejecting new apps and app updates through the review process. 

This means that the App Store still has thousands of apps that are in violation of this new rule. It’s not clear whether that will change, and if so how quickly. What is clear is that Apple is serious about cleaning up the App Store, so if you’re a developer you should keep to the rules.


About the data

These insights came directly out of Explorer, a platform we’ve built to identify trends and get to know apps, developers, and SDKs. Try it out for yourself →

Viewers Can Now Manage Email Reports

Email reports for your mobile apps

Email reports are a core component of the Appfigures platform, giving you a summery of key metrics. They’re so useful, that many of our members rely on them for keeping tabs on their app portfolio daily, some even collect them.

For legacy reasons, we’ve always treated email reports as an account feature. This meant only users with the “admin” permission were able to manage them. We’ve now removed this restriction, giving viewers complete control over scheduling email reports for all of their apps.

If you’re a viewer and would like to manage your email reports simply head into your Account setting area and select the (new) Email reports tab. There you’ll be able to see any reports already scheduled, modify them, create new ones, and remove ones you no longer want to receive.

If you have any questions don’t hesitate to get in touch.

A New Overlay to Make Visualizing Performance Over Time Even Easier

Visualizations make data analysis simpler and more intuitive, that’s why they’re a core component of the Appfigures platform. From the get-go we set out to build reports that enable you to quickly recognize trends and provide the flexibility to combine multiple metrics.

Today we’re adding one more: Prior Period, a new overlay for easy data comparisons over time.

The Prior Period overlay does what it name suggests, and plots the metric you have selected for the date range prior to the one selected so you can see how your app grows over time, across any of the 25 sales, ads, and usage metrics we support.

Using the new overlay you can quickly visualize before and after effect. Easily visualize things like whether an ad campaign had an impact on downloads, if a new feature increased session duration, how revenue compares to last month, and many other types of analyses.

The new overlay is available now to all members on all plans, so go ahead and try it out!
Not tracking with us yet? Get started free.

Lyft Dethrones Uber for First Time

It’s official, transportation tycoon Uber has been surpassed by its competitor Lyft. In response to this weekend’s events, Lyft has shot up into the Top 5 free apps in the US for the first time ever, currently ranked at #4, while Uber, which currently sits at #13 looks up from below. Not only did Uber lose the lead in overall rankings and incite a flux of numerous new poor reviews (read more below), but Lyft has also taken the #1 spot in the Travel category for the US, with Uber now at #2.

Lyft overtakes Uber in the App Store

The news can heavily affect the outcome of businesses and their apps, something that Uber is no stranger to having previously risen in ranks during another taxi strike in the UK in 2014. While it worked in their favor then, this time Uber isn’t having the same luck. While it’s a notable event for Lyft against Uber, time will tell if this is merely a fad brought on by political unrest and protest or if indeed Uber will start to see a drop in business due to any insensitivity they may have caused over the weekend.

It’s Not Me, It’s You

To add salt to the wound, Uber is also seeing a spike in negative reviews. Not a total surprise but who’s writing these? It could be customers leaving poor reviews before deleting the app or it could be new users downloading the app to simply share their views in light of the situation.

Uber gets trashed in app store reviews

One thing is for sure, as expected, the reviews being written have a common voice. “Trump” was the third most used word among the negative reviews, with “CEO” and “Ban” being in the top 10 most used words. Included in many of the new reviews are mentions of “ACLU”, “JFK”, “Immigrant” and “Strike”. Some even go as far as including negative phrases such as “Facist” in their reviews. All in all, more than 95% of all reviews for Uber, meaning 1 or 2 stars reviews, have been negative over the last few days.

App Stores Start to Mature – 2016 Year in Review

2016 has been a busy year both in and out of app stores — new devices, improvements to the buying experience, support for the subscriptions model, and a new App Store for iMessage apps kept developers busy. In fact, app developers have shipped the most new apps in a single year so far, including two of the biggest releases: Pokémon Go and Super Mario Run.

To recap the year by numbers, we’ve analyzed over 5 million apps and will be focusing on two general topics:

  1. App and developer growth trends
  2. The technologies (SDKs) apps are using

Keep reading to find out which categories grew the most, how most games monetize, and more.

App Growth: Steady Does It

Total Number of Active Apps

As of December 2016

Total number of apps in the iOS App Store and Google Play at the end of 2016

Over the years, we’ve seen the number of app releases grow substantially year-over-year as smart phones became standard across the world. In 2016, new and existing developers published a total of 1.1 million new iOS and 1.3 million new Android apps. 2.4 million apps in total isn’t only an incredible number of apps, but also the most apps ever added in a single year.

However, as incredible as this total is, it’s only marginally higher than 2015. Comparing year-over-year growth, it’s obvious things are starting to slow down.

Number of apps released by year to the iOS App Store, Google Play, and Amazon Appstore

Taking into account the number of new releases for the last few years, you can see that the totals are starting to be constant. Over a million apps were added to the App Store for each of the past two years and to Google Play for the past three years.

One tricky aspect of growth is that the bigger you get the harder it is to sustain double digit growth rates. This year both stores opened with a pretty big catalog of apps. Just as an example, for the App Store to have the same growth as last year developer would need to produce more than 1.5 million apps–roughly 500 thousand more than they actually released.

Don’t take this the wrong way, even at a moderate growth rate, app stores will continue to thrive. We see this slowdown in growth as a sign of maturity and stability. What maturity means is that these stores have become entrenched into the lives of billions of people around the globe. Which is great news if you’re in the business of making apps.

Note: We’ve included The Amazon Appstore in some areas of our report, however, with less than 30,000 new apps released in 2016 the Amazon Appstore is no competitor to Apple or Google and will not be the focus of this report.

The Fastest Growing Categories

More than 300 new iOS and Android apps were released every hour in 2016, making Apple’s app reviewers pretty busy. Let’s take a closer look at what kind of apps these were.

Fastest growing App Store categories in 2016

On the App Store, the Shopping and Magazines & Newspapers categories have seen the most growth, followed by Social Networking, Games, and Food & Drink.

iOS Games Nearly Double

Although Games was not the fastest growing in 2016, it did have pretty impressive numbers on the App Store. The category nearly doubled in 2016, adding more than 200k new titles to close the year with almost a half of a million games. Bravo Game developers!

Fastest growing Google Play categories in 2016

On Google Play, Music & Audio and Photography have dominated, each almost doubling. Shopping, Entertainment, And Books & Reference follow, all growing more than 50% each.

Lots of Shopping Apps

Increased popularity of mobile commerce (aka. mCommerce) in 2016 resulted in a barrage of new apps, growing the shopping category three fold on the App Store and by nearly doubling it on Google Play. However, not all shopping apps were created equal. In late 2016 many “fake” shopping apps were detected across both app stores. The fake apps were made to look like the real brands’ app so customers would give them private information. Luckily, both stores caught this in time and removed them right away. because they’re no longer active, these apps aren’t included in our analysis.

Apple’s Big Sweep

In September, Apple announced new regulations that threatened hundreds of thousands of abandoned apps. This raised an obvious question: Is the App Store so big that Apple is okay thinning its catalog?

Probably. While reducing unnecessary competition, this could also be a strategic move by Apple to use quality to differentiate itself from its rival, Google, whose guidelines are much more lax by comparison.

The new regulations effectively force developers to constantly update their apps or face removal. As a policy, this has ramifications for developers but also for the growth of the store. Forcing developers to focus on updates rather than new releases could continue the plateau we’re already seeing. We’ll be keeping an eye on this in 2017.

Developer Growth: Things Are Slowing Down

Total Number of Active Developers

As of December 2016

Total number of iOS and Android developers at the end of 2016

Just as with number of new apps released, we analyzed new developers who entered the market by looking at the first app released by each developer. This includes apps that are no longer available on the store.

Not surprising, the number of new developers releasing apps has begun to moderate in the exact same manner as the number of newly released apps.

Number of new developers starting to release app by year on the iOS App Store and Google Play

In 2016, more than 412 thousand new developers released their first app. Roughly 60% of those new developers released apps for Google Play with the rest releasing their apps on the App Store. As of the end of 2016, Google continues to maintain its lead in this category as well.

Although growth has slowed down, numbers in the hundreds of thousands are still high enough to suggest there is enough excitement about the opportunities that making apps affords.

Categories of Apps Published By New Developers

Putting aside that new developers and apps has slowed, we pulled the top five fastest growing categories with the most number of new developers to see if there were any similarities to the categories found for new apps released this year.

Fastest growing categories by new developers - iOS App Store

There is. As you can see, these line up pretty well with the fastest growing categories from our apps section. The Shopping category dominates with double digit growth on both platforms, followed by Social, Entertainment, and Utilities.

Fastest growing categories by new developers - Google Play


The Most Installed SDKs

Many developers turn to 3rd party tools to help their apps run more smoothly. We looked through millions of apps and compared 20 different categories of SDKs – from Ads and Analytics to Payments and Notifications, to find the top categories and top SDK providers.

Most installed types of SDKs

Ads lead the way by a wide margin, which makes sense considering that’s a way of monetizing apps. Analytics and dev tools compete for second place, followed by Authentication and Backend as a Service SDKs.

Ranking The Top SDK Providers

Advertising

Nearly 65% of all apps in our analysis had at least one ad network installed. AdMob commands the category. Being integrated into the Android development experience gives it a clear advantage. Chartboost and Facebook follow behind, albeit with a big gap.

Top Mobile Ad SDKs - iOS and Android

Analytics

Knowing how users interact with an app is essential to developers. That’s why we were a bit surprised that only 30% of all apps had an analytics SDK installed.

Again, Google leads the way, followed by incumbent Flurry and Facebook right behind.

Top Mobile Analytics SDKs - iOS and Android

Developer Tools

Many apps and games are built using development engines that streamline the process and enable cross-platform publishing. In this category, Cordova leads the way, followed by Unity with Adobe Air a distant third.

Top App Development SDKs - iOS and Android

Authentication

Leveraging a user’s existing online presence makes for much smoother on-boarding and retention. And what better platform is there for online presence than Facebook? The data says there isn’t.

Top Mobile Authentication SDKs - iOS and Android

Note: unlike other categories, we focused on Facebook and Twitter here because they’re by far the most installed SDKs. There are a few others, but none that can compete at such scale.

Backend As A Service

Firebase and Parse are the most used BaaS SDKs. While there are a few competitors, they’re very small at this point (under 1% market share total).

Top Mobile BaaS SDKs - iOS and Android

A Deep Dive Into Games

Games account for more than 25% of all apps and more than half of those apps use at least one SDK.

5 of the Top 10 most used SDKs are ad networks. Considering a majority of games are free, this makes a lot of sense. A selection of tools, like Unity and Firebase, show that game developers don’t like to reinvent the wheel.

Most installed SDK in games

Two Companies Are Responsible For SDKs Installed In > 70% Of Apps

If you’re keeping count you’ve noticed that SDKs from Facebook and Google lead in almost every category. Advertising to backend services, SDKs from these giants are installed in more than 70% of all apps. So, roughly 2 of 3 apps on your smart device talk to Google or Facebook.

What’s Next?

The theme of maturity is consistent across both stores, leaving us with some compelling questions for the new year.

How will Apple’s cleanup affect its growth in 2017? Will Google follow suit? Will consumers find the subscriptions model appealing? Only time will tell. One thing’s for sure, the apps economy is thriving and stable.

About The Data

Data for this report was gathered using Explorer, our mobile app search and intelligence platform. Explorer covers 9+ million apps from all major app stores and provides app store info, SDK analysis, app ranks, ratings, and more.

Written with the help of Lucas Dowiak and Josh Vernazza.

What Went Wrong With Super Mario Run — Analysis of 120,000+ Reviews

Nintendo released its first mobile game last week, and with unprecedented levels of support from Apple, Super Mario Run was poised to become the most successful mobile game the App store has seen so far. However, eager players were less than thrilled once the game hit, sending Nintendo’s stock down 14% in the first few days.

We’ve been covering the release from day one and have noticed its not-too-stellar performance, so we analyzed all of the game’s 120,000 App Store reviews to get a better understanding of what went wrong. 

More Than Half Of All Players Aren’t Happy

To start our analysis, let’s take a look at how the game is rated so far. We collected all 120,000+ reviews available (as of 12/21), and grouped them by star rating. 

What Went Wrong With Super Mario Run — Analysis of 120,000+ Reviews by appFigures

Boy are people unhappy. Overall, 71% of all players gave the game a 1 or 2-star review. That’s harsh. As of right now, Super Mario Run’s average rating is just 2.1 stars. That’s really low for such a well crafted game.

Is this unhappiness widespread, or isolated geographically? To answer this question we looked at all reviews by country and analyzed the top 10 countries with most reviews. In the chart below you’ll see the ratio of negative (1 and 2-star reviews in red) to positive (4 and 5-star reviews in green) and neutral reviews (3-star reviews in gray).

Russia, France, and Italy Are Very Unhappy

What Went Wrong With Super Mario Run — Analysis of 120,000+ Reviews by appFigures

If you thought 71% was high, check out Russia. 85% of reviews from Russia are negative compared to just 10% positive. France, Italy, Japan, and Germany have an above average negative rating as well. The bottom of the top 10 list comes in below average, but not by much, suggesting this isn’t isolated but rather a problem that spans different cultures and languages.

So, what’s upsetting so many players around the world?

It’s All About The Money!

A text analysis of all reviews in English shows the most common topics mentioned include different variations of “price is too high” and “not enough free levels”. The most common words those reviews included were: pay, free, money, price, and purchase.

What we found interesting is that many of the negative reviews were emotionally charged, using words such as sad and disappointed. This just goes to show the expectation Nintendo set when announcing the game in September.

So players don’t want to pay $9.99 for the game. That’s certainly a higher price point than most other games, however we don’t think that’s the only issue. Super Mario Run is free-to-download (demo), and not a free-to-play (freemium), which is a much more common monetization strategy in the App Store.

Demos, unlike freemium titles, limit how much you get access to very strictly, enticing you with a bit and putting up a paywall for the rest. Freemium titles on the other hand, give you access to most of the game for free but offer you upgrades along the way. Successful free-to-play game, like Candy Crush, use consumable in-app purchases so that players need to buy more to continue. They don’t have to, but they can, and that’s a very important difference.

If you’d ask 10 different people whether they like free-to-play titles, 8 would probably say no but would still play those games and won’t leave them extremely negative reviews. That’s why 4 of the 5 Top Grossing apps in the U.S.right now are freemium games.

For a quick comparison, let’s look at similar games from a similar company:

What Went Wrong With Super Mario Run — Analysis of 120,000+ Reviews by appfigures

SEGA’s Sonic Dash, arguably similar in terms of brand recognition and casual nature, has an average rating of 4.5 stars with nearly 3 times the number of reviews. Sure, it’s been around since 2013 and has a head start, but with more than 75% of reviews being positive it’s hard to argue. To make the comparison even more objective we added Subway Surfers, another comparable game with a similar number of reviews. This title also has an average rating of 4.5 stars.

Demos Are A Harder Sell

Why did Nintendo choose the more traditional demo approach and not freemium is hard to tell. Keeping things simple is what the company said publicly, but it’s also possible they relied on the brand a bit too much. In a different world, where Super Mario Run launched as a free game with consumable in-app purchases, things might have been significantly different. Hindsight is always 20/20.

Remember, A Rocky Start Doesn’t Mean Failure

This report paints a pretty unpleasant picture for Super Mario Run, and while that’s true right now, it’s possible (and likely) that between new users, strategic changes, and updates to the game, in time, Super Mario Run will gain momentum and retain players for longer periods of time. Enough to get them to tap that buy button. 

We’ll be keeping an eye on that and report if we see it change, so keep an eye on the blog, follow us on Twitter, or subscribe to our mailing list.

Happy holidays.

Track every review for all of your apps with appFigures. Start your free trial.