Job Spotlight

Games Programmer
Dependant on experience
UK - London

OPINION: The problem with game analytics

OPINION: The problem with game analytics

Game Investor Consulting's Rick Gibson on why constant click-reading won't breed innovation

When we first started writing about what’s come to be called social gaming, it was clear that any company looking to enter the space would a need new skill set to successfully navigate the social graph.

Principal amongst them was learning how to deal with the fire hydrant of data on user behaviour. The resulting discipline of analytics has rapidly become central to the success of all social games companies, but its use without moderation could hamper future market growth.

ANALYSE THIS

Customer profiling used to mean – and still does for some traditional publishers – focus groups and the odd consumer survey; fairly blunt marketing instruments that rely on consumers being transparent and accurate (a rare occurrence).

Early web businesses bought off-the-shelf client-based solutions that analysed log files and counted click-throughs and page impressions to convert them into advertising dollars.

Advertisement

Processing and bandwidth constraints drove providers to sample a tiny proportion – perhaps 10 per cent – of total usage and then extrapolate, charging clients for every byte processed.

Many analytics companies still use the sampling model, which often results in serious inaccuracy, is often not real-time and can be unaffordable for those games services with bulky user data. Many, particularly those selling virtual goods, find sample-based solutions unfit for purpose, and so turn to new, cloud-based solutions to provide detailed, real-time analysis of the data flow.

These new analytics tools allow unprecedented insight into your players – who they are, where they came from, what they play, what and how they buy, who they recruit on your behalf and, ultimately, how valuable they are to you.

Once you’ve asked whether that cherished new gameplay mechanism actually works or if those expensively acquired new customers are worth it, it becomes apparent that analytics can inform all parts of your online business. These hard-to-find practitioners of the dark arts can have dramatic impact on businesses large or small.

However, analytics are useful only to studios prepared to turn the data into meaningful actions, which in practice means continual experimentation and continuous production, all of which can be a cultural challenge for staff schooled in fire-and-forget console development.

In the early days of social gaming, before microtransactions became a real revenue source on Facebook, many failed to realise how critical analytics would become to their businesses.

What differentiated Zynga was that, since its inception, management placed data mining at the heart of its operation. Today scores of analysts continuously sift Zynga’s vast customer data flow in real time, segmenting their audience, optimising customer acquisition and passing intelligence to designers and programmers to improve the customer experience, and, ultimately, drive up sales.

This more detailed understanding of customers means practitioners understand what, how, why and when customers purchase and can therefore make more of what they like best. They can react to customers faster, which keeps players engaged and buying for longer.

Above all they smooth out any friction to deepen engagement, raise conversion rates and minimise customer drop off. This can add up to businesses that are more efficient and responsive to consumer demand and ultimately more profitable because there are fewer unknowns about their existing users.

But here’s the serious flaw: analytics, however real-time, are fundamentally retrospective. They can only make you aware of what today’s users do with your existing app.

They can’t tell you what new app to build tomorrow for new audiences. This retrospection is patently visible today in many social game designs, some of which are repetitive and self-referential.

ANALYSE THAT

The sheer numbers of saccharine, flavourless, me-too titles aping 1990s games designs show the perils of allowing your existing players to lead you by the nose. Without checks and balances, analytics will predetermine what you design, resulting in constant evolution but few – if any – revolutions. Have any brave new frontiers yet been discovered in social gaming?

What innovations do arise are swiftly copied because barriers to entry are so low. Zynga, a fast follower par excellence, will snap up nice little ideas as well as a dozen or so companies, doing a decent impression of its silverbacked forebear, Microsoft.

One reason for Zynga’s acquisitiveness, as repeatedly demonstrated by Microsoft and Google, is that when innovation is hard to create internally, management compensate by trying to buy it.

Historically, few succeed, and analytics can exacerbate this tendency.

There’s undoubtedly huge mileage in watching your customers closely, and sensible use of analytics combined with inspirational games design will result in more sustainable, profitable companies.

Insights are key

posted by Justin Johnson Mar 10, 2011 at 10:02 am
1
Justin Johnson

Whilst it's true that analytics are no silver bullet, what analytic data allows you to do is to obtain insights into the behaviour of your intended player market - without that you're blind. And you're right, just collecting data is a useless activity without the planning in place to be able to act on those insights. That's critical. Analytics is something that needs to become part of the fibre of any company using it.

They can tell you which features of your existing games are most popular, which parts of your game are too easy/too hard and whereabouts you can deliver more relevant content to players and consumers. Any key insights into your player behaviour is going to give you a steer on what you develop for them tomorrow. Without data all you have is guesswork, hunches and intuition - all useful, but also very high risk alone, especially in a dynamic industry like the gaming industry.

Zynga continues to get a lot of flak from the mainstream games industry. But they enabled simple 'pop-corn' gaming for people to engage with in-between social digital activities. They measured the engagement and geared their products to provide piece-meal entertainment whilst generating considerable revenue. The games industry should perhaps be thankful because it's suffering at the moment, in many places being decimated, and these new social players may well migrate to core game players via this kind of passive introduction to gaming. It's also hard to knock a company that's now valued $7bn - $10bn.

So yes, analytics are retrospective - they are, after all, a record of operational history. But the insights from that record should be used to iterate on future versions of game releases and help steer new product development. Combine that with creativity and you'll have something really special.

  • + 0 
  • - 0 
  • 0

Creativity and local maximums

posted by Patrick O'Luanaigh Mar 10, 2011 at 10:18 am
2
Patrick O'Luanaigh

I think Justin's final comment is spot on - that combining genuine creativity with analytics is a very powerful combination. The key is giving creativity enough room and allowing genuinely new things to be tried out. One of the biggest dangers of being too analytics-dependent is taking tiny creative steps and ending up stuck on a creative 'local maximum'. There might be much more exciting mountains in the distance, but no way to reach them unless you're prepared to try something new and unexpected. Given the financial success that Zynga is achieving, I suspect there is little appetite to be very adventurous from their management, and that creates opportunities for adventurers willing to search for more exciting mountains, particularly if/when their mountain starts to sink.

  • + 0 
  • - 0 
  • 0

Creativity and Analytics

posted by Joel Kemp Mar 10, 2011 at 11:12 am
3
Joel Kemp

Analytics won't tell you what creative ideas you should come up with but will be able to tell you which ones are working based upon you key objectives and success criteria, so it's a blend of Art and Science to achieve the best results, one does not successfully exist without another.

Of course if you just capture data but don't analyse and draw business intelligence from that data it would be pretty pointless.

  • + 0 
  • - 0 
  • 0

Leave a Comment