Looking Closer at Your Groups
Your generation is different than your parents’. You don’t have the same tastes, same behaviors, or the same expectations about a lot of things. The same logic applies to the groups that pass through your system. The people who started at the beginning are often different from the ones who started yesterday. If you’re looking at everybody lumped into one pool, you’re going to make mistakes.
Luckily, cohort analysis is a straightforward tool that will help you prevent those mistakes and better serve your players.
Cohort analysis is a fancy way of saying you’re looking at the people who started playing your game or app at different times. Each group is a “cohort” and, well, you’re analyzing them. Happily, this is baked into everything the Katana® Social Analytics Engine does. Whether you are looking at predictive analytics, measuring your social values, or just trying to understand player behavior in a game, cohort analytics are simple and powerful tools.
Group your players by their starting date. Let’s say you launched your game on January 1 and it’s now August. You might think of the players who joined in January as one cohort, and those joining in February as another, etc. Or maybe you slice by quarter or year.
Sometimes you pick cohorts based on your content changes or release schedule, or an event or promotion. For example, maybe you did a major expansion or patch in March. You want to look at the players who joined before that and compare them to the players who joined after.
Here’s an example:
A team of developers and marketers are using Katana to track their new game, Space Paranoids. The developers made a change to the tutorial level on April 15, so the new player experience is very different before and after that date. Using Katana, the team makes a cohort for players joining up to that date, and another for those joining after it. This couldn’t be easier:
With the groups defined, the developers want to see if the cohorts have different rates of completion for the tutorial. The early cohort was completing it 65% of the time, but for everyone joining after April 15, the completion rate was 80%. The fix worked.
At the same time, the marketing team wants to know the financial impact. Katana tells them that the churn rate for the first cohort was 34% and for the second 25%. Meanwhile, the conversion rate jumped from 8% to 12%, and the ARPU from $1.56, to $1.78. Most importantly, the average Social Value® of the players in Cohort A was $1.50, but $3.05 in Cohort B, telling them that there was a great viral ripple effect from the improvement. Management is happy, and the team gets kudos for a better design. Bonuses abound.
These are simple cases that can be completed in 5 minutes. With a little more thinking Katana’s cohort analytics can be applied in even more powerful ways. Take it in conjunction with other forms of segmentation like CRM groups, geographic regions, gender, etc. Now you’re looking at different groups within groups. Add in predictive analytics and suddenly you have the tools to answer nearly any question you could have about your game, your players, and your bottom line.
For more in depth discussion of cohort best practices see our cohort analysis blog post.