Pre-Alpha Feedback

backlog

In the past 2 weeks a number of people, mostly friends and colleagues but also some complete strangers, have played the Startup Freak pre-alpha and have given me feedback. This was great in and of itself, but what has absolutely floored me is the length and detail of the feedback. I have had people write entire documents for me, have lengthy chats, and send me exact screenshots of the issues they are running into.

I’m still waiting for a few more, but so far a couple of themes have emerged which have really given me direction. Here they are:

The Positives

Before I jump into the problems, it’s worthwhile looking at what people liked about the game. I am taking these with a grain of salt, as it’s always hard to judge whether something was really fun or the player just liked the idea of it…

  • General concept: people seem to generally like the concept of the game and some of the unique elements of it.
  • Marketing: There are a few mechanical problems with how marketing activities work (more on that later) but overall I have had positive feedback. I think people like trying to figure out what marketing activity gets them the best results.
  • Product Building: Again this one is a mixed bag but overall people have liked the concept of feature building and trying to optimize design/tech features. Again, more on this later.
  •  Investment mini-game: I got some positive feedback on this one, though yet again it has execution issues. I’ll definitely keep it around.

Tutorials, Tutorials, Tutorials

Issue:

This is the single biggest feedback that I got: it’s not clear what the player is supposed to do. This is specifically an issue in the backlog area.

backlog-feedback

Detailed feedback from one of the play-testers.

Not a single one of the players knew that they can/should be building features for the first few sprints. The tasks themselves are also obscure and just too overwhelming initially. The problem also extended to other areas like the funding mini-game, the spending screens, and employee management. I knew going in that my tutorials are lacking and essentially placeholders, but I didn’t really anticipate the extent of the problem. It’s clear to me that the text-based tutorials simply won’t be enough.

Solutions:

I will need to overhaul the tutorials. Some things to do here:

  • Introduce UI elements gradually. For example initially don’t show any tasks but 1 or 2. Or hide the funding game entirely until the first time the user needs to get cash.
  • Use visual walk-throughs. For example walk the player through building their very first feature using a combination of text and highlighting where they need to click. This won’t be an easy feat I admit.
  • Use more visual cues generally to bring the player’s attention to the right things. Use progress bars instead of numbers for example, or highlight buttons.
  • Try to simplify UI where possible, such as the feature design UI.

I’m kind of leaving this ’till later on. I want to minimize waste on tutorials as I’m still tweaking the game-play.

 

Skewed Challenge

Again I knew going into the pre-alpha that the game doesn’t really scale after a certain point. What I actually found surprising is how far people played the game (much further than I ever pushed the game…which tells you why testing your own software has diminishing returns). As it turns out, the player’s experience goes something like this:

  • I get started…things are confusing
  • It’s difficult to stay afloat, mostly because I’m not sure what I should be doing
  • At some point I build enough features and market enough to become cash-flow positive
  • All challenge completely disappears as I exponentially grow my user base.

I actually had a friend cause an overflow in the cash offered by an investor.

Solutions

Competition: I thought about adding the concept of competition. What would be cool is, when visitors come to your site, they also visit other competitors’ sites based on their marketing spending. A portion of them will then trial one or more products. From those trials some will then choose one of the competing products. What this means is that you are not just trying to spend more money on marketing and product building, but you are trying to keep up with and/or beat what your competitors are doing. This should create an interesting challenge through to the late game.

I actually did a bunch of the stat work behind this. But then it dawned on me: building AI, and more specifically good AI, is going to be a massive task. It would just grow the scope of this game way too much. As much as I think it would be great for a game like this, it would simply put the game in the unachievable basket :/

Re-scale Marketing: An obvious change is the marketing activities. Currently each activity has a fixed conversation rate which scales linearly. In reality there would to diminishing returns on spending. So I’ll be looking to implement “S” curves for the activities, and so you’ll need to try and find a sweet spot for each activity:

marketing-curves

Reputation(?): This is an idea I’m still toying with. It has the potential to make the game more obscure but it could also be a good way to create a challenge in the late game. Basically there could be a reputation value which, if left alone, would decrease over time. Various activities such as building bigger features, or hitting certain milestones, would increase this reputation which in turn translates to more customers. However events like a security attack would drop its value rapidly.

Yeah, I don’t know…

Events Revisited: Right now I believe the randomly generated events go mostly unnoticed. Hardly anyone in the alpha group even mentioned them. I think it’s partly because they get buried in your emails and you don’t know they are still going on, partly because they don’t last very long (usually 6-8 sprints). I think I need to make them far fewer, but with a lot more impact so that the player really has to react to them. I also need to throw them in the user’s face.

 

Product Building

As I mentioned people generally liked the concept of product building. Some likened it to 4X games. But:

  • It’s too simplistic
  • It isn’t obvious if the shape of the feature matters or not
  • “What the heck are the black squares?”
  • The three metrics: breadth, depth, and cohesion were a bit vague. Even if understood, it almost wasn’t worth trying to optimize them. You eventually get into a positive cash flow and that is it.

I’m definitely taking this one on board. This is THE feature in the game (no pun intended). It’s unique and I want to really flesh it out.

Solutions

  • There will be a new security feature type. Security features protect their surrounding features. Any unprotected feature components are vulnerable to security attacks. This replaces the current level-based security.
  • There will be a new performance  feature type. Performance features speed up their surrounding features (in one direction). Their effect can stack. Performance of the product will have some sort of contribution to things like sign ups and churn.
  • There will be the concept of “most requested features”. As you do market research and your visibility increases, you’ll see outlines of features that users want. They may be really large to build so they would take a long time, but building them will give you some form of bonus.
  • I will be removing the black squares.
  • I’ll be removing the cohesion metric. It’s interesting but it’s not something that players can meaningfully affect. What remains is depth and breadth, i.e. building lots of little features or building a few large features. I think that’s an interesting choice and I’ll keep it for now. I’ll need to make it very clear how each choice is affecting the game.

backlog

What’s Next

There are many many other pieces of feedback which I’ll be looking into (e.g. employee UI and interactions). I have a lot of work to do, but I also want to keep the scope reasonable. The next goal will be to incorporate as much of the feedback as I can, do another quick alpha, and then decide whether or not I can justify spending the money on art. Here we go!

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s