What Should be in a Review?

Gamoc says it's all about the game...
Published 09/11/2009 at 11:30 by Gamoc
Related stories (more)
Lunchtime Discussion: Review Scoring [43]
Review: Borderlands [33]

In case you didn’t gather it from the totally genius play on the title, this is a response to nofi’s relatively cynical (relative to, for example, the Teletubbies) What’s In A Review? blog earlier this morning. He basically outlined that the up-to-3 years (didn’t Killzone 2 take 4?) that games spend in development basically comes down to  a load of people sitting at keyboards and summing it up in a public opinion to the tune of around 1200 words. All that work, all the code-configuring, engine-optimising, game-marketing and other-stuff (that shouldn’t be hyphenated, but I had a thing going on) all having less of an effect on how well the game sells than what a load of buggers say about it. At TSA, we are a load of buggers, but nofi may have a point there. Or does he?

No. Sorry nofi, but it doesn’t matter how much work has gone into a game, it should never be scored in relation to that. A review is specifically about the quality of the game and nothing else.

It might seem a little harsh, I suppose. I understand that a lot of work goes into making a game, even the horrors that you wouldn’t play if you were at gunshot probably took more work than I will ever do (I’m a very lazy person), and that is why it shouldn’t be taken into account when reviewing said game. Huge amounts of work go into all games, even the crappy ones, so that evens the playing field between them all – sure, the work that went into, say, Pixeljunk Monsters didn’t last as long as Killzone 2’s 4 years, but that doesn’t devalue either game – they both deserve to be judged fairly.

What I’m trying to say is that it doesn’t matter how hard you work on that single assignment, it’s the end product that matters. If it’s shit, it’s shit, regardless of whether you spent 2 years polishing said shit or whether it’s only just burst forth from your tortured anus after a night of curry and Guinness. I will end this paragraph so you can shake that image from your mind.

The reason for this is that games cost £40-£45 (unless it’s published by bastards), it’s more important than ever that people not buy bad games. Have you ever bought a game for the full price, got it home and thought ‘well, this brings forth a certain terrible image from a paragraph ago back’? People can not really afford to buy games that aren’t good, and that’s why people hold reviews in such high regard. Sure, it’s just an opinion and it might not necessarily be one you will agree with, but game quality is not opinion. Lo-res textures, bad animation, bad dialogue, terrible voice acting, dull cutscenes, awkward controls, unintuitive gameplay; all of this is not opinion, it is simply fact, and can be evidenced by proof.

Where the opinion comes in is the score, and whether or not the good points outweigh the bad points. If a game has awkward animation, and lo-res textures but plays like the second coming of digital Christ, it’s probably going to get a high score regardless. In short, it’s how much the bad points bother the reviewer that makes up the review, not the bad points themselves. The best way to even out the opinion is, of course, Metacritic. The averaging system works rather well in minimising opinion’s affect on the score – I even look at averages myself before I buy a game. Granted, if I still want a game after looking at the score, even if it’s got a low score, I still buy the game, but then again I’m about as responsible with money as Paris Hilton is with video cameras.

Personally, when reviewing a game, I like to have a high opinion of the game until I have reason to think otherwise. I start a game like it’s going to give me money and send me into a tantric orgasm, then every time something annoys me, or something doesn’t quite work, it gets knocked down a peg. LittleBigPlanet lost so little I gave it a 10 in my review (not on TSA), whilst Bladestorm, when I reviewed it for TSA two years ago (How weird is that?), got a 6 because it did a lot of things wrong. How long the game took to make, how much work went into it and how much I like the publisher or developer never affects the score I give a game. I owe it to the readers to be impartial, they’re trusting me.

Comments

Please note that all comments are the opinion of the individual author and not TheSixthAxis.


  1. Are all these articles in prep for you guys scoring MW2 a 7 or something? I mean i cant help but get the feeling that you are covering your backs for the inevitable backlash in the comments to such a low score, heck you guys got slammed for scoring Forza a 10, never mind the FPS supergod!

    Personally i am passing on MW2 and waiting for other games coming next year and enjoying the ones i have at the mo. Please though warn me if the above is true, i will go off and save the universe with Ratchet until the storm passes


    • Of course not, we don’t need to cover our arses.

      I’m skipping MW2 too, as I can’t afford it on top of L4D2, Assassin’s Creed 2, Christmas and New Year.


      • Cool, thats ok then.

        Glad i am not the only one with budget issues! I dread to think what March 2010 is going to be like!


      • I was going to skip MW2 as well, at least temporarily, but if I see it in Sainsbury’s tomorrow for £26, then I won’t be able to resist!! ;)


  2. Good point, Gamoc. ‘Effort’ does not equal ‘quality’.

    But, as Nofi said in his post, ‘quality’ doesn’t necesarily mean the same thing to different people. Sure some things are universal when it comes to judging quality of games – like broken controls are always bad. But how about framerate? Some rate 60 fps above all else, while I’m personally fine with 30 fps as long as it’s steady.

    So, the reviewer has great responsibility. And should at least review a game bye the final code…


    • Well yes, I said it’s all down to how the reviewer views what is there, not what’s actually there, that’s important.

      And yeah, final game code is a given, really.


  3. One interesting bit is that the reviewer profile has a very important role in the whole process. I don’t care for GTA, IMHO it is over-hyped, but all reviews says otherwise. I use to remember the Zzap! (C64 and Amiga) review style, based on a committee. Instead of just a breakdown, different reviewers gave their different takes on the game and it was usual to see disagreeing views, even when the game got a good score.


  4. I value the evidence part of reviews highly. The parts that talk about the frame rate, the controls, the graphics etc sway my opinion considerably becasue these are fact, as Gamoc stated. The rest I take as advice. How valuable that advice is to me depends, like all advice, on how much I trust the person giving it and how similar our general views are in this particular area.


  5. I couldn’t care less for MW2. Didn’t like CoD4, wont like MW2.


  6. good point there.
    say duke nukem forever had come out and was merely mediocre, would it deserve a higher score because of how long it had been worked on?
    no.


  7. Who the hell really cares about a score? A score cannot articulate the drama of COD4 or the childish joys of LBP. I still think the scoring system is flawed and needs to be killed off. Metacritic is an objective take on the subjective. It’s ridiculous and we should want more out of our reviews then some 8, 9, or 10. Why is it that reviews can’t evolve into critics and commentary and become something useful instead of what they are, which is just a way to make us feel good or bad about what we purchased.


    • That’s not what they are at all.