Furthermore, I think the whole idea of coming to some sort of objective rating of a games' technology is equally suspect. How does level size trade off against lighting detail or animation?
Okay, I wasn't using the term 'technological' to mean a proper technological evaluation. The 'technological' ratings, partinioning a game into scores for different aspects, are covered by viceral experience, just like entertainment value. A game shouldn't be scored highly because it uses x,y,z technical features well, but because the technical competancy of the graphics add to the game's appeal. I was never arguing for a review system based on scientific performance metrics, and indeed no-one was. The complaint is a score that's solely 'how much I enjoyed the game' that doesn't consider the other aspects of quality. Taking this game as an example...
...graphics do contribute to a game's entertainment value, acting as a method of drawing the player into a game...
Rating graphics according to this metric helps developers make better games, rather than better tech demos, it helps them realise the role graphics play in rewarding the player - it makes them realise the importance of good art, of effective visual communication. Finally, it stops them from falling back entirely on graphics and ignoring the core of the experience - the gameplay. That can only be a good thing.
...Eurogamer have given it a high score regardless of the fact it's graphics aren't good. They haven't weighted in the way the graphics do or don't draw the player into the game. They haven't weighted in the audio, or the animation. It's
just a gameplay score. That's different from a game score, which considers all the contributing factors and produces an 'I liked this game' response. It's just a 'I don't care what this game looks like, or what it sounds look, or how silly the animations are, I enjoyed it and so give it a 9/10.' If that reviewing method were the norm, where's the incentive for developers to push the graphics and audio to produce more immersive, involving experiences? All aspects have to be considered some way or other.
And you could equally argue, why have reviews to rate the technical aspects of a game when you can simply play the demo? The point however is that demos still don't allow you to experience the whole game, and not every game will be released in demo form
That's becoming very true these days. I think however reviews will stay with us for lots of reason, not least because you can't test every single game! And they are entertaining to read.
I can agree with using reviews to rate individual elements of a game like sound or technology, but at the end of the day the only way of combining those elements into a rating that makes sense is to ask 'how entertaining does this make the game'.
Absolutely. Which is what I was arguing, and TheChefO was arguing, and which the Eurogamer score isn't. We're talking about an entertaining score that doesn't comine the elements, and only says 'I thought it was fun'. It makes the game impossible to place into context. ie. If EDF3 score 9/10, what if there's another game that comes out that is just as much fun to play, yet looks better, sounds better, and is in fact in every way better. That can score a 10/10, yet only appear marginally better, and also it'll have a 10/10 score which suggests perfection, which shouldn't happen except in very, very rare circumstances (unless devs suddenly become very different to what they are now!). Eurogamer's score says the game was entertaining, but doesn't present a value that can be used comparatively, which is perhaps the main point to review scores. Do you get Game A or Game B? If they're both fun, what other distinguishing factors are there? Shouldn't those distinguishing factors be reflected in any single-unit scoring system? EDF3 is great fun, looks poor, sounds poor, and looks a bit ridiculous. Alien Invasion Repulsion is great fun in the same kind, looks incredible, sounds fantastic, and really grabs you. How much higher rated should AIR be than EDF3? Or should it get the same score because the review found it to be just as much fun and doesn't care about the other aspects?