Reverend said:
Who's a web-reviewer? Someone that works for a website. Who's not a web-reviewer? Someone that doesn't work for a website. While being in such a fortuitous position a web-reviewer has two options when it comes to his "work" - (A) provide benchmarks and IQ studies (something Tom, Dick and Harry can do, and apparently is being done by almost all websites) or (B) go the extra mile by being more adventurous and innovative and hence, hopefully, provide the extra info lacking in (A). Both (A) and (B) are important and useful. My view however is that when you are in such a "privileged" position (someone with a website and getting numerous "free" hardware), option (B) should, ethically, have a higher priority. As usual, there is never enough time. That's what follow-up articles are for and are what I regard as more important than the original review.
When you are a good web-reviewer, you are trusted. When you are trusted, people will look at you as someone with an authoritative voice. There is nothing wrong, nor egoistic, with viewing yourself as someone with authority - as long as you never forget that what you have to say means two things : (a) the consumers will or will not spend their money on the hardware you're reviewing; and (b) the vendor will or will not make extra money based on what you have to say about their hardware.
At most times, it is simply a matter of using better choices of words - it is more politically correct to say "It would appear that X looks better than Y" when what you really want to say is "X definitely looks better than Y!"
I, for one, would like to be in a position where I can say the latter without having to defend myself (against fanboys or not!).
First of all, Rev, I think the term "f-a-n-b-o-y(z)" needs to be removed from any intelligent vernacular. It has no meaning. Rather, it's merely a dodge that someone might use to deflect the focus of an argument he cannot, at least at the moment, answer. It's not a legitimate term, in other words, and nobody who is a bonafide "web reviewer" should be using it in a review--it degrades and erodes the assumed authority of those who wield it as a shield. And rarely does it actually cloak the ones who use the term, which is all the more reason it should never be a word used in a review, IMO. Also, never apologize for what you write (unless you make a mistake, of course), but always be able to explain and justify it.
In short, as a reviewer you may say, "X definitely looks better than Y," or "X looks a lot better than Y, I think" all you like. You are the reviewer--this is what people both expect and want you to do. People understand that the reviewer's review is his *opinion* and not necessarily Gospel truth. And they read you to get that opinion. The worst reviews possible are reviews in which no opinions are actually rendered, but rather the reviewer engages in a lot of equivocating, instead. It often becomes obvious in such a review that the reviewer does have a favorite, does have a preference, but is *afraid to say so.* This always diminishes the power and force of the review and in short simply makes it much less than it could be, and can often actually pervert what it was the reviewer was actually trying to get across. It's not a reviewer's job to be "politically correct"--it's a reviewer's job to
review. That's why I read them and what I look for. I think trying to be diplomatic because of concern that some might not think you diplomatic is a waste of time because no matter what you say some will think that anyway.
...Will not work well because many people have different "thresholds" for what is termed "acceptable" or "desirable" performance. And then the priorities may change from one game to another (AA/low-rez for this game, NoAA/high-rez for another, etc).
I still believe that when it comes to comparing video cards, as long as screenshots are provided, "equalizing" IQ and then benchmarking is the better way to go. A reviewer can rarely go wrong by much when "equalizing" IQ, nor can he afford to go wrong by much (his credibility and that of his site's is on the line).
Provided such "equalization" is possible. Sometimes it is, sometimes it isn't. When one product has obviously better image quality than another, to glaze over that observation in the interests of "equality" is to actually provide a review picture which the reviewer himself thinks is dishonest, and to shortchange both the review and the reviewer.
If you mean "equalize" in terms of resolution, FSAA, AF, etc. ad infinitum--I absolutely agree with you. If this stops you from commenting on which product you think is better in terms of IQ, once those conditions have been achieved, then I have to completely disagree. Again, the reader is not interested in a diplomatic display--he's reading your review because he wants to know what you *think*--he's not interested in what you think you are "supposed to say," instead.
Of course, in cases where you honestly perceive no difference in IQ, it is eminently acceptable to say so (obviously.)
The only downside to this type of equal IQ review is the fact that different cards have different sweet spots or perf cliffs, so there the review author should step in and mention these.
Nice idea. That, of course, would mean many mini-reviews within the review!
How so? It may broaden the scope a bit, but would not change the review subject. But basically I think this can be avoided by the reviewer simply showing what he thinks are the "sweet spots" for both products compared. If you are doing a comparison, I think a reviewer should always keep in mind that what he's actually doing is reviewing all the products he is comparing--instead of just one of them. Years ago I remember one thing I saw more than one reviewer doing which used to actually make me angry at the time (sort of)--they'd take a card that was the subject of the review, over clock it, and then compare it to a stock-clocked competitor card. Then on the basis of the overclocked FPS scores of the one card contrasted to the non-overclocked scores of the other--they'd proclaim that the overclocked card was indeed the winner of the performance race between the two products compared! I saw this several times between a 3dfx V3 and a TNT2, if I recall correctly. Unbelievable, right? But it definitely happened more than once. So your idea about "equalizing" things in a comparison as much as possible is a good one.
Who is forcing them? And why? How important is it to be "on time" with Anand, HardOCP, Tom et al? To who is it important to be "on time"?
It's not important to be "on time"--such as "first," etc., because no one alive today can tell you who wrote and published the first 9700P review--and nobody cares....
But it is important to be "timely" which is why I can respect your decision not to run your own 9700P review.
If I had a singlemost gripe about reviews it would be that they are too often less than candid. I read reviews because I am sincerely interested in hearing what a reviewer thinks about a product, and I think a good review is also a thorough review (I have no taste for single-pagers.) I want to hear as much negative--if it is there--as I do positive. That doesn't mean I will agree with the reviewer--but I'd still like to hear what he *doesn't like* as much as what he does. Most of the time we get the latter but never the former. With some products this is really justified because some of them are actually very good. But what happens far too often is that reviewers are simply *afraid* to tell us what they don't like--I've not determined whether that stems from a fear of reprisal from the manufacturer, or a fear of rejection by the intended audience. Sugar-coating everything is the safest course, and the one that most reviewers take.
For instance, how often to do we hear:
"Well, I had a few driver problems here and there but nothing that prevented the review from proceeding and I am confident that company Y will fix these bugs in an upcoming driver release. In fact, I just emailed the company about it and have their assurances, so all is just Jim Dandy and Peachy Keen."
What would be nice is if the reviewer would detail what his problems were along with the manufacturer's assurances--and let the readers decide whether these were problems they felt would be taken care of in future driver/firmware updates to the products. In fact, along with any detailed critical analysis of any problems present with the products at the time of review, I think it would be great if reviewers would grant the manufacturers space to answer the criticisms within the body of the review--again letting the reader decide whether the manufacturer's explanation is credible. But I doubt something like this will ever happen, right? *chuckle*
Edits: Typo