Back in the day of 3dMark2001, I was one of those people who'd snear at 3dMark. To be more accurate, I sneared at those who made a game out of getting as high score as they possibly could. I followed the overly simple logic that "I don't play 3dmark" therefore the scores didn't mean anything. I use it to see if anything funky was going on with my system-- but not to measure performance.
Then I ran across a link to the top 10 cards by average score. I noticed 3dmark ranked them exactly how I'd rank them based on in game performance. That's when I first started to think that maybe the score tells something after all.
Fast forward to 3dMark03... the perfect benchmark at the perfect time. The fx was fatally flawed wrt pixel shading but no game available at the time could reveal just how deep the flaws ran.
I still remember the thread where someone noted that the sky's brightness was off in Nature test. It was eventually pinned down to drivers lowering precision to fp16. I think everyone on these boards should know the story well enough from that point on... just one hack or shader replacement after another. And it was easy to surmise (well, it was easy for some of us
) that nVidia would need to use similar techniques to get good performance out of heavily shaded games.
Now, with 05, it's still too soon to judge it's value. I don't think it's as critical now as 03, because it seems neither 6800 nor x800 have any fx-scale fatal flaws to uncover. I'm also leery about issues such as DST and other concerns that have been raised.
I'm not sure how to vote: I'm still in wait and see mode concerning the usefulness of 3dmark05, but 03 was awesomely good.
woah, this was a post of nearly WaltC proportions
But at least it's on topic and I'm not bickering with anyone.