Interesting (3DMark2003) article at Aces Hardware

What´s a "game benchmark"? If you want a game benchmark use real games to measure performance, and leave synthetic applications to do the "lucky guestimates" in relative terms for what the future might hold. Wether it´s accurate or not should be determined if games start to actually use even partially dx9.0 shaders, and that´s still going to take time.

Well I look at 3dmark 2003 as having the same functionality as shadermark. Its designed to test a specific thing. In this case its designed to test overall video card performance. As I've outlined before theres alot of things going on in a game that very likely is not in 3dmark.
So unless you expect the games of the future to be alot like flybys and product demos more than feature actual things to increase gameplay. Like AI, physics, things of that nature. I wouldn't call 3dmark 2003 an indicator of future games.
I realize theres no real directX 9 games out there right now. And there might not be for some time (save for one or 2 water shaders or something) But Dx9 doesn't totally clear the CPU of any responsibilities like 3dmark2003 seems to reflect.
 
I read a statement by FutureMark not too long ago in which the company plainly stated that '03 was more of a vpu benchmark and if you were after a general system bench you should run '01. Can't understand why that should give anyone a problem. It's not difficult to understand.

As for people running older 3D hardware with older 3D software who complain that '03 isn't "indicative" of their performance running older games with no interest in IQ apart from resolution and color depth, heh...if these folks try running new games with AA/AF & shader function requirements on their GF2's they'll see quickly how accurate '03 really is...;)

I encounter this all the time, but can't understand it. People get stuck in a timewarp--timeloop, really--and they'll buy hardware of all descriptions and expect it to be relevant 3-4 years later. Whether it's 3D cards or software, some people have no understanding of the truth that nothing is forever in this business, that things are constantly changing and developing and improving, and the price of progress is technological obsolescence. Just a few months ago I read in some forum some folks railing on about the lack of '486 support and DOS support in newer hardware and software. It was difficult to believe, but some people simply don't understand the principle of progress and technological obsolescence. The market moves on and leaves them behind, fuming...;) People seem to love pounding those square pegs into round holes.
 
WaltC said:
I encounter this all the time, but can't understand it. People get stuck in a timewarp--timeloop, really--and they'll buy hardware of all descriptions and expect it to be relevant 3-4 years later.[...] It was difficult to believe, but some people simply don't understand the principle of progress and technological obsolescence. The market moves on and leaves them behind, fuming...;) People seem to love pounding those square pegs into round holes.
Well if in 3-4 everyone will have a new PC, and that 3DMark03 shows you how your actual PC will act in 3-4 year, why should i use it now?
 
Evildeus said:
Well if in 3-4 everyone will have a new PC, and that 3DMark03 shows you how your actual PC will act in 3-4 year, why should i use it now?


Well, you probably shouldn't.....After all, nVidia says it useless! :rolleyes:
 
how about beyond 3d doin a follow up to this misunderstood issue???

if im not wrong the recent bartons & t'bred athlonXPs are unlocked...

Could someone test a modern CPU ...say XP3000+ ...at say 5x,10x, and 15x multiplier - on a kt4/600 or nf2 - and show that not just 3dMark03, but actual games under VPU stress/limitations (high levels of AA & AF, etc), will show similar performance characteristics (maybe not to the extremes though).

Doing a (scientific style) test as such, you would get rid of all other variables- bus, ram, cache, agp, ide performance etc.. only the speed (multiplier) would be the variable to test against the graphics cards in question... radeon 9600 + 9700 both run at 8x agp, so both would get total system advantages n disadvantages.

How many people these days now run games with AF & AA switched off using modern graphics hardware (ie r3xx, nv3x)??? :rolleyes:

maybe the total 3Dmarks are fictional but the tests are not... :oops:
 
martrox said:
Evildeus said:
Well if in 3-4 everyone will have a new PC, and that 3DMark03 shows you how your actual PC will act in 3-4 year, why should i use it now?


Well, you probably shouldn't.....After all, nVidia says it useless! :rolleyes:
Well perhaps but i'm not future proof, i'm just last gen, so it doesn't concern me ;). But i'm still interested in the answer.

PS: FYI I've tested once (2-3 days after the release) my PC with it something like 1200 pts ;)
 
an opposite stance

Michael used all synthetic benches in his 9800 review.....from his conclusion>

"One thing about this review has been that we did not use real life gaming benchmarks and the reason is simple enough: There are no current games that would stress the feature set and performance of these high-end cards beyond generating absurd frame rates. Therefore, the synthetic benchmarks are sythetic but at the same time more forward looking and reflect the challenges of the next generation of game, without which, there would be no need for any of the new cards anyway.

So, all we need now are the games that take advantage of the new features and performance."

have to say I agree 100%

http://www.lostcircuits.com/video/ati_radeon9800/
 
Neeyik said:
*Sigh* Because it is a benchmark for "gamers" - simple as that. It's not for office workers, it's not for internet connection testing, it's not for Photoshop users. The only people interested in buying and using 3D graphics cards are people who play 3D games, aka "gamers". Perhaps I should have said more about this in the help file but I had obviously made the mistake in granting too many people with enough intelligence to see this for themselves.

LMAO! Nice one. I have not seen such a good post on that. Yes you should remember that people by large are not very bright...
 
Neeyik said:
*Sigh* Because it is a benchmark for "gamers" - simple as that. It's not for office workers, it's not for internet connection testing, it's not for Photoshop users. The only people interested in buying and using 3D graphics cards are people who play 3D games, aka "gamers". Perhaps I should have said more about this in the help file but I had obviously made the mistake in granting too many people with enough intelligence to see this for themselves.

Then why does 3DMark03 have close to NO relevance to current games that gamers are playing RIGHT NOW? 3DMark03 is for anyone with a video card (i.e. everyone), since it measures video card performance, not gaming performance. It might measure future gaming performance, but that has yet to be determined.

Example: http://www.amdmb.com/article-display.php?ArticleID=249&PageID=8

Real world gaming and 3DMark03 scores are very different. Just by looking at 3DMark03 scores one could easily be mislead into believing that the FX5600 is much better in gaming then the TI4800SE.
 
Slides said:
Then why does 3DMark03 have close to NO relevance to current games that gamers are playing RIGHT NOW?

For the last time, BECAUSE IT'S NOT SUPPOSE TO! If you want that, then you should continue to use 3DMark 2001. Futuremark have stated many times that the release of 3DMark03 does not make 3DMark 2001 obsolete. Considering that DX9 type apps are taking forever to come out 3DMark 2001 is a better indicator for today's games and today's gamers. When Doom3 and whatever DX9 class games come out then we can talk about 3DMark03's relevance to games, but they're not here yet.

Tommy McClain
 
Neeyik said:
Perhaps I should have said more about this in the help file but I had obviously made the mistake in granting too many people with enough intelligence to see this for themselves.

A mistake sad to say that is far too easy to make in this world these days... :LOL:
 
AzBat said:
For the last time, BECAUSE IT'S NOT SUPPOSE TO! If you want that, then you should continue to use 3DMark 2001. Futuremark have stated many times that the release of 3DMark03 does not make 3DMark 2001 obsolete. Considering that DX9 type apps are taking forever to come out 3DMark 2001 is a better indicator for today's games and today's gamers. When Doom3 and whatever DX9 class games come out then we can talk about 3DMark03's relevance to games, but they're not here yet.

We have already established that, and the Ace's article proves this further. Yet, FM still advertises 3DMark03 as the gamers benchmark, which could be considered misleading by some. So why are you all getting excited about the Ace's article when it proves something we all know?
 
Well I look at 3dmark 2003 as having the same functionality as shadermark. Its designed to test a specific thing.

Up until there we agree. It's after that that we part mindshare.

If we would have today a game containing dx9 shaders with no software fallback modes to render said effects where compliance isn't met, what would your best guestimate be that it'll turn out? CPU bound or GPU bound?

I wouldn't call 3dmark 2003 an indicator of future games.

I see it as a guestimate. If I'd be hardpressed to make the same guestimate myself, I'd probably result to the same conclusion as 2k3.

Ironically issues get constantly recycled in this thread and Battle of Proxycon has been already mentioned. Let's see it makes extensive use of stencil ops. If you should object that much with 2k3's result in that singled out test, than just use PowerVR's Fablemark demo. If you should then see that accelerator X does rather crappy in either/or, then it's an indication how crappy that accelerator will run games that make extensive use of stencil shadows and unless you turn off stencils in say Doom3, X will suffer from severe performance penalties.

If one knows what conclusions to draw from each individual synthetic test, then it can become a useful tool for pure testing purposes.

I realize that there've been notions in this thread, that FM doesn't make it all as clear to the layman. They do essentially but there's no way you can repeat the same over and over again, besides it's in their best interest to keep users conducting silly score pissing tests, just as much as it's in IHVs interest too after all since they do market extensively advanced featuresets which are hardly of any immediate usability for the gamer.

But Dx9 doesn't totally clear the CPU of any responsibilities like 3dmark2003 seems to reflect.

As I said before: all their applications start out being GPU limited and then become CPU limited. It happens in demanding games too and it most likely won't stop occuring either. The margin might be small but developers like Carmack have that luxury.

Scroll up look again at the GF2U- GF3 paradigm I posted and tell me that things were actually different.

As for people running older 3D hardware with older 3D software who complain that '03 isn't "indicative" of their performance running older games with no interest in IQ apart from resolution and color depth, heh...if these folks try running new games with AA/AF & shader function requirements on their GF2's they'll see quickly how accurate '03 really is...

Agreed on the IQ improving features, yet I disagree on the supposed accuracy of 2k3 in that department.

Shader performance is completely irrelevant there.

That said anyone who buys a recent high end card and runs it in 800*600*16 with no AA/AF deserves to be shot.

By the way it also depends what exactly you mean with a GF2; alas if it isn't a higher end model, even UT2k3/dx7 is a tough cookie for that one.

PS: FYI I've tested once (2-3 days after the release) my PC with it something like 1200 pts.

Ironically I have a dx9.0 compliant accelerator here and I haven't run it yet. I don't even have the application to be honest.

Real world gaming and 3DMark03 scores are very different. Just by looking at 3DMark03 scores one could easily be mislead into believing that the FX5600 is much better in gaming then the TI4800SE.

Fine then why not blame NVIDIA then for releasing a relatively underwhelming mainstream product?

Isn't there a chance that if you contact NV and ask them what the point is in getting a 5600 over a GF4Ti, part of the answer will be dx9 functionalities?

Can I please have an educated answer about my former question concerning the GF2U and GF3 in early 2001?

In contrast would you say the same if the comparison would be between a Radeon8500 and a Radeon9500PRO? (same ballpark: former mid-high end compared to recent mid-end).

The only other thing behind those wild theories concerning FM's benchmarks are IHV specific interests. When it favours IHV A, then it's a perfectly legitimate and accurate application both for said IHV and it's followers, while it's completely irrelevant and not representative for IHV B. Should tables turn down the line it's just the same story in reverse.

In the meantime if you take a CPU bound game like RtCW let's say and run dx8.1 cards against dx9.0 cards in say 1024*768*32, then it shouldn't come at a surprise that both will have pretty close if not identical performance. Pick a higher resolution and add AA/AF and the tables will turn quite a lot.

Needless to say that if one doesn't care about today's high end cards strengths, it's pretty senseless to waste money on an upgrade in the first place.
 
We have already established that, and the Ace's article proves this further.

The comparison methodology and conclusions are flawed. I don't see where Ace's article has established anything.

Aceshardware should stick to CPU reviews, in which they rather specialize in.
 
Slides said:
FM still advertises 3DMark03 as the gamers benchmark, which could be considered misleading by some. So why are you all getting excited about the Ace's article when it proves something we all know?
Who is it misleading? I've yet to receive a single email or read a single forum post from anyone who said anything along the lines of "I've just downloaded 3DMark03. It says it's "The Gamer's Benchmark" but I'm not sure what that really means." Why are you getting oh-so excited about this one bit of nomenclature?

At the risk of repeating myself, the title is a tie-in with the fact that the 3DMark series is the most used benchmark by gamers anywhere. Not just in reviews - website or magazines - but by non-journalists too. You don't get several million entries in the ORB for each 3DMark version by not appealing to gamers. It's just 3 bloody words, for God's sake...
 
Why would I blame anyone for inaccurate 3DMark03 results for current games?

All I'm saying is that 3DMark03 should not be advertised as a gamers benchmark, when it doesn't measure gaming performance on any current games. It's a synthetic video card benchmark, and an excellent one at that.
 
3 bloody words that are false mind you. 3DMark is not measuring gaming performance on any current games.
 
Ailuros said:
We have already established that, and the Ace's article proves this further.

The comparison methodology and conclusions are flawed. I don't see where Ace's article has established anything.

How so? 3DMark03 has little relevance to current games? Do you agree or disagree?
 
This is ridiculous almost to the point of being funny. Gamers' - ie. belonging to a category of people who would declare themselves as gamers. Gamers - those people who play computer games on a regular basis, mostly 3D games at that. Now then, what device is very important in 3D games? That's right, a 3D graphics card!

Hmm, now what to test it with? How do I know if my setup is okay compared to others? What are the real limits of my setup? Is there a program I can use to do this? Is there a program just for this purpose? Is there a program just for 3D games - you know, 3D gamers and whatnot? I don't want to measure things like Internet stuff or Word - I want it to be designed just for us gamers....

:rolleyes:
 
Back
Top