3DMark05 and certain websites

Discussion in 'Graphics and Semiconductor Industry' started by Reverend, Sep 24, 2004.

  1. Reverend

    Banned

    Joined:
    Jan 31, 2002
    Messages:
    3,266
    Likes Received:
    24
    Now that 3DMark05 is almost upon us and with NVIDIA on Futuremark's Beta Development Program, do you think certain websites (almost all of which have no idea what 3DMark05 is about right now, save for Beyond3D, ExtremeTech and CNet) who had "opposed the use of 3DMark03 in hardware reviews" will have a change of heart once they can experience 3DMark05 for themselves?
     
  2. trinibwoy

    trinibwoy Meh
    Legend

    Joined:
    Mar 17, 2004
    Messages:
    10,426
    Likes Received:
    423
    Location:
    New York
    How can we comment on this if we aren't part of the elite Beyond3D, ExtremeTech and CNET crowd? We are all as ignorant as those 'other sites' aren't we?
     
  3. karlotta

    karlotta pifft
    Veteran

    Joined:
    Jun 7, 2003
    Messages:
    1,292
    Likes Received:
    10
    Location:
    oregon
    Some will say this is a good measure of a cards ability. But i think one site will stick to the Only games mantra.
     
  4. AzBat

    AzBat Agent of the Bat
    Legend Veteran

    Joined:
    Apr 1, 2002
    Messages:
    5,934
    Likes Received:
    1,734
    Location:
    Alma, AR
    Rev,

    IMHO I doubt many of the anti-3DMark sites will change their mind. The point is 3DMark is still a benchmark that doesn't represent game usage since it's solely a synthetic benchmark. The only possible way for some of those sites to change their mind is if 3DMark05 uses an actual game engine that is also used by a game.

    Other factors will probably also affect their decision like the requirement to only use certified drivers when doing testing. If it happens again that NVIDIA's driver continually fails to be certified then there's no real incentive for them to use the test. If they removed the certified driver requirement, then a few of them may be more apt to support it. But only if they don't have to worry about cheating or optizimations nullifying the results.

    Tommy McClain
     
  5. digitalwanderer

    digitalwanderer Dangerously Mirthful
    Legend

    Joined:
    Feb 19, 2002
    Messages:
    17,215
    Likes Received:
    1,736
    Location:
    Winfield, IN USA
    Ahem!

    I believe you missed Elite Bastards in your list there Rev, check the credits. ;)
     
  6. Richard

    Richard Mord's imaginary friend
    Veteran

    Joined:
    Jan 22, 2004
    Messages:
    3,508
    Likes Received:
    40
    Location:
    PT, EU
    Well, considering [H]'s recent mini-editorial about this, I'd say some sites will continue to ignore it. But I hope they'll at least use some tests because, recalled patches aside, there's no SM 2.x/3.0 games atm AFAIK.
     
  7. Bouncing Zabaglione Bros.

    Legend

    Joined:
    Jun 24, 2003
    Messages:
    6,363
    Likes Received:
    82
    They will if Nvidia tell them to. Seriously, with the first big benchmarking tool for SM3.0 that Nvidia can use in their marketing, Nvidia will back 3DMark05 and tell everyone to use it. Nvidia will produce a white paper claiming that this version is more fair than the last version, and spoon-feed it to websites who will parrot it back to us as they explain why they are now prepared to back 3DMark05.
     
  8. Scali

    Regular

    Joined:
    Nov 19, 2003
    Messages:
    2,127
    Likes Received:
    0
    I think 3DMark03 was just a case of the messenger getting shot.
    A lot of people saw GeForce as the symbol of 3d acceleration, and some weird benchmark that suddenly claimed this weird Radeon stuff was lots faster, well... those weren't just lies, that was pure blasphemy!

    I think it's the same with Doom3. Pretty much all reviews I've read, are very positive about the game. But if you look at some of the reactions from actual gamers (even on this forum, for example), not everyone is impressed. For example, people think the gameplay is far too repetitive and predictable. Again, this is pure blasphemy ofcourse.

    I suppose a lot of people are just afraid to have an opinion that deviates from the average, including a lot of websites, which should have journalists who try to remain objective, but apparently don't.

    Question is: what is the status of the GeForce today? Did 3DMark and other games succeed in convincing people that Radeons are just as good? Did it make people swing around, and is the Radeon now the symbol of 3d acceleration?
    I think, or hope at least, that now the general consensus is that Radeons and GeForces are both equally good cards, with their unique strong and weak points. In which case, if 3DMark05 stumbles upon any strong or weak points, there won't be a big deal made out of it.
     
  9. CMAN

    Regular

    Joined:
    Mar 23, 2004
    Messages:
    620
    Likes Received:
    15
    Location:
    St Louey
    If 05 shows the 6800 series above the XX00 series will some sites stop using it? Will it have the same effect as 03 had? I think those are the questions that need to be asked. Having someone go into the fold for reasons other than yours may not necessarily be a bad thing (such as a rich person giving a lot of money to a worthy charity not because the charity is worthy, but because it makes that rich person feel good).
     
  10. tEd

    tEd Casual Member
    Veteran

    Joined:
    Feb 6, 2002
    Messages:
    2,094
    Likes Received:
    58
    Location:
    switzerland
    I don't think there will be a change in policy. Those who used it are going on to do so and the others won't

    I usually ingnore the plain 3dmarks tests in reviews anyway as they don't tell me anything useful.
     
  11. g__day

    Regular

    Joined:
    Jun 22, 2002
    Messages:
    580
    Likes Received:
    1
    Location:
    Sydney Australia
    I think if you wait 1-2 months the answer will become painfully obivous - so why bother spectulating about something so close and possibly random?
     
  12. ChrisRay

    ChrisRay <span style="color: rgb(124, 197, 0)">R.I.P. 1983-
    Veteran

    Joined:
    Nov 25, 2002
    Messages:
    2,234
    Likes Received:
    26
    Hopefully not, I have been pretty satisfied with the exclusion of synthetic benchmarks such as Aquamark, 3dmark03 and Codecreatures. Unfortunately I am guessing you're right that it will be used, Taking into the account its the newest thing will also serve to promote it more unfortunately.

    With the exception of Hardocp, I find it hard to believe they would use any 3dmark product or synthetic benchmark in there test suites.
     
  13. Randell

    Randell Senior Daddy
    Veteran

    Joined:
    Feb 14, 2002
    Messages:
    1,869
    Likes Received:
    3
    Location:
    London
    I think thats very short sighted iro 3dmark03 at least. Without 3dmark03 we would never have known so early have much better the R3xx was at DX9 over the FX. The score isn't it's true worth, the individual tests for what they do are ie. the PS tests and teh individual games tell you a lot. GT2 showed for well over a year that the R3xx's would struggle big rtme with AA on Doom3 for example.

    It's not the tool it's how you use it. (fnarr fnarr..)
     
  14. Ichneumon

    Regular

    Joined:
    Feb 3, 2002
    Messages:
    414
    Likes Received:
    1
    What blows my mind about all those folks who slammed 3DMark03 based on Nvidia prompting.... is that 3DMark03 was proven to be an *EXCELLENT* predictor of the cards actual performance prior to Nvidia fsking with their drivers. And each patch proved that accuracy time after time.

    I still can't believe the attitudes some folks have to 3dm03 when the benchmark has been proven right all along. Talk about truly allowing themselves to get blinded by marketing. Pretty sad actually. I still don't really understand how Nvidia has been given such a pass on that whole sack of crap.
     
  15. ChrisRay

    ChrisRay <span style="color: rgb(124, 197, 0)">R.I.P. 1983-
    Veteran

    Joined:
    Nov 25, 2002
    Messages:
    2,234
    Likes Received:
    26

    I would still rather tests such shadermark be used to test performance, The FX wasnt slow in Every DirectX 9.0 game either, I'm not really interested in getting in an argument about 3dmark, But I will promptly ignore any scores, In future products with tests like Aquamark and 3dmark03/05, There are other good utilities for testing performance of such titles, The only real benefit I could see to using such tools is to get more content into a review quick because they are relatively simple programs to use.

    HL2, EQ2, Doom 3, and practically any game performance will be quite a bit more useful, As are multi API targets.
     
  16. Randell

    Randell Senior Daddy
    Veteran

    Joined:
    Feb 14, 2002
    Messages:
    1,869
    Likes Received:
    3
    Location:
    London
    Again why is shadermark more credible than 3dmark? 3dmark03 gave us a range of tests that at the time no other game or synthetic gave us.

    Give me an FX result from a pure DX9 game with no pp hints and no shader replacement then.
     
  17. Hanners

    Regular

    Joined:
    Jul 12, 2002
    Messages:
    816
    Likes Received:
    57
    Location:
    England
    In a word, no. We've already seen [H] gearing up to strike it down in the past few days, for example.

    Which is a shame, because there's a fantastic collection of tools in there.
     
  18. IgnorancePersonified

    Regular

    Joined:
    Apr 12, 2004
    Messages:
    778
    Likes Received:
    18
    Location:
    Sunny Canberra
    I'll go with that - if not a whitepaper then something similar in the press kits.

    Could be a gradual reverse - "In testing the nv-blah blah we had to resort to 3dmark05 since the gf-blah is so advanced no games currently use the future proof feature set....". A few disclaimers which will gradually disappear as the collective acceptance takes place. Saying that I think some sites will stick to their guns.

    That is of course if the sm3 tests shine for nv?

    Bit of a load blowing thread though :p
     
  19. Reverend

    Banned

    Joined:
    Jan 31, 2002
    Messages:
    3,266
    Likes Received:
    24
    Why do you think that is?
     
  20. Bjorn

    Veteran

    Joined:
    Feb 6, 2002
    Messages:
    1,775
    Likes Received:
    1
    Location:
    Luleå, Sweden
    I agree. I don't get this constant complaining about 3D Mark. It's of course always a question on how much you should focus on a single benchmark but that's always the case.

    Doesn't mean that i believe that 3D Mark 05 will the absolute answer to how the cards will perform in f.e UE3 engine based games but it'll at least be something.
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...