Motherboards.org uses 53.03 benching 3dm2k3?!?

Discussion in 'Graphics and Semiconductor Industry' started by digitalwanderer, Jan 18, 2004.

  1. Crash_7

    Newcomer

    Joined:
    Mar 16, 2002
    Messages:
    2
    Likes Received:
    0
    (long time lurker, first time poster)

    Probably a stupid question, but wouldn't it be possible for Futuremark to set up 3dmark2003 so that it simply wouldn't run with unapproved drivers? You know, have it call home to Futuremark and check the drivers on the system running the benchmark against a database of currently approved drivers. It might be a bit inconvenient for review sites, but it's a lot better than FM having to chase down every bogus benchmark in every review.
     
  2. Tim Murray

    Tim Murray the Windom Earle of mobile SOCs
    Veteran

    Joined:
    May 25, 2003
    Messages:
    3,278
    Likes Received:
    66
    Location:
    Mountain View, CA
    Of course it's possible, but that seems a little draconian. One of the things about review machines is that they often don't have active Internet connections.
     
  3. Quitch

    Veteran

    Joined:
    Jun 11, 2003
    Messages:
    1,521
    Likes Received:
    4
    Location:
    UK
    What kind of excuse is that? We live in an age of USB Pens, CD Burners, Ethernet connections. They manage to shift the latest driver onto the review machine, but the latest version of the software they're using to test is too much trouble? Don't make me laugh.
     
  4. Tim Murray

    Tim Murray the Windom Earle of mobile SOCs
    Veteran

    Joined:
    May 25, 2003
    Messages:
    3,278
    Likes Received:
    66
    Location:
    Mountain View, CA
    And the original poster's idea relies upon 3DMark phoning home every time it's run, not simply patches.
     
  5. digitalwanderer

    digitalwanderer Dangerously Mirthful
    Legend

    Joined:
    Feb 19, 2002
    Messages:
    17,276
    Likes Received:
    1,788
    Location:
    Winfield, IN USA
    Or you could just have it say "UNOFFICIAL" in big red flashing letters on the results screen until such a time as it was posted to the ORB, and when it's posted to the ORB it'll become official and the "UNOFFICIAL" in big red flashing letters won't show up anymore.

    Simple & effective. :)
     
  6. Tim Murray

    Tim Murray the Windom Earle of mobile SOCs
    Veteran

    Joined:
    May 25, 2003
    Messages:
    3,278
    Likes Received:
    66
    Location:
    Mountain View, CA
    That's the obvious thing to do, but reviewers do not always rely upon the ORB.
     
  7. micb

    Newcomer

    Joined:
    Sep 14, 2003
    Messages:
    64
    Likes Received:
    0
    Location:
    Bedfordshire, UK
    Hello worm,

    Here is another site benching with the 53.03.


    http://www.rojakpot.com/showarticle.aspx?artno=74&pgno=0


    It is on the page, 3 - Test setup & Benchmark settings page.

     
  8. ByteMe

    Banned

    Joined:
    May 27, 2003
    Messages:
    136
    Likes Received:
    7

    Why bother? That is like trying to patch a hole in a damn with your thumb. Why not fix the problem instead of the result?
     
  9. Quitch

    Veteran

    Joined:
    Jun 11, 2003
    Messages:
    1,521
    Likes Received:
    4
    Location:
    UK
    Well, no, it would only need to update its "approved" driver file, and if your driver wasn't approved you could download the latest file to see if it was now. It would hardly take an age, could be put on the CD with the driver, and at worst would produce a warning box which I'm sure there could be an option to disable.

    But at least then people have to go out of their way to ignore it, not out of their way to find it.
     
  10. Joe DeFuria

    Legend

    Joined:
    Feb 6, 2002
    Messages:
    5,994
    Likes Received:
    70

    Because the problem is nVidia. And FM doesn't control them.
     
  11. Nick[FM]

    Regular

    Joined:
    Feb 8, 2002
    Messages:
    527
    Likes Received:
    7
    Location:
    Helsinki
    We are updating the ORB (and all official lists) at the moment to point out which results are got with approved drivers, and which aren't. It is indeed sad that so few reviewers submit the 3DMark03 results to the ORB, and provide compare URL's in their reviews. If they would do that, it would be much easier for everyone to see all numbers, and if the result is valid or not.
     
  12. dan2097

    Regular

    Joined:
    May 23, 2003
    Messages:
    323
    Likes Received:
    0
    Cant you just sue Nvidia for loss of business or something?, thats getting to the root of the problem.
     
  13. MuFu

    MuFu Chief Spastic Baboon
    Veteran

    Joined:
    Jun 12, 2002
    Messages:
    2,258
    Likes Received:
    51
    Location:
    Location, Location with Kirstie Allsopp
    Are you playing with yourself?

    MuFu.
     
  14. digitalwanderer

    digitalwanderer Dangerously Mirthful
    Legend

    Joined:
    Feb 19, 2002
    Messages:
    17,276
    Likes Received:
    1,788
    Location:
    Winfield, IN USA
    True, they usually just grab screenshots of their final scores anymore to "prove" it's official...thus the "UNOFFICIAL" watermark on the final score tally screen until it's posted to the ORB. ;)

    I know it ain't perfect, but it would help at least remind reviewers...they'd KNOW they're doing an endrun around FM by just charting the results at least.

    I still think you'd be better of just not accepting any un-approved drivers scores to the ORB, that would pressure nVidia in a big way by having all the fanboys cry about not being able to post their "big" scores with their nV hardware. When they backlash against FM over not being able to point 'em at the real problem and explain to them to complain to nVidia. ;)
     
  15. cthellis42

    cthellis42 Hoopy Frood
    Legend

    Joined:
    Jun 15, 2003
    Messages:
    5,890
    Likes Received:
    33
    Location:
    Out of my gourd
    Um... Ew? :shock:
     
  16. Crash_7

    Newcomer

    Joined:
    Mar 16, 2002
    Messages:
    2
    Likes Received:
    0
    That's what I meant about it being inconvenient for review sites. But it just seems to me Futuremark needs to do something about this if they want to remain a viable benchmark. It's obvious from the number of reviews that have been pointed out using unapproved drivers with 3dmark2003 that the concept of having an approved driver list simply isn't working. Futuremark can go scurrying all over the web trying to correct bogus benchmark results, but once they've been posted in a review, the damage has already been done even if it is corrected later.
     
  17. ByteMe

    Banned

    Joined:
    May 27, 2003
    Messages:
    136
    Likes Received:
    7
    The next time I get sick I must remember to kick the dog.
     
  18. Tim Murray

    Tim Murray the Windom Earle of mobile SOCs
    Veteran

    Joined:
    May 25, 2003
    Messages:
    3,278
    Likes Received:
    66
    Location:
    Mountain View, CA
    How about this--no results are displayed immediately. They are either uploaded to the ORB and verified or they are saved to an encrypted file on the drive, which can then be taken to a computer with an Internet connection, uploaded, and verified? Sure, it'd be cracked eventually, but I don't think you're going to get De3DMark from your favorite Belgian teenager anytime soon.

    But anyway, with that solution, the only way you can see results is with Futuremark's seal of approval.
     
  19. Althornin

    Althornin Senior Lurker
    Veteran

    Joined:
    Feb 6, 2002
    Messages:
    1,326
    Likes Received:
    5
    ARG!
    [H] misses the point, again!
    Too bad your content ignores the future performance of said reviewed products. Synthetic benchmarks ahve proven thier worth again and again, and i hold [H] responsible for the huge amount of nonsense floating around about them. A valid predictive tool is being thrown away for NO FREAKING REASON.



    OverClocker Cafe's editorial:
    http://www.overclockercafe.com/Futuremark.htm
     
  20. kyleb

    Veteran

    Joined:
    Nov 21, 2002
    Messages:
    4,165
    Likes Received:
    52
    from overclockerscafe:

    the moron thinks it looks like futuremark is standing up against nvidia's "optimizations" because they don't want ati winning the benchmarks? how can he even think that makes sense?!?
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...