Use of Custom Demo's In Reviews

Discussion in 'Graphics and Semiconductor Industry' started by Dave Baumann, Jun 16, 2003.

  1. Miksu

    Regular

    Joined:
    Mar 9, 2003
    Messages:
    997
    Likes Received:
    10
    Location:
    Finland
    Didn't first notice that those Nascar4-scores were a bit of strange too. In the older test Radeon's were leading the bag in most of the tests, now they're behind with like 20fps all the time. So we go from this http://firingsquad.gamers.com/hardware/msi_geforce_fx5900-td128_review/page6.asp to this http://firingsquad.gamers.com/hardware/evga_e-geforce_fx_5900_ultra_review/page6.asp

    Yep, if I read this correctly: "Like the Serious Sam demo we made, this new demo is less stressful than the demo we used earlier, as Q3DM7 is a much larger map than Q3DM1, hence the higher frame rates."

    It's somewhat odd that when creating new timedemoes, they're choosing less stressful demoes to some games and more stressful to others. Then in UT2k3 they're using the original demoes.

    edit: It seems that eVGA's board is giving many problems to users: http://evga.com/community/messagebo...ra+issues&Forum_Title=GeForce+FX+Family+Forum
     
  2. Sharkfood

    Regular

    Joined:
    Feb 7, 2002
    Messages:
    702
    Likes Received:
    11
    Location:
    Bay Area, California
    I don't see how it's odd at all. Like I mentioned earlier, a benchmark reviewer can basically make any statement of performance they wish- just by using selective benchmarks, resolutions, settings and feature sets.

    It's old hat and has been used for a long, long time. Once you have identified a particular strength or weakness to a few platforms, you just have to work these in.

    The tough part is trying to quantify how much a particular condition may actually occur during your average game. This is what draws the line- if benchmarks are focused 100% on a particular performance element that only is encountered in like 5% of your average playing encounter.
     
  3. chavvdarrr

    Veteran

    Joined:
    Feb 25, 2003
    Messages:
    1,165
    Likes Received:
    34
    Location:
    Sofia, BG
    On the topic - guys from ixbt.com/digit-life decided to change used programs/demos for benchmarking... They'll use (excerpt from http://forum.ixbt.com/0010/044212-44.html)
     
  4. kihon

    Newcomer

    Joined:
    Dec 4, 2002
    Messages:
    53
    Likes Received:
    0
    Has anyone actually tried comparing standard time demos and custom ones while running the antidetector scripts? Im curious to see if the standard timedemos are affected more by the scripts than custom ones.
     
  5. deviantchild

    Regular

    Joined:
    Feb 8, 2002
    Messages:
    370
    Likes Received:
    5
    Location:
    ST 65527 76257
    i have experienced this with Kyro but not with GLQuake,
    i think i only experienced it with "GLQuake Update" and possibly also the engine that Nehahra used too
    iirc it seemed that the smoke trails from rockets and the grenade launcher used a different method than that in GLQuake [don't ask me, i'm not up on this stuff like most of you] and this killed Kyro framerates
    i don't know what it's called but i think they were using what looked like crosshatched textures (alternating colour and transparent pixels) to simulate alpha for these effects
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...