The Way its Meant to be Reviewed?

Discussion in 'Beyond3D News' started by Dave Baumann, Dec 8, 2003.

  1. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    You're on a roll for putting things in nutshells tonight! Read the sentence above if you haven't already everyone. This spells it our very clearly as to where I'm coming from.
     
  2. Anonymous

    Veteran

    Joined:
    May 12, 1978
    Messages:
    3,263
    Likes Received:
    0
    Isn't Beyond3D a member of Futuremark's Beta program?

    http://futuremark.com/betaprogram/

    Wouldn't it be fair to say that being a member of the Beta program would give you an unfair bias in writing an article such as this?
     
  3. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    Thanks for mentioning this. I'd like to dig a bit deeper though and ask you to elaborate if any of the confusion, biasedness, etc you alluded to was ever present in one of my reviews in your opinion. Probably best to take it offline via chat or email. Just an open invitation at your convenience. I never want to be viewed as being biased or not trustworthy. So, I welcome any thoughts, concerns, etc you may have about my reviews (or anyone else's at nV News).
     
  4. Dave Baumann

    Dave Baumann Gamerscore Wh...
    Moderator Legend

    Joined:
    Jan 29, 2002
    Messages:
    14,090
    Likes Received:
    694
    Location:
    O Canada!
    For one, the article wasn't about 3DMark per-se, but about the use of synthetic benchmarks in general. However, I'm not sure how our being on the Futuremark Beta program affects developer opinions, which is fundementally what we were seeking in this article.

    We are not trying to justify the use of 3DMark for ourselves, since we've demonstrated that we'll use what we want to use as we see fit, its there to get a bit or clarity to the issue and take a slightly different appraoch in doing it, by asking game developers (the ones that actually do the stuff with this hardware) what a sensible approach would be in their opinion.
     
  5. digitalwanderer

    digitalwanderer Dangerously Mirthful
    Legend

    Joined:
    Feb 19, 2002
    Messages:
    18,992
    Likes Received:
    3,532
    Location:
    Winfield, IN USA
    I'm starting to feel like you two are avoiding answering this one for a reason....Volt didn't hit a nerve, did he? 8)
     
  6. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    Huh...how 'bout dem apples? ;)

    Why is B3D "just" a "BETA Member Level" and not an "Active" or "Strategic" status? I see that these are the perks of BETA status:

    • Access to specification documents, alphas, betas and release candidate code drops of benchmarks
    • Email based communication and briefing
    • Troubleshooting for drivers and new technology
    • 10% discount for Professional versions of Futuremark benchmarks, if bundled
    • Free site license to pro versions
    • Benchmark version featuring Member company logos for promotion purposes
     
  7. Anonymous

    Veteran

    Joined:
    May 12, 1978
    Messages:
    3,263
    Likes Received:
    0
    I guess my response is "How can it NOT affect an article authored by B3D"? You are part of a Beta program that helps further the development of a synthetic benchmark. Now you are writing articles that attempt to legitimize an industry you are helping develop.

    Isn't that the case?
     
  8. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    Ease up on the innuendo Digi...I know that's tough for you though. ;) Nah, no nerve tingling here. I simply don't answer questions that I have no answer to. I defered it to MikeC already so you can wait for him to respond or ask him directly. :p
     
  9. Dave Baumann

    Dave Baumann Gamerscore Wh...
    Moderator Legend

    Joined:
    Jan 29, 2002
    Messages:
    14,090
    Likes Received:
    694
    Location:
    O Canada!
    Because we don't pay. We were asked to join by Futuremark themselves, along with only two other publications - we are provifing feeback and input to them that is probably a little different (and more focused on the end user needs in some cases) then the feeback they get from IHV's.
     
  10. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    True enough Dave and worth reiterating. I kind of drove this thread down the "yip yip yip about 3DMark03 for the millionth time" which I didn't really mean to do...was just using it as an example since it's the most widely recognized.

    It does remain an interesting question and one I'd like to get a more direct answer from you on.
     
  11. Anonymous

    Veteran

    Joined:
    May 12, 1978
    Messages:
    3,263
    Likes Received:
    0
    Providing feedback?

    It looks as though you are providing Editorials on the benefits of synthetic benchmarks in a gaming environment.

    what type of feedback is that exactly?
     
  12. digitalwanderer

    digitalwanderer Dangerously Mirthful
    Legend

    Joined:
    Feb 19, 2002
    Messages:
    18,992
    Likes Received:
    3,532
    Location:
    Winfield, IN USA
    When the discussion is about a site's bias and the mods/staff from that site are ignoring the one question that is directly showing their bias how am I expected to react?

    If you don't want to answer the question or have no answer to the question that's fine, but I wish you would have said that earlier so I wouldn't have to keep bringing it up. :(
     
  13. Doomtrooper

    Veteran

    Joined:
    Feb 6, 2002
    Messages:
    3,328
    Likes Received:
    0
    Location:
    Ontario, Canada
    Nvnews WAS very biased for years, only recently has it turned into a respectable and more balanced site. Due to some staffing changes, due to some people waking up and smelling the coffee, and membership.
    Still there is many things that piss me off about Nvnews...there is no need for fan sites anymore.

    Being a fan of hardware in general will get you more respect. I've been following Nvnews for 3 years...the mentality of the membership there has changed ALOT for the better.
     
  14. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    I see, well that negates any "special interest" innuendo in my book so you won't hear it from me. :)
     
  15. Dave Baumann

    Dave Baumann Gamerscore Wh...
    Moderator Legend

    Joined:
    Jan 29, 2002
    Messages:
    14,090
    Likes Received:
    694
    Location:
    O Canada!
    Again, I put it too you, how can it affect the developer opinions displayed in the article? Unless you are trying to suggest those responces are fabricated. Those opinions are their opinions, and to my knowledge we included the responce from every developer that we sent out questions to and who sent responces back.

    "Attempt legitimize" -- Sorry, synthetic benchmarks have been legitimate for many many years, unless you are trying to suggest that every CPU, motherboard, RAM, and 3D card review out there is using illegitimate testing methodoligies!

    The article is centered on developer opinions on what is sensible testing methodologies - do you discount their opinions?
     
  16. MaxPower_NVN

    Newcomer

    Joined:
    Dec 9, 2003
    Messages:
    63
    Likes Received:
    0
    Well dang it to heck Digi I thought I clearly did by deferring to MikeC right away. C'mon now, don't frown like that...you use more muscles that way. :D
     
  17. Tim Murray

    Tim Murray the Windom Earle of mobile SOCs
    Veteran

    Joined:
    May 25, 2003
    Messages:
    3,278
    Likes Received:
    66
    Location:
    Mountain View, CA
    Sigh. Dig. Of course you think it's some grand NVIDIA conspiracy--it's not. Is it NVN bias? No. Is it a result of stupid politics between sites that we have no control over and that have a negative impact on us? Yes. Most definitely. One event in particular (that had NOTHING to do with NV News to begin with but one where we were drawn in for bullshit reasons) was the cause of the decision not to publish the reviews, and I'm going to leave it at that.

    And NVN isn't really a fan site anymore. It's a site that is focused on NVIDIA cards in particular because that's what all of us used for years and it's what we know best.
     
  18. FUDie

    Regular

    Joined:
    Sep 25, 2002
    Messages:
    581
    Likes Received:
    34
    That's because most games aren't extensively using shaders. The ones that are, show a performance gap.
    This is not what Carmack has said at all. What he said was that using the NV30 path, the NV35 was on par with the 9800 Pro in shader performance. However, using the ARB2 path, the 9800 Pro was about twice as fast in shader performance.
    Upcoming games that no one has seen, right? How do we even know that shading is the bottleneck?
    So you're saying the NV35 is slower, but it doesn't matter because games will be hand-tuned or the driver will do shader replacement? I think this is wrong. Any game that is not hand-tuned will be slower, period. See Shadermark. If your favorite game is not one of these top-tier games, then you won't get the artificially inflated results other games have and you're going to be unhappy with an NV3x.

    -FUDie
     
  19. Bouncing Zabaglione Bros.

    Legend

    Joined:
    Jun 24, 2003
    Messages:
    6,363
    Likes Received:
    83
    So why do you suppose that Valve stood up and said they spent five times as much time putting in TLC optimisations and still couldn't get reasonable performance on one of the most anticipated and technically advanced games of the last few years? If Nvidia couldn't improve things on that game, how are they going to improve things on anything else that uses any of the significant "cinematic computing" or next-gen features that Nvidia have been selling?

    My personal opinion is that Valve were not willing to compromise their visuals to the extent necessary to get NV3x performing in a reasonable fashion. This appears to be the only way for NV3x to overcome the performance deltas that have been predicted by the various benchmarks (both gaming and synthetic) that we have seen.

    TLC and lots of hassle and workarounds from the developers is not enough to fix the problem.
     
  20. Dave Baumann

    Dave Baumann Gamerscore Wh...
    Moderator Legend

    Joined:
    Jan 29, 2002
    Messages:
    14,090
    Likes Received:
    694
    Location:
    O Canada!
    Seeking opinions from one of the two most important people in this industry is a bad thing then? Why?
     
Loading...

Share This Page

  • About Us

    Beyond3D has been around for over a decade and prides itself on being the best place on the web for in-depth, technically-driven discussion and analysis of 3D graphics hardware. If you love pixels and transistors, you've come to the right place!

    Beyond3D is proudly published by GPU Tools Ltd.
Loading...