Hi Dave,
I'm not sure I see the fallabck as 'wrong'; a tad daft to say they shouldn't be directly comparable.
If the scenes generated by the "fall-back" and "full 1.4 PS" are different (as is implied in the FAQ..."same looking effect"), then they should not be directly compared.
What bothers me, is that MadOnion goes out of their way in the FAQ to explain that they built the test for "compatibility."
FAQ:
The Advance Pixel Shader test is what we call a Feature Test, which means that we, above all, want to present some new technology.
There is a conflict between showcasing "new technology" and making it "compatible" with old technology. Which is it? A showcase of the new PixelShader 1.4 technology, or not?
The point of "showcasing technology" is to do something specifically WITHOUT regard to compatibility with older tech. When you do that, you can be limiting what you're doing with the new tech.
Why not have one bump-mapping feature test. Fall-back to emboss mapping if Dot-3 isn't present. You can generate two "scenes" that show Emboss looking pretty close to Dot-3 for "compatibility", but only if you limit how you present DOT-3.
FAQ:
Both modes could be optimized to show more performance either way, but now the test is just optimized for maximum compatibility.
So with this in mind, isn't it actually DANGEROUS to show scores for this "feature" test? I mean, it sounds like very little consideration for performance was given, and most was on making it "compatible".
It is unbelievable to me, that at seemingly EVERY opportunity MadOnion has to make a decision, where deciding one way would "favor" nVidia and the other way would "favor" someone else....the decision has ALWAYS been in favor of nVidia.
I'm not one to typically promote conspiracy theories and hidden alliances, but hell, Mad Onion makes it almost impossible to believe that nVidia doesn't have extremely heavy influence on how 3D Mark is presented.