Entropy said:
At some point Beyond3D has to make up its mind on where its focus is, and for whom it exists. The benchmarks used (as with most sites) do not describe gaming in general, but a very small subset that are not CPU limited and which uses particularly advanced techniques.
Excellent point!
The following is copied from
the Mission:
beyond3D said:
Our mission is still to deliver an honest view on 3D architectures, technology, software, and hardware. We try to run an unbiased site. Yes, we do advertise and we do run ads from hardware companies, but we will never let these ads influence our writing. We try to write informative articles on 3D technology, and by delivering good, honest writing we try to deliver the truth to those who visit our site.
From the above statement and from my impression of the site I would extract the following points:
1) Honest view of 3D architectures:
A truthfull description of various elements of 3D architectures that goes beyond marketing fluff. Pipeline arrangement, shader configuration or simple fillrate numbers spring to mind.
This is mostly achieved through synthetic benchmarks (often written by forum members! ) that test very specific parts of the 3D pipeline.
2) Honest view of 3D technology:
IMO this covers technology like texture filtering and AA techniques, shader technology (compilers, languages, implementation etc.) but also precision issues (in the old days 16bit vs 32bit, now FP16/32 vs FP24).
This could be achieved with the usage of only synthetic benchmarks, but beyond3D seems to like to get real world applications/games in the mix as these things vary from software to software (read: application specific optimization) so a larger sample gives a better understanding of the actual usage of said technologies.
3) Honest view of 3D software:
This is IMO closely tied with 2).
How does the software use the technology?
How does the architecture (implementation of the technology) deal with the software?
Currently most 3D software are games. There is of course the professional 3D market (content creation, CAD, etc.) but we are talking consumer devices here and SPECviewperf seems to be the only widely available benchmark.
As Longhorn is said to require DX9 level 3D hardware this may change in the future, but as of today if you want to evaluate a card's real world capability you have to benchmark games. :?
4) Honest view of 3D hardware:
IMO this is an often overlooked point.
I would like to see more of the following:
Display output quality tests (BNC, DVI, S-Video)
Noise level testing
Different features like downclocking in 2D mode, automatic overclocking, etc. and a honest evaluation of their implementation.
So after breaking it up like this I come to the following conclusion:
You need both synthetic and realworld benchmarks to cover everything that's stated in Beyond3D's mission. Currently I have the feeling that there is a very good balance between the different testing methods, and I get a pretty well-rounded review.
As for Aquamark 3?
I have no idea.
These points are of course based on my opinion and I may be wrong, so feel free to correct me.