All you accomplish with a rubric is that people will criticize the rubric, which isn't really a change from what happens right now.
I don't think we're looking at a rubric. More a collection of (agreed upon) reference points and a sort of metacritic score for graphical achievement. At the moment, Clukos says UC4's water is the best ever. VFX says Batman's is better. There's no actual analysis of the water effect in detail to determine which really is 'the best'. If there were a discussion that could arrive at an understanding of both water techniques, it could hopefully either accpet they are good but different, or one is technically better. And then someone introduces...Crysis and we have a benchmark for water, say.
How do we rate these two very different cases against each other in a way that is both useful and can be evaluated in a purely objective manner?
I'm not sure we would. Lighting ought to be measured against 'how close to real' (for photorealistically lit games) regardless of the technique used to achieve that. Within that domain, we'd factor in dynamic lighting, secondary lighting, AO type hacks, etc. based on what appears on screen. QB may look great, but also has lots of errors - so that's factored into its solution. UC4 has some nice lighting and some amazing secondary ilumination, but it has issues with when they're applied (certainly outdoors) and a lack of contact shadows.
The reasonable thing is for people to stop panicking over whether a game's graphics are the best.
We've been saying that for years but it doesn't stop the mindless derailments.
The options to me seem to be:
1) Ban anyone saying anything enthusiastic about graphics to avoid reactions
2) Ban reactions to enthusiastic remarks about graphics to prevent these types of arguments
3) Separate out all comparison discussion from game discussion, stick it in the tech forum, and moderate extensively
4) Do nothing at maintain the
status quo
5) Try to come up with a framework by which games can be compared without it getting personal or emotional. This has the added benefit of tracking best-in-class realtime solutions which is something we probably ought to be doing anyway. I like the idea of a 'best in class' database/library showing techniques and linking to technical documents and papers so devs can see what's available, what results are, and find papers to help them achieve that.