You're making this comparison to be a lot more than what actually is. Here's the author's description of what the article is about:
No he is not, CSI is saying you need to ensure settings/games are the same because otherwise, the conclusion of the article isn't justified because there is no direct correlation between the end %, which is a valid argument.
now if Hardware Canucks, kept the same games and then a different part of the review with different games, then we can see the correlation of how things shifted, but without the original shift (same games/settings across that time frame) you can't see the changes taking place, further more then trying to add in the new games the shift can be even more dramatic, which causes margins of error to be exceeded.
Now you might be able to make a general conclusion but by no means is that conclusion 100% absolute because its like looking at a trend instead of actual results. A Trend might be wrong and less data you have the more chances it might be wrong, and that is exactly what you have here a trend with limited data compounded by the fact you need to exclude some of the data points because there is nothing to compare to because of the reasons above.
Last edited: