archangelmorph
Veteran
Couldn't have said it better myself
Here's a good classic white paper (made by Sony R&D in 2009):
http://harmful.cat-v.org/software/O...ls_of_Object_Oriented_Programming_GCAP_09.pdf
Slides 17 and 18 are especially notable. RAM latency in cycles is now 400x more than in 1980 (comparison between PS3 and probably the first x86 PCs). Same is true for memory bandwidth relative to CPU ALU performance. And the gap is widening all the time. Memory performance is now the most important thing when you are designing efficient algorithms, both for CPU and GPU (both are memory starved now, and both will be even more in the future).
Surely this depends on how far IDM, AMD & Intel can take 3D memory stacking, through-silicon-vias technology & the like going forward?
I'd imagine if any technologies are going to radically improve memory latencies to and from RAM it will be these.