I've been away from the keyboard for a few days, so apologies for the belated response.
Short response is - you'll never see it, if by "In much larger scale" you mean that it will become relevant to the general public.
The reason being that when viewed as a general co-processor the GPU is horribly, horribly inefficient use of transistors, (and thus money and power). At the introduction of Nehalem Intel made quite a bit of propagandistic noise about how new power drawing features had to pay for themselves 2:1 in terms of overall performance or they wouldn't be implemented. And this makes perfect sense as the majority of x86 processors are used in environments where power limits apply, so performance/Watt is critical. Viewed in that light, a GPU is incredibly inefficient even if by magic all x86 software was rewritten from scratch due to the very limited set of problems it can be applied to. In the real world, the level of utilization would be so low so as to be hard to calculate.
So why is it so popular a topic on these boards? Well, GPGPU was something that was pushed by ATI and nVidia in order to try to strengthen their market legs outside gaming, or at least appear to investors as if they did. (I take the somewhat cynical view that this was done to increase the likelyhood of being bought out under good conditions to their shareholders.) So it received a lot of PR attention. It was new, and therefore interesting to those who take an interest in these things.
But it was only ever a valid proposition on the condition that the GPU was already in the system "for free", and any extra use you could put it to was gravy. And this is only true for the core gamer market. For all other users it's essentially true that once you can drive the interface, little more 3D performance is needed. This is why Intel integrated graphics will always suck in the view of the denizens of this forum, and why it should do so. The way the market is moving, the ever increasing focus on power efficiency and cost of the whole system makes it unlikely that a large part of the market will ever have high-power GPUs.