Saying using the GPU for GP-GPU assumes GPUs should only be utilized for graphics...
Yes. As you said earlier, in reality we have a variety of computational problems to solve and a pool of processing resources to solve them. However, typically in a game, developers target visuals above everything else. I can't imagine many developers thinking to cut back on possible graphics to allow for other gameplay features. If they have access to a processor capable of making their game look better, they'll use it for that. eg. Cell is being used as GPU support for that very reason.
Looking at PS3, there is a lot of processing power there, which is almost always thrown at graphics (animation, setup, post, etc.). How many developers have said, 'let's forget the graphics, just use RSX for that, and let's throw Cell at these sophisticated algorithms'? In that same vein, in the future will developers be thinking, 'let's create a new game that doesn't look as good as everything else out there but uses the GPU to calculate some amazing stuff' or 'we've got to aim for the best looking title possible, so let's not worry too much about AI and destructible materials and creating our organic universe'?
Indeed, looking at XB360, how many games are using the GPU to help with processing? The principle interest is just in creating better graphics. And from a business POV that may be the right one, as graphics is one of the strongest selling points.
I think that concept will die sooner than later as chips like Fermi blow C2D, PPEs, K10s, and SPEs out of the water in streaming tasks. The question is how much to gamble on it being the future--being GP has a lot of advantages over saying, "Your code must be X big, your data format must be in Y construction, and you need to vectorize it--or your performance will suck."
That didn't go down too well with Cell and it wasn't so demanding! However, everything is moving in that direction, so it'll be 'old news' and a common problem that all tool creators will be addressing. I dare so though that devs would prefer a current model. A GPU that could do everything asked of it, leaving a simple game engine on a fairly simple processor, would probably be the prefered choice for many developers. That's my guess anyhow.