It's not about refusal at least not in a sense of an conscious act of refusing to buy something because of its price. The market works differently - it's about what you get for the money you're spending.
So for gamers to stop buying expensive GPUs these must stop provide something which make them worth buying.
The examples which failed which I know of failed because they weren't providing enough of performance uplift from a cheaper alternative.
Nvidia has obviously learned that very well which is why we don't have a 4080Ti on AD102 and are unlikely to have a 5080Ti on GB202 either. Also TU102 never left the 2080Ti SKU.
Everyone can bitch about it but these expensive cards sell because they provide value to those who buy them. Simply "refusing" to buy them won't work since you won't be able to coordinate a worldwide refusal of buying some product which seems like a good deal for the value it provides. So for everyone to stop buying these cards - which would in fact lead to Nvidia making changes in the lineup, not necessarily making these products cheaper mind you but making other products at lower price points - they have to miss with their value when designing the lineup. It's not impossible to do but so far they haven't and thus they continue to sell.