You either have supremely excellent hearing or you really failed the fan lottery with yours. I have to put my ear next to it to hear when it's running, it's a slight woosh. While certainly not bothersome, my 3060 is noticeably 'louder', and it's prob the quietest GPU under load I've owned in the past 5 years.
The gap is extremely small without PSSR. I thought Sony would aim for at last a 100% improvement, but all we got was at best 45%. From my perspective, that's too little.