The stuttering only happens on certain maps. I have not had any hard crashes. And any hard crash is likely related to your hardware stability (overclocking, shitty power supply, bad memory than the drivers.)
I haven't had random performance drops. It almost sounds like you have something in the background-like a virus scanner. Random distortion in the terrain should be easy to verify with a screenshot. An old 97.x driver did have some form of texture corruption (glitching) in this game, but 97.92 doesn't have that problem.
That doesn't happen to me, and slowmo mode is supposed to slow down the game. It sounds like these problems which aren't widespread point to an issue with YOUR setup.
A drop to 15 fps and below from switching weapons is a driver issue? It sounds like a UI issue to me. I also have not had any of those drops.
Given that the majority of the problems that you've stated are far from being established as a result of poor drivers, it's a bit premature to call them the worst.
PEBKAC seems more likely given the fact that I haven't experienced these problems (save for the UT2004 stuttering [on some maps, not all], which I hear is fixed in a new Vista driver revision) on my 8800GTX with 97.92 drivers on XP SP2.