I don't keep the CC running ever, however it is installed if I want to change any settings. When I first installed Vista and initial ATI drivers, CC used to be very fast, much faster than XP beforehand. Now it's just as slow. Never had problems with crashing or video playback with it open though.
If I underclock with tray tools, does it need to be running to stay in effect?