Out of curiosity what games do you swap drivers for? I've a 1070 too and its never even occurred to me. Don't think I'm even running the latest drivers.
If you mostly play AAA games then it's not likely to be something you run into as NV will generally ensure that things are correct in the latest AAA games and the most played AAA games.
Since I play a lot of AA and indie games which don't generally see attention by NV's driver teams, sometimes general fixes in the drivers for some game will negatively impact rendering in other games. since there isn't a per game driver profile for them.
Hell, this is the main reason I stopped upgrading to the newest drivers with each driver release. It was driving me absolutely batty in my most played games at the time (Warframe and GW2). In Warframe, for example, depending on the driver the player character would sometimes be translucent such that you'd see the world through the body. GW2 would have a similar rendering bug depending on driver version (not necessarily the same driver that would make Warframe render incorrectly) but would also sometimes introduce a different rendering bug (I've posted a screenshot years ago in one of these threads) where there would be blocks of "weird rendering" (I don't know how to describe it). At the time I had wondered if it was related to tiled rendering (it wasn't) on Pascal GPUs.
Anyway, when I'd upgrade to a newer driver, either rendering artifacts would go away or come back or new ones would be introduced. So I eventually just settled on drivers that worked well in those games and then I don't change the driver unless I need it for another game that I'd start to play.
And don't even get me started on bugs that different drivers introduce in Windows. They don't usually exhibit themselves until the PC has been used extensively. So that was fun finding a driver version that was both relatively bug free after extended use in Windows AND didn't have rendering artifacts in those 2 aforementioned games.
And now, I just don't play a game if it shows artifacts since I don't have time to juggle drivers.
Hell, one driver was so bad that it would mess with my internet connection. Installing a different NV driver made that issue go away. Reinstalling that driver made the issue come back. Why that driver was messing with my internet connection? I have no idea why a GPU driver would need to even touch internet functionality. This was easily reproduced, so something with how that particular driver interfaced with Windows was doing some weird ass things.
That more than anything has me wanting to get a newer GPU. The hope is that maybe either a newer NV GPU wouldn't have so many driver problems or that AMD hasn't started having so many driver problems (I almost never ran into this with the Radeon R9 290, my last AMD GPU). But I don't know that I'd trust that they don't also have these issues now. Bleh.
Regards,
SB