You can try to clean up your background processes before starting Blender: CTRL+ALT+SUPR / task Manager/ then click right and end processes you deem unnecessary.
I "feel" that some processes can spike the 3D card usage at times. I have this issue on Octane for rhino and before Blender.
You might want to test this solution before working on valuable files. Ending processes might bring instability to your OS.
Good luck and let me know if it helped.