When I download manually it simply doesn't see it there. When you click the button on download screen to open path, it opens the folder I created with the DLLs in it. So the path is correct.

I have the same problem with RTX 2060. I downloded cudnn manually and placed it in designated folder after I clicked download button two times (downloaded 2 times) but download windows opens still.