Here's a great example of what I'm trying to do

Yet with daylight the pattern is perfect the white floor ( and all other objects ) are bright blue.
With normal texture white lighting the color white is perfectly white, but no shadows to make the pattern.
With the HDRI rendered from MR, I get blue floor and no shadows...
The only solution I have is to render one white lighting pass and then another with sky but set GI Mode to none and composite just the light on top.
Rendering separate passes is kinda lame considering I just want the sky to be LESS BLUE