I have this setup in Substance Designer (opengl and opengl).

Normal:

Displacement:

I have no idea what went wrong, I did a photoshoot with 8 angles with the flash in studio (12.00, 13.30, 15.00, 16.30, 18.00 and so on..) at a low angle with a softbox.