Welcome to heng-wei.nien!
What's your videocard?
- Try to uncheck "fake shadows" in specular material because the caustics are bad and unrealistic.

- Try to change to PMC kernel because this kernel is less noises than and much better caustics than PT at same samples per pixel (spp).
- Try to increase spp from 2500 to 5000 or 10000. If you change "caustic blur" from 0.01 to 0.00 then you increase spp to 10000 or 15000.
- Try to increase maxdepth (PMC kernel settings) from default (as 8 diffuse and 24 specular) to 80 spec for eliminate blacks in glass.
Your glass material has dispersion - very good for real-life!

But it's very important that all specular materials must have dispersion at real-life.
