First, PNG images have the ability to have transparent parts.
Second, the image must be square, otherwise it won’t completely fill the square placeholder and will show the underlying color.
Like stated above, you’ll need to edit your image to make sure it’s not transparent and that it has square dimensions.