The delete button will not appear when the Label is too long.
I noticed that too. I had to switch it to a different column before I could delete it.