Cancel tagging, untagging tag sets

I have always noticed that when using tag sets, It is difficult to untag once you have done it.

Am I missing anything or is there no function as such?
(I have tried double clicking but didn’t work and I always end up re-tagging it from the beginning)

Thanks in advance.

Try clicking on the column’s header.