There is no way to remove easily a custom tag from ezoe.

You can remove them by disabling the editor and removing tags manualy but it is not a good thing for final users.

We should add an option to remove the tag from the custom tag panel or to add a tool who will remove all tags on a selection (could be usefull in other ways).