To delete more than one category at once tick the checkbox next to the categories you wish to delete and from the Action menu choose Delete categories.
Confirm or cancel your choice.
This function runs in the background, you will be notified about it in the Action center.