To delete a Mail Collector or Connection click on the little waste-bin icon at the left of the green bar on the Mail Collector or Connection settings page.

(We are going to try to make this more obvious in the next version of VPOP3).