There is a pulldown menu next to the email address for each contact. Click on “Delete” in this menu.