External Contacts

Does anyone know how to delete a contact that was added by mistake externally? I have tried to obvious delete, but it just ignores it. When you try to edit it, it says that the contact was added externally and any data changed will be lost.