You can only remove contacts that do not have you in their contact list anymore. To remove those, right click them and select Delete. If this option is grayed out, you cannot delete them because they still have you in their list. See Messenger Privacy for more information
/ 
