Try Noroom's Listmanager, with that you can clean up your contactlist (like delete ppl from the allowlist wich you don't have on your contactlist anymore and deleted you too...clean up the blocklist, you might have ppl onthere that don't have you on their list anymore).
/ 
