I don't think so. Once a invitation is sent it is sent. The only thing you can do is once they accept the invitation and they appear on your contact list deleate the person and block them. Simple as that.
They dont have to accept do they, they appear on your contact list as soon as you add them, they don't appear online until they accept, just block and delete them as soon as you go on.