Ok, here is a little update. I just arrived home and guess what's back? So the problem seems to be present only when using Remote Desktop (which I can confirm in 2 hours when I'm back at work).
Edit: Confirmed, I'm back at work now and using Remote Desktop again and the icon is not there. Buggy