Google and read these first:
http://www.google.be/search?hl=nl&q=refresh+icon+cache
Also, you don't need to restart Windows, see google again:
http://www.annoyances.org/exec/show/article06-031
Has that worked?
----------------
btw, I see that all the icons are way different than the standard default Windows icons. Do you use any skin or something which might interfear with the proper workings of the icon cache or layout of Windows in general? Try to uninstall the skin first...
/ 
