Windows generates it each time you view the folder using the thumbnail view, that lets you see the images before you open them. It won't go away unless you disable it somewhere, can't remember excactly at the moment.
EDIT:
http://www.annoyances.org/exec/show/article03-204