You can uninstall it by simply deleting the contents of the directory where you installed it - first of all make sure it isn't running (ie, kill it in the Task Manager or reboot/logoff).
You shouldn't have chose to remove the tray icon with no desklets up and running