Try
Audacity. You can use it to do exactly what you described.
You just click and drag to select a part of a song, and press delete to delete the selection.
To export to MP3 you will need LAME, there are instructions on the download page about getting LAME.