What happened to the Messenger Plus! forums on msghelp.net?
Shoutbox » MsgHelp Archive » Skype & Technology » Tech Talk » Website extraction

Website extraction
Author: Message:
Adeptus
Senior Member
****


Posts: 732
Reputation: 40
Joined: Oct 2005
RE: Website extraction
The best tool to use if you want to create a local copy of all or part of a website is wget.  It is command line based, so it takes some learning curve to get it to do exactly what you want: "wget -r -np http://somesite.com/somepage/" is a good starting point.  However, once you learn how to use it, it can do anything as far as this kind of stuff goes. 

I use this Windows build. It is not the latest version, but it works just fine.  If you use this package, you will want to edit the PATH environment variable and add ";%PROGRAMFILES%\GnuWin32\bin" at the end (";%PROGRAMFILES(X86)%\GnuWin32\bin" on 64-bit Windows).

Other than that, the DownThemAll Firefox extension works well for simpler tasks.  It won't recursively mirror a site, but it is fine for grabbing all the images on a page or all linked files of a certain type.

09-29-2009 01:11 PM
Profile E-Mail PM Find Quote Report
« Next Oldest Return to Top Next Newest »

Messages In This Thread
Website extraction - by SmokingCookie on 09-28-2009 at 07:22 PM
RE: Website extraction - by Menthix on 09-28-2009 at 08:33 PM
RE: Website extraction - by iKingsten on 09-28-2009 at 09:06 PM
RE: Website extraction - by Adeptus on 09-29-2009 at 01:11 PM
RE: Website extraction - by SmokingCookie on 09-29-2009 at 04:14 PM


Threaded Mode | Linear Mode
View a Printable Version
Send this Thread to a Friend
Subscribe | Add to Favorites
Rate This Thread:

Forum Jump:

Forum Rules:
You cannot post new threads
You cannot post replies
You cannot post attachments
You can edit your posts
HTML is Off
myCode is On
Smilies are On
[img] Code is On