Archive for January, 2008
mirror/download a website
If you need for some reason to download a full website, wget is a nice tool to accomplish this.
With “man wget” you can get a pretty good idea of all available features. I heard there is also a wget version for windows.
Let us examine an example:
- -m stands for mirroring
- -k and -K convert the page with local links
- -E to convert to an html suffix
- –random-wait to add a random waiting period between requests
$ wget -m -E -k -K -w 1 --random-wait -o logfile http://website_uri/pathNo comments
Disable directory browsing in apache
You can disable directory browsing at several levels like everything else.
In order to do that:
- Edit either the http.conf or a specific .conf file or the .htaccess file.
- If exists, look for “Option Indexes”
- Replace it or create a new line with “Options -Indexes”