UnixServerAdmin

Server Administration & Management

How to Disable website pages download using wget by .htaccess

If you want to disable wget to grab your site pages then simply add the code below in the .htaccess file under public_html directory for which you wish to disable the wget grabbing.

==========================================
SetEnvIfNoCase User-Agent “^Wget” bad_bot
<Limit GET POST>
Order Allow,Deny
Allow from all
Deny from env=bad_bot
</Limit>
=========================================

Now, if anybody tries to grab info from your website using wget, he will receive a 403 error.

Advertisements

March 9, 2011 - Posted by | Apache, htaccess | , ,

5 Comments »

  1. Thank you so much for taking a few minutes to line this all out for people like us. This kind of article ended up being really useful if you ask me.

    Comment by Claudine Hamelinck | June 15, 2011 | Reply

  2. This is a outstanding article. Thank you so much for making the effort to detail this all out for folks. It is a great guide!

    Comment by Octavia Skay | June 15, 2011 | Reply

  3. I was really looking for something on this topic and your blogging perfectly matches my current needs. Please blog more along these lines? Viewers are looking for this knowledge and the type of unbiased opinion that you offer.

    Comment by fresh water | June 16, 2011 | Reply

  4. I learned a lot from this post, great help for me, thank you!

    Comment by Richard Machine | August 19, 2011 | Reply

  5. Very nice, i suggest webmaster can set up a forum, so that we can talk and communicate.

    Comment by Edward | September 4, 2011 | Reply


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: