 |
| View previous topic :: View next topic |
| Author |
Message |
Capt_Dave
Site Admin
Joined: Mar 29, 2004
Posts: 3936
Location: Cape Fear, NC
|
 Posted: Tue Dec 18, 2007 8:09 am Post subject: Do you run your own website.... |
 |
|
Take this and drop in into a file called ".htaccess" or add it to the one that is already present. IF you do not see it in your file list....try -la before you upload....(htaccess files do not show in most ftp clients)
| Code: | #Bad Bots
RewriteCond %{QUERY_STRING} \.ru
RewriteCond %{HTTP_USER_AGENT} ^Java [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^LWP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^lwp-trivial [OR]
RewriteCond %{HTTP_USER_AGENT} ^libwww-perl [OR]
RewriteCond %{HTTP_USER_AGENT} ^NaverBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Twiceler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Yeti [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR]
RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus |
_________________
Capt. Dave
Life is SHORT....Fish Hard!
NOT a Member??You are missing ALL the Downloads........and most of the Pictures....!! |
|
| Back to top |
|
 |
Capt_Brent
Captain
Joined: May 03, 2004
Posts: 187
Location: Wilmington, NC
|
| Posted: Tue Dec 18, 2007 2:44 pm Post subject: |
|
|
what does it do Dave???
_________________
Capt. Brent Stanley
Current Adventure Charters
910.200.9959
www.currentadventurecharters.com
MMSI#338034031 |
|
| Back to top |
|
|
Capt_Dave
Site Admin
Joined: Mar 29, 2004
Posts: 3936
Location: Cape Fear, NC
|
| Posted: Tue Dec 18, 2007 3:26 pm Post subject: |
|
|
Capt_Brent,
It blocks the BOTS listed from spidering your site. It also blocks referrers from the domain ru
The bots listed there....you don't want them on your site....they are for harvesting e-mail addresses, stealing content and other things that are not desired.
Dave
_________________
Capt. Dave
Life is SHORT....Fish Hard!
NOT a Member??You are missing ALL the Downloads........and most of the Pictures....!! |
|
| Back to top |
|
|
HOTSPOT
1st Mate
Joined: Jul 10, 2008
Posts: 59
|
| Posted: Thu Jul 24, 2008 8:26 am Post subject: |
|
|
Thanks for the code Capt Dave. Adding it to all my sites.
You mind posting the code to disable hot linking of images?
_________________
 |
|
| Back to top |
|
|
Capt_Dave
Site Admin
Joined: Mar 29, 2004
Posts: 3936
Location: Cape Fear, NC
|
| Posted: Thu Jul 24, 2008 9:12 am Post subject: |
|
|
I use several methods. Which one do you want? htaccess in the image DIR is the best IMHO.
That way you can allow or disallow who ever you want.
Dave
_________________
Capt. Dave
Life is SHORT....Fish Hard!
NOT a Member??You are missing ALL the Downloads........and most of the Pictures....!! |
|
| Back to top |
|
|
Capt_Dave
Site Admin
Joined: Mar 29, 2004
Posts: 3936
Location: Cape Fear, NC
|
| Posted: Thu Jul 24, 2008 9:17 am Post subject: |
|
|
This is what I use....place it in an htaccess file in the image DIR
| Code: | Options -Indexes
RewriteEngine on
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !^http://(www\.)?fryingpantower.com(/)?.*$ [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?kurebeachfishingpier.com(/)?.*$ [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?continentalshelf.com(/)?.*$ [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?militaryappreciationday.org(/)?.*$ [NC]
RewriteRule .*\.(gif|jpg|jpeg|bmp|pdf|zip|doc|tif|tiff|xls|wmv|txt)$ http://www.fryingpantower.com [R,NC]
|
You add any site you want to allow to the list. Only sites listed are allowed to use the files in that DIR.
Dave
_________________
Capt. Dave
Life is SHORT....Fish Hard!
NOT a Member??You are missing ALL the Downloads........and most of the Pictures....!! |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum
|
|
|
|
Forum FAQ
Search
Usergroups
Profile
Log in to check your private messages
Log in
