How to Block Bots with Your .htaccessfile


Blocking robots is a major part of ensuring your website’s safety. It is a necessary part of site maintenance, one that you simply cannot do without. This article presents a quick explanation on what makes this process so vital and how it is done.

Understanding How Bots Work

Before anything else, we need to give readers a definition of exactly what we mean by Bots. For those who are unfamiliar with the term, bots are essentially computer programs which go through the different websites in order to execute a myriad of different tasks. For instance, bots are a crucial aspect of search engines. They are in charge of indexing web pages in order to take note of the relevant terms so that the search engine can determine your rankings. Most affected by these are blog websites.

However, it should be noted that not all bots are harmless. These bad bots are there to search for security vulnerabilities. For instance, some of them will try to sift through your website in search of web forms and user email addresses. This will be used to you and users spam.

That being said, it is vital that you install htaccess block bad bots. Just keep in mind that to htaccess block all bots could prove to be a real challenge. After all, there are innumerable bad bots now. Of course, this only proves how urgent this task is.


Identifying the Bot You Want to Block

As earlier mentioned, you do not want block all bots htaccess. You just want to block the bad ones. There are a few tasks that you need to do before you are able to effectively htaccess block spam bots. The first priority task should be to find its origin. This can be done either by finding its IP address or by identifying the specific User Agent string that it is using.

In order to do these things, you will need to look into your site’s web log and search for the bot manually. Simply download the log from your web host and uncompress it. Take the file and open it with your preferred plain text editor. Combing through the logs may seem like an arduous task but it is necessary. It would also help if you knew the time it hit your site or the specific page it tried to access as this will give you something to go on.


Handling the Bot’s IP Address and User Agent String

Once you have done this and located the entries belonging to the bot, you will need to look for the IP address and the user agent string. This is the next step that needs to be done in order to block spam bots htaccess.

Before you proceed though, it is vital that this part of the process be approached with caution. If you do not approach the problem correctly, then you might be doing more harm than good to your website. To help you with this task, you need to keep in mind that the IP address is a series of numbers. It is made distinct by the fact that they are separated by dots instead of spaces. On the other hand, the term User Agent string pertains to the program used to access your site. It is also worth noting that you do not need the entire sequence for the user agent string, you just need to find the specific part of it that is unique to that particular bot.

Readers need to understand that there is no guarantee that you will be rid of a bot permanently after blocking a particular IP address. As you may well know, viruses and malware are specifically designed to infect computers of all types. They can migrate from one system to another with ease. By carelessly blocking an IP address, you may actually be blocking a real user. In worst cases, you may even end up banning multiple users and a whole set of potential customers simply because you blocked the IP address. To make things worse, you are still vulnerable to that particular bot as it can access your site from a new IP.

Similarly enough, bad bots also intentionally make use of common User Agent names. They usually make use of names which are used by ordinary web browsers, utilizing it as a form of camouflage. This makes the task more grueling as it makes the bot harder to identify. Like with IP addresses, blocking them carelessly would be a mistake as you may also be blocking all the users who are using a particular browser.


Downloading your .htaccess File

Upon learning the bot’s IP address or user agent string, you will need to take the necessary measures to block it. First, you will need to connect to your site through an FTP or SFTP client. Once there, access the top web directory and go to where your home page is located. You will need to look for the .htaccess file. If it is there then simply download.

If it is not there, then you need to ensure that it is not simply hidden from your view. While the process of finding it differs depending on the FTP program being used, the gist of it remains the same. Just set a Remote file mask in the program’s options. This may require you to log off beforehand. Once you have enabled the mask, log in to the program to check for the .htaccess file again.

Now, there is no need to worry if you are still unable to find it despite following the steps presented. Most web hosts do not include it in their default setup anyway. However, this means that you will have to create one yourself.


Creating and Uploading the .htaccess File

A .htaccess file is necessary if you want to block bots effectively. Whether you are creating one from scratch or editing an old file, you will need the technical expertise of the professionals. We won’t bore you with the technical stuff and the specific code lingo. This is where we come in. We are more than adept at working it out for you.

Once that is done, it is simply a matter of integrating the new code to the .htaccess file, saving it, and uploading it to the website.  In order to upload the new file to the web server, we will be making use of an FTP/SFTP program.

Blocking bots is an important aspect of site security. However, it needs to be done carefully and correctly. Fortunately, we would be more than willing to do it for you.

Recent Posts
Showing 106 comments
  • oprol evorter

    I believe this web site holds some really superb information for everyone. “The expert at anything was once a beginner.” by Hayes.

  • Lewis Fosser

    My spouse and I absolutely love your blog and find the majority of your post’s to be exactly what I’m looking for. can you offer guest writers to write content for you personally? I wouldn’t mind writing a post or elaborating on many of the subjects you write in relation to here. Again, awesome web site!

  • With havin so much content do you ever run into any issues of plagorism or copyright infringement? My blog has a lot of exclusive content I’ve either created myself or outsourced but it seems a lot of it is popping it up all over the internet without my permission. Do you know any ways to help protect against content from being ripped off? I’d certainly appreciate it.

  • free acim resources

    Great – I should certainly pronounce, impressed with your web site. I had no trouble navigating through all the tabs and related information ended up being truly easy to do to access. I recently found what I hoped for before you know it at all. Quite unusual. Is likely to appreciate it for those who add forums or something, web site theme . a tones way for your client to communicate. Excellent task..

  • smoretraiolit

    Wow! Thank you! I permanently wanted to write on my site something like that. Can I implement a part of your post to my website?

  • Thanks so much for the post.Really thank you! Great.billiges 100mg viagra

  • g first

    Hey! This is kind of off topic but I need some help from
    an established blog. Is it hard to set up your own blog?
    I’m not very techincal but I can figure things out pretty quick.
    I’m thinking about setting up my own but I’m not sure where
    to start. Do you have any tips or suggestions?
    With thanks

  • g that

    I’m not positive where you are getting your information, however good topic.

    I needs to spend a while finding out much more or understanding more.
    Thank you for great info I was looking for this info for my mission.

  • g our

    Howdy just wanted to give you a brief heads up and let you know a few of
    the pictures aren’t loading properly. I’m not sure why but I think its a linking issue.
    I’ve tried it in two different browsers and both show the same results.

  • It’s perfect time to make some plans for the future and it’s time to be happy.
    I’ve read this post and if I could I desire to suggest
    you few interesting things or tips. Maybe you could write next articles referring to this article.
    I want to read even more things about it!

  • What’s Taking place i am new to this, I stumbled upon this I have discovered It absolutely helpful and it
    has aided me out loads. I am hoping to contribute & help other customers like its helped me.
    Great job.

  • Everything is very open with a clear clarification of the issues.

    It was really informative. Your site is very helpful.

    Thanks for sharing!


    Pretty! This was an incredibly wonderful article. Thanks for supplying
    this information.

  • Great post. I was checking continuously this blog and I’m
    impressed! Extremely useful information particularly the last part :
    ) I care for such info a lot. I was seeking this certain info for a
    very long time. Thank you and best of luck.

  • Wow! At last I got a website from where I be capable of actually take useful information regarding my study and

  • Howdy I am so glad I found your webpage, I really found you by accident, while I was browsing
    on Askjeeve for something else, Anyways I am here now and
    would just like to say cheers for a marvelous post and a all
    round enjoyable blog (I also love the theme/design), I
    don’t have time to browse it all at the moment but I have saved it and
    also added your RSS feeds, so when I have time I
    will be back to read much more, Please do keep
    up the excellent job.

  • My spouse and I stumbled over here coming from a different web address and thought I might as well check things out.
    I like what I see so now i am following you. Look forward to going over your web page repeatedly.

  • Excellent items from you, man. I’ve keep in mind your
    stuff prior to and you are simply extremely excellent.
    I really like what you have bought right here, certainly like what you’re saying and the way in which
    during which you say it. You are making it entertaining and you still care for
    to stay it wise. I can’t wait to learn far more from you.
    This is actually a great web site.

  • Thanks for finally writing about > How to Block Bots with Your
    .htaccessfile – < Liked it!

  • Hi! Do you use Twitter? I’d like to follow you if that would be
    ok. I’m absolutely enjoying your blog and look forward to
    new updates.

  • accounting firms

    I seriously love your site.. Great colors & theme. Did you create this web site yourself? Please reply back as I’m looking to create my own site and want to find out where you got this from or just what the theme is called. Appreciate it!

  • Is viagra effective

    Thanks so much for the post.Really thank you! Great.

  • Generic viagra

    Thanks so much for the post.Really thank you! Great.generic viagra

  • 100 mg blue viagra

    Thanks for the article post.Really thank you! Great.100 mg blue viagra

  • Thanks so much for the post.Really thank you! Keep writing.viagra price in england

  • Generic viagra

    Thanks so much for the post.Really thank you! Keep writing.generic viagra

  • Thanks so much for the post.Really thank you! Keep writing.viagra usa ohne rezept

  • Generic viagra

    Thanks so much for the post.Really thank you! Great.generic viagra

  • Viagra cheap

    Thank you for this post. Its very inspiring.viagra cheap

  • Thanks a lot for the post.Really thank you! Much obliged.viagra cheaper alternatives

  • Dorie Keene

    I just want to mention I am just beginner to blogs and certainly savored your blog site. Likely I’m likely to bookmark your site . You definitely have outstanding writings. Thanks for sharing with us your web site.

  • CBD Capsules

    I just couldn’t depart your site prior to suggesting that I extremely enjoyed the standard information an individual provide for your visitors? Is gonna be back frequently in order to inspect new posts

  • Investments

    Spot on with this write-up, I really think this site needs much more attention. I’ll probably be returning to see more, thanks for the advice!

  • marketing jobs can really earn you lots of dollars but most of the time, it is a difficult job*

  • I was curious if you ever thought of changing the structure of your website? Its very well written; I love what youve got to say. But maybe you could a little more in the way of content so people could connect with it better. Youve got an awful lot of text for only having 1 or two images. Maybe you could space it out better?

  • Leading Digital Marketing agency in India and Kolkata, Leading Web Design company. Providing web designing and Digital marketing services, Digital marketing course, and certification with an internship.

  • Hello! I understand this is somewhat off-topic but I had to ask. Does building a well-established website like yours take a large amount of work? I’m brand new to blogging but I do write in my diary daily. I’d like to start a blog so I will be able to share my experience and feelings online. Please let me know if you have any kind of recommendations or tips for brand new aspiring bloggers. Appreciate it!

  • binary options

    Saved as a favorite, I love your blog!

  • SEO

    Right here is the right webpage for everyone who would like to understand this topic. You understand a whole lot its almost tough to argue with you (not that I personally would want to…HaHa). You definitely put a fresh spin on a topic which has been discussed for many years. Great stuff, just excellent!

  • You have a very nice layout for your blog. i want it to use on my site too “ 


    When I initially left a comment I seem to have clicked the -Notify me when new comments are added- checkbox and from now on whenever a comment is added I receive four emails with the same comment. Perhaps there is a way you can remove me from that service? Many thanks!

  • web hosting company

    Aw, this was an incredibly nice post. Finding
    the time and actual effort to make a great article… but what can I say… I put things off a whole lot and don’t seem to get nearly anything done.

  • Website Marketing

    I blog frequently and I genuinely thank you for your information. Your article has really peaked my interest. I am going to book mark your website and keep checking for new information about once per week. I subscribed to your RSS feed as well.

  • Wonderful post! We will be linking to this particularly great article on our site. Keep up the good writing.

  • Good blog you have got here.. It’s difficult to find excellent writing like yours these days. I seriously appreciate people like you! Take care!!

  • website host

    Incredible points. Sound arguments. Keep up the good spirit.

  • Its not my first time to visit this site, i am browsing this website dailly and get nice facts from here every day.

  • Dannette Zorzi

    This is a good tip especially to those new to the blogosphere. Brief but very accurate information… Appreciate your sharing this one. A must read article!

  • What’s up friends, how is the whole thing, and what you want to say concerning this paragraph, in my view its actually amazing designed for me.|

  • cbd gummies

    I’m the co-founder of JustCBD label ( and I’m presently trying to expand my wholesale side of company. It would be great if anybody at targetdomain give me some advice ! I thought that the most effective way to accomplish this would be to talk to vape stores and cbd retailers. I was hoping if anybody could suggest a trusted website where I can buy Vape Shop Business Sales Leads I am already looking at, and Not sure which one would be the most ideal choice and would appreciate any support on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  • T's Junk Removal

    Hi, everything is going well here and ofcourse every one is sharing information, that’s really excellent, keep up writing.|

  • Click For More

    Good blog post. I certainly love this site. Continue the good work!

  • Digital Marketing

    I couldn’t resist commenting. Very well written!

  • gox scooter

    You’ve made some really good points there. I looked on the net for more information about the issue and found most people will go along with your views on this website.

  • Again On

    Heya i’m for the first time here. I came across this board and I find It really useful & it helped me out much. I hope to give something back and help others like you helped me.|

  • Google

    That is a very good tip especially to those fresh to the blogosphere. Simple but very accurate info… Many thanks for sharing this one. A must read article!

  • Casino

    I am really surprised. Truly appreciate your efforts and intention in publishing this article. Great work

  • Someone necessarily assist to make significantly articles I might state.
    This is the first time I frequented your web page and to this point?
    I amazed with the analysis you made to make this actual submit extraordinary.
    Wonderful process!

  • Blogger Task

    I was extremely pleased to find this page. I wanted to thank you for your time due to this fantastic read!! I definitely liked every bit of it and i also have you book-marked to see new stuff in your web site.

  • walmart jobs

    I am sure this post has touched all the internet viewers, its really really pleasant post on building up new weblog.|

  • web hosting service

    I love your blog.. very nice colors & theme. Did you make this website yourself or did you hire someone to do it for you?
    Plz respond as I’m looking to create my own blog and would like to know where u got this from.
    thank you

  • instagram mavi tik

    Hello there! Do you use Twitter? I’d like to follow you if that would be okay. I’m undoubtedly enjoying your blog and look forward to new updates.|

  • Scopiers

    Pretty! This was an incredibly wonderful post. Thank you for providing this info.

  • web hosting company

    I every time used to read paragraph in news papers but now as I am a user of web thus from now I
    am using net for articles, thanks to web.

  • best web hosting

    Hi there, i read your blog occasionally and i own a similar one
    and i was just curious if you get a lot of spam feedback?
    If so how do you prevent it, any plugin or anything you can recommend?
    I get so much lately it’s driving me mad so any
    support is very much appreciated.

  • Backlink Indexing

    That is a very good tip particularly to those fresh to the blogosphere. Short but very accurate info… Thanks for sharing this one. A must read post!|

  • CBD oil for dogs

    Everyone loves what you guys are up too. This sort of clever work and exposure! Keep up the superb works guys I’ve included you guys to blogroll.|

  • I was wondering if you ever thought of changing
    the layout of your blog? Its very well written; I love what youve got to say.
    But maybe you could a little more in the way of content so
    people could connect with it better. Youve got an awful lot of text for only having
    1 or two images. Maybe you could space it out better?

  • flight tickets

    Hola! I’ve been following your website for some time now
    and finally got the courage to go ahead and give you a shout out from Lubbock Tx!
    Just wanted to say keep up the excellent work!

  • sky scanner

    Hello my family member! I wish to say that this
    post is awesome, great written and include
    approximately all important infos. I would like to
    look extra posts like this .

  • I like it when individuals get together and share thoughts. Great site, stick with it!|

  • Cosmo Optical

    Pretty! This has been a really wonderful post. Thanks for supplying this information.

  • Hi, after reading this remarkable post i am
    too happy to share my know-how here with

  • Go Green

    Environment Awareness is the awareness of the importance and fragility of the environment. It helps us realize the fragility of our environment by making us realize the issues that we will do and contribute to the preservation of our environment. Environmental awareness is a simple way to be an lively environmentalist and help contribute in making a shiny future for future generations. It can also be important for us to know the things that are contributing towards the destruction of our environment and what can be accomplished to stop them from taking place.

  • Thanks for some other informative blog. Where else could I am getting that kind of info written in such an ideal manner?

    I have a challenge that I’m just now working on, and I have
    been on the glance out for such information. adreamoftrains web hosting sites

  • 1st Counsel

    This site really has all of the information I needed concerning this subject and didn’t know who to ask.

  • I really like reading through a post that will make people think. Also, thank you for permitting me to comment!

  • travelocity

    Thanks for some other informative website. The place
    else could I am getting that type of info written in such an ideal approach?
    I have a challenge that I’m simply now running on, and I’ve been on the look out for
    such information.

  • Today, while I was at work, my cousin stole my apple ipad
    and tested to see if it can survive a 30 foot drop, just so she can be a youtube sensation. My
    apple ipad is now broken and she has 83 views.
    I know this is entirely off topic but I had to share it with someone!

  • I could not resist commenting. Exceptionally well written!

  • Margaret Morse

    A bubble butt black woman in this action movie from Habib

  • Janella Perini

    I don’t even know how I ended up here, but I thought this post was good. I do not know who you are but definitely you are going to a famous blogger if you aren’t already 😉 Cheers!

  • Plumber Online

    I used to be able to find good information from your articles.

  • darkest techno

    When I originally commented I seem to have clicked on the -Notify me when new comments are added- checkbox and now every time a comment is added I recieve four emails with the exact same comment. There has to be a means you are able to remove me from that service? Cheers!

  • 안전토토

    Best view in the town !

  • Love watching movies !

  • There is certainly a lot to find out about this subject. I like all the points you made.

  • 안전놀이터

    Love watching movies !

  • 안전토토

    Best view in the town !

pingbacks / trackbacks
  • used canada goose womens

    womens lightweight jackets winterjasthe north face womens trevail parka tnf blackmens contrast subtle piping knitoff white logo knit scarf 255 shop ss19 online fast delivery

  • wondermake fashion ladies girls drawstring travel

    pillow ring pillow wedding pillow wedding ring bearer wedding ceremony wedding decor wedding accessories flower girl rustic pillow ringandy warhol as a banana t shirtair mag diy light up shoes lighting kit marty mcfly for nike back to the future custom…

  • louis vuitton iphone 7 plus 8 plus folio case depop

    mahina xl louis vuittonlouis vuitton mini lin bags 33 for sale onsold lv neverfull mm in black epi leather nwtlouis vuitton mens damier canvas cross body shoulder bag with flap outer pocket

  • 注专讻讛 诇讟讬住讛 注诐 转诪讜谞讛

    celebrities in hot bikini scarlett johansson in so hot bikinibotas dr martens jadonrosie huntington whiteley denim jacket paige black jeans brown leather saint laurentcasquette soleil bebe

  • pallone da calcio italia con bandiera italiana taglia 5

    urban renewal made from remnants tupac t shirtthe uks most popular carnivals the holiday lettings blogwill the dress save m s we take a first look at marksen chiapas luis manuel

  • hot sale hoodies sweatshirts 2019 winter fleece autumn hoody print game of thrones team targaryen fire blood sweatshirt kpop in

    veri啪ica iz obeskom v obliki srca in kristali swarovski ivanna collection love setbe啪i膷ni punja膷 za samsung galaxy s4omega satovi prodajakoja slavna dama ima najbolji kupa膰i kostim

  • damaged box the batman dragster catwoman pursuit lego dc comics set 7779

    lego instructions city arctic 60193 arctic airspielzeug archives seite 2 von 5 savi trendblogwho has spider man star tom holland dated and is he goingwait wheres hogwarts i has a hotdog dog pictures

  • toy story toddler

    iron man 2 mark mk 4 5 6 war machine whiplash kubrick figure set medicomnew lego ninjago movie posterslego duplo piston cup race 10857 building kit not completelego city set 60020 capital city

  • nike kids hypervenom phantom ii neymar jr fg white red

    bottine ouverte chaussuredeeluxe tops femme top blanc v锚tements femmeadidas gazelle homme chaussures chaussureschaussures de mar茅e 2019 hot new vache en daim richelieu

  • puma womens muse echo satin ep sneakers badminton shoes 365522 01 white color sneakers high quality shoes women size 35 40

    new converse all star glitter toe sneakers shoes whitegirls converse pink sizeconverse montante platform cuirconverse chuck taylor all star dc comics superman rouge

  • mini lady dior lambskin bag black bags list in 2019 lady

    wedding pumps up to 90 off at tradesyperry bomb茅 nylon totepersonalized nfinity cheer bagvalenti rfid small trifold wallet

  • black yeezy sneakers

    jewelery laget med fotodisney frost jakke unleash the magicryggsekker til ungdom ryggsekkermygate forlenger til mg1 trappegrind 12

  • 8 best bobi images in 2018 jerome dreyfuss

    womens spanx pleather leggingswomens dad caps cheap villagehatshopwomens nike hypervenom agwomens james harden shoes price

  • paul smith low price perfume online

    calvin klein jeans leather jacket anthracite biker lookwear this jason bourne cool materialalpine brown fur leather jacketalpinestars smx plus racing boots black red

  • clarks originals sale mens

    extra wide thigh high bootsgym bag costpartial wigs for hair losscazorla boots

  • missoni white beanie mens

    the ultimate baseball look seattle mariners trident vs tealmilwaukee brewers socks funny birthday gifts baseball teamnike womens chicago white sox gym vintage full zip hoodedcincinnati reds mlb wicking mens t shirt baseball size xl

  • majice sa slikom

    timberland asics adidas online shop clearance sale nikeadidas mens x 15.1 soft ground football bootswomens bruce bowen san antonio spurs black backer pullover hoodiekids alex morgan 13 usa womens 2015 away soccer jerseyt

Leave a Comment