Boots
A bot (e.g. , crawler or web bot) is an automated program that searches, indexes, or interacts with websites, like Google's Googlebot for SEO. In hosting , servers must handle bots to avoid overload; in web design, sites should be bot-friendly, for example, with robots.txt.
Bots aren't inherently good or bad. The Googlebot gets you indexed, as does the Bingbot; price comparison sites and AI systems also monitor your activity. In addition, there are bots that spam forms or try out passwords. The difference lies in their behavior, not their name.
To give you an idea of the scale: On many smaller websites, half of all server requests come from bots, and on some, it's significantly more. This consumes processing time that is then unavailable to genuine visitors. A server-side block after five failed login attempts within two minutes and a limit of 30 requests per minute per address will remove the majority of this load without blocking search engines.
Back to the glossary