Vulnerabilities / Threats
12/10/2013
02:42 PM
Connect Directly
Google+
Twitter
RSS
E-Mail
50%
50%
Repost This

'Imposter' Bots On The Rise

A whopping 61.5 percent of all website traffic is attributed to bots of all types, new report finds

Both good and bad bots are frequenting websites, but, overall, the traffic they generate makes up more than half of all site traffic.

A new study by Incapsula based on 1.45 billion bot visits to some 20,000 websites worldwide in a 90-day period found that these code-based visitors account for 61.5 percent of all website traffic, an increase of 21 percent over 2012.

The good news is that most of that growth comes from good bots -- search engine crawlers, SEO services crawlers, and other types of legitimate software agents, for instance. And spam bots are down from 2 percent in 2012 to 0.5 percent this year. Much of that is due to Google's efforts to discourage comment-spamming SEO methods as well as link-spamming.

"We've noticed a 75 percent reduction in comment spammers, and that's really significant," says Marc Gaffan, co-founder of Incapsula.

The bad news is that 31 percent of bots are malicious. There was an 8 percent increase in unclassified bots with hostile intentions, according to Incapsula. Those are bots posing as legit agents, such as search-engine or browser user agents. The aim of these "impersonators" is to bypass the website's security, and they are typically built for specific malicious activity, such as automated DDoS agents or Trojan-activated browsers.

"The increase in impersonation is obviously a bad sign ... and it's also a bad symptom of increased malicious activities," Gaffan says. These automated bots also can be used to scan websites for holes or to impersonate a Google bot, he says.

"Sixteen percent of all websites had some type of good impersonation going on," he says.

The key to combating unwanted impersonator bots is to benchmark legitimate ones, and to get the proper visibility into their presence and activity, he says. "You want to make sure you don't block some of the good bots. Blocking Google bots by mistake can be hazardous" to your SEO investment, for example, Gaffan says.

Have a comment on this story? Please click "Add Your Comment" below. If you'd like to contact Dark Reading's editors directly, send us a message. Kelly Jackson Higgins is Senior Editor at DarkReading.com. She is an award-winning veteran technology and business journalist with more than two decades of experience in reporting and editing for various publications, including Network Computing, Secure Enterprise Magazine, ... View Full Bio

Comment  | 
Print  | 
More Insights
Register for Dark Reading Newsletters
White Papers
Cartoon
Current Issue
Video
Slideshows
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2013-1421
Published: 2014-04-22
Cross-site scripting (XSS) vulnerability in Craig Knudsen WebCalendar before 1.2.5, 1.2.6, and other versions before 1.2.7 allows remote attackers to inject arbitrary web script or HTML via the Category Name field to category.php.

CVE-2013-2105
Published: 2014-04-22
The Show In Browser (show_in_browser) gem 0.0.3 for Ruby allows local users to inject arbitrary web script or HTML via a symlink attack on /tmp/browser.html.

CVE-2013-2187
Published: 2014-04-22
Cross-site scripting (XSS) vulnerability in Apache Archiva 1.2 through 1.2.2 and 1.3 before 1.3.8 allows remote attackers to inject arbitrary web script or HTML via unspecified parameters, related to the home page.

CVE-2013-4116
Published: 2014-04-22
lib/npm.js in Node Packaged Modules (npm) before 1.3.3 allows local users to overwrite arbitrary files via a symlink attack on temporary files with predictable names that are created when unpacking archives.

CVE-2013-4472
Published: 2014-04-22
The openTempFile function in goo/gfile.cc in Xpdf and Poppler 0.24.3 and earlier, when running on a system other than Unix, allows local users to overwrite arbitrary files via a symlink attack on temporary files with predictable names.

Best of the Web