Cloud

3/24/2016
08:00 AM
Connect Directly
Google+
Twitter
RSS
E-Mail
50%
50%

Majority Of Bad Bots Behave Like Humans

And for the first time since 2013, humans outnumber bad bots on the Web -- but that doesn't mean humans are beating bots, new study shows.

Nearly all bad bot traffic on the Web imitates human user behavior in some way or attempts to evade detection, while humans now encompass more than 54 percent of all website traffic after being outnumbered by bots the past two years.

New 2015 bot data from Distil Networks, which draws from its Hadoop cluster that includes 74 billion bot requests and data culled from its customer base shows, that bad bot traffic decreased from 22.78% to 18.61% from 2014 to 2015, while good bot traffic dropped from 36.32% to 27.04% during that period, putting human user traffic on top. But the jump in human Web traffic likely has much to do with a rise in new Internet users in China, India, and Indonesia, the report says.

“Bots still have the upper hand,” says Rami Essaid, CEO of Distil. “What we’ve seen in the past year is bots are more sophisticated in their tactics and more focused: the bad guys are lot less likely to throw [bots] on the Web to a more focused approach of ‘we’re going to narrow down the attack to a specific aspect of a Web app.’”

Distil’s bad bot data doesn’t include bots used in distributed denial-of-service attacks: it focuses on bots used for fraud and other badness, such as web scraping, data-mining for competitive purposes, personal and financial data-stealing, brute-force login, man-in-the middle attacks, digital ad fraud, spam, and transaction fraud.

These “advanced persistent” bots, as Distil calls the latest generation of bots, are able to execute JavaScript, load cookies, manipulate a mouse, imitate keystrokes, and other human actions. he says. “Bots are a lot more intelligent than ever before,” and often are embedded in the browser and more difficult to spot, he says. “They look like a real person.”

Essaid says he was surprised these sophisticated bots are now the majority. “Sixty-three percent can load JavaScript, for example,” he says. “That’s big ... If the majority are running JavaScript, they are skewing all of the marketing numbers,” for example, he says.

Nearly 40% can perform human-like behaviors and tasks, and 73% use multiple IP addresses to evade detection. Some 20% of these bots use more than 100 IP addresses.

Bots indeed are a boon for bad guys. In addition to bots that spread banking Trojans and other malicious code, online ad fraud via bots is booming, according to a recent report by the Association of National Advertisers (ANA) and WhiteOps. The average brand suffered $10 million in damages in 2015, and bots are expected to cause some $7.2 billion in losses to advertisers this year, up from $5 billion in 2014. This brand of bots tricks advertisers with phony clicks that appear to be from human users.

Distil’s data shows that midsized websites are hit most with bad bots: 26% of all Web traffic on sites with an Alexa ranking of 10,001 to 50,000, came from bad bots. Real-estate websites overall suffered a 300% jump in bad bot traffic, and 31% of all web traffic on digital publishing sites comes from bad bot activity.

The US ranks as the number one nation with bad bots (40%), followed by India and Israel. Maldives has the highest bad bots per online user, 526, followed by Israel (168) and Kyrgyzstan (94).

“It’s where the end bot is coming from, but not necessarily who’s puppeteering the bot. In Maldives, there’s a giant ring of people running botnets out of there, but [there’s one] that also controls bots worldwide,” Essaid says. And US and Indian users are are popular bot targets due to their higher-speed Internet connections, for example.

Related Content:

 

Interop 2016 Las VegasFind out more about security threats at Interop 2016, May 2-6, at the Mandalay Bay Convention Center, Las Vegas. Register today and receive an early bird discount of $200.

Kelly Jackson Higgins is Executive Editor at DarkReading.com. She is an award-winning veteran technology and business journalist with more than two decades of experience in reporting and editing for various publications, including Network Computing, Secure Enterprise ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Joe Stanganelli
50%
50%
Joe Stanganelli,
User Rank: Ninja
3/28/2016 | 9:41:28 AM
Lilability issues
I remember reading some time back that Google had data (i.e., knew) that at least one third of its ad clickers were bots -- and that this presented potential grounds for a fraud suit against the company by its advertising customers.
12 Free, Ready-to-Use Security Tools
Steve Zurier, Freelance Writer,  10/12/2018
Most IT Security Pros Want to Change Jobs
Dark Reading Staff 10/12/2018
6 Security Trends for 2018/2019
Curtis Franklin Jr., Senior Editor at Dark Reading,  10/15/2018
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
Flash Poll
The Risk Management Struggle
The Risk Management Struggle
The majority of organizations are struggling to implement a risk-based approach to security even though risk reduction has become the primary metric for measuring the effectiveness of enterprise security strategies. Read the report and get more details today!
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2018-10839
PUBLISHED: 2018-10-16
Qemu emulator <= 3.0.0 built with the NE2000 NIC emulation support is vulnerable to an integer overflow, which could lead to buffer overflow issue. It could occur when receiving packets over the network. A user inside guest could use this flaw to crash the Qemu process resulting in DoS.
CVE-2018-13399
PUBLISHED: 2018-10-16
The Microsoft Windows Installer for Atlassian Fisheye and Crucible before version 4.6.1 allows local attackers to escalate privileges because of weak permissions on the installation directory.
CVE-2018-18381
PUBLISHED: 2018-10-16
Z-BlogPHP 1.5.2.1935 (Zero) has a stored XSS Vulnerability in zb_system/function/c_system_admin.php via the Content-Type header during the uploading of image attachments.
CVE-2018-18382
PUBLISHED: 2018-10-16
Advanced HRM 1.6 allows Remote Code Execution via PHP code in a .php file to the user/update-user-avatar URI, which can be accessed through an "Update Profile" "Change Picture" (aka user/edit-profile) action.
CVE-2018-18374
PUBLISHED: 2018-10-16
XSS exists in the MetInfo 6.1.2 admin/index.php page via the anyid parameter.