Cloud

3/24/2016
08:00 AM
Connect Directly
Google+
Twitter
RSS
E-Mail
50%
50%

Majority Of Bad Bots Behave Like Humans

And for the first time since 2013, humans outnumber bad bots on the Web -- but that doesn't mean humans are beating bots, new study shows.

Nearly all bad bot traffic on the Web imitates human user behavior in some way or attempts to evade detection, while humans now encompass more than 54 percent of all website traffic after being outnumbered by bots the past two years.

New 2015 bot data from Distil Networks, which draws from its Hadoop cluster that includes 74 billion bot requests and data culled from its customer base shows, that bad bot traffic decreased from 22.78% to 18.61% from 2014 to 2015, while good bot traffic dropped from 36.32% to 27.04% during that period, putting human user traffic on top. But the jump in human Web traffic likely has much to do with a rise in new Internet users in China, India, and Indonesia, the report says.

“Bots still have the upper hand,” says Rami Essaid, CEO of Distil. “What we’ve seen in the past year is bots are more sophisticated in their tactics and more focused: the bad guys are lot less likely to throw [bots] on the Web to a more focused approach of ‘we’re going to narrow down the attack to a specific aspect of a Web app.’”

Distil’s bad bot data doesn’t include bots used in distributed denial-of-service attacks: it focuses on bots used for fraud and other badness, such as web scraping, data-mining for competitive purposes, personal and financial data-stealing, brute-force login, man-in-the middle attacks, digital ad fraud, spam, and transaction fraud.

These “advanced persistent” bots, as Distil calls the latest generation of bots, are able to execute JavaScript, load cookies, manipulate a mouse, imitate keystrokes, and other human actions. he says. “Bots are a lot more intelligent than ever before,” and often are embedded in the browser and more difficult to spot, he says. “They look like a real person.”

Essaid says he was surprised these sophisticated bots are now the majority. “Sixty-three percent can load JavaScript, for example,” he says. “That’s big ... If the majority are running JavaScript, they are skewing all of the marketing numbers,” for example, he says.

Nearly 40% can perform human-like behaviors and tasks, and 73% use multiple IP addresses to evade detection. Some 20% of these bots use more than 100 IP addresses.

Bots indeed are a boon for bad guys. In addition to bots that spread banking Trojans and other malicious code, online ad fraud via bots is booming, according to a recent report by the Association of National Advertisers (ANA) and WhiteOps. The average brand suffered $10 million in damages in 2015, and bots are expected to cause some $7.2 billion in losses to advertisers this year, up from $5 billion in 2014. This brand of bots tricks advertisers with phony clicks that appear to be from human users.

Distil’s data shows that midsized websites are hit most with bad bots: 26% of all Web traffic on sites with an Alexa ranking of 10,001 to 50,000, came from bad bots. Real-estate websites overall suffered a 300% jump in bad bot traffic, and 31% of all web traffic on digital publishing sites comes from bad bot activity.

The US ranks as the number one nation with bad bots (40%), followed by India and Israel. Maldives has the highest bad bots per online user, 526, followed by Israel (168) and Kyrgyzstan (94).

“It’s where the end bot is coming from, but not necessarily who’s puppeteering the bot. In Maldives, there’s a giant ring of people running botnets out of there, but [there’s one] that also controls bots worldwide,” Essaid says. And US and Indian users are are popular bot targets due to their higher-speed Internet connections, for example.

Related Content:

 

Interop 2016 Las VegasFind out more about security threats at Interop 2016, May 2-6, at the Mandalay Bay Convention Center, Las Vegas. Register today and receive an early bird discount of $200.

Kelly Jackson Higgins is Executive Editor at DarkReading.com. She is an award-winning veteran technology and business journalist with more than two decades of experience in reporting and editing for various publications, including Network Computing, Secure Enterprise ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Joe Stanganelli
50%
50%
Joe Stanganelli,
User Rank: Ninja
3/28/2016 | 9:41:28 AM
Lilability issues
I remember reading some time back that Google had data (i.e., knew) that at least one third of its ad clickers were bots -- and that this presented potential grounds for a fraud suit against the company by its advertising customers.
Register for Dark Reading Newsletters
Dark Reading Live EVENTS
INsecurity - For the Defenders of Enterprise Security
A Dark Reading Conference
While red team conferences focus primarily on new vulnerabilities and security researchers, INsecurity puts security execution, protection, and operations center stage. The primary speakers will be CISOs and leaders in security defense; the blue team will be the focus.
White Papers
Video
Cartoon Contest
Write a Caption, Win a Starbucks Card! Click Here
Latest Comment: No, no, no! Have a Unix CRON do the pop-up reminders!
Current Issue
Security Vulnerabilities: The Next Wave
Just when you thought it was safe, researchers have unveiled a new round of IT security flaws. Is your enterprise ready?
Flash Poll
[Strategic Security Report] How Enterprises Are Attacking the IT Security Problem
[Strategic Security Report] How Enterprises Are Attacking the IT Security Problem
Enterprises are spending more of their IT budgets on cybersecurity technology. How do your organization's security plans and strategies compare to what others are doing? Here's an in-depth look.
Slideshows
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2017-0290
Published: 2017-05-09
NScript in mpengine in Microsoft Malware Protection Engine with Engine Version before 1.1.13704.0, as used in Windows Defender and other products, allows remote attackers to execute arbitrary code or cause a denial of service (type confusion and application crash) via crafted JavaScript code within ...

CVE-2016-10369
Published: 2017-05-08
unixsocket.c in lxterminal through 0.3.0 insecurely uses /tmp for a socket file, allowing a local user to cause a denial of service (preventing terminal launch), or possibly have other impact (bypassing terminal access control).

CVE-2016-8202
Published: 2017-05-08
A privilege escalation vulnerability in Brocade Fibre Channel SAN products running Brocade Fabric OS (FOS) releases earlier than v7.4.1d and v8.0.1b could allow an authenticated attacker to elevate the privileges of user accounts accessing the system via command line interface. With affected version...

CVE-2016-8209
Published: 2017-05-08
Improper checks for unusual or exceptional conditions in Brocade NetIron 05.8.00 and later releases up to and including 06.1.00, when the Management Module is continuously scanned on port 22, may allow attackers to cause a denial of service (crash and reload) of the management module.

CVE-2017-0890
Published: 2017-05-08
Nextcloud Server before 11.0.3 is vulnerable to an inadequate escaping leading to a XSS vulnerability in the search module. To be exploitable a user has to write or paste malicious content into the search dialogue.