Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Threat Intelligence

4/12/2018
02:00 PM
Martin McKeay
Martin McKeay
Commentary
50%
50%

The Good, the Bad & the Disruptive: Bots on the Wild, Wild Web

Not all bots are bad -- some are downright helpful -- so you can't block them entirely.

Botnets, with odd names like Mirai and Dorkbot, give bots a bad name. That being said, it's important to understand that just because something is called a bot doesn't mean it's bad. We use the term to refer to almost anything from the spider programs that search engines like Google use to make a searchable index of your site to the most malicious tools hackers use to steal data. The reality is that most tools we call bots are beneficial to the workings of your site and the Internet. Intent and usage make a huge difference, even for the most helpful bots.

IT and security teams must be prepared to manage bots with their eyes open. According to Akamai's Fourth Quarter, 2017 State of the Internet/Security Report, bot traffic accounts for more than 30% of all pure Web traffic (excluding video streaming). Web teams can't afford to ignore the impact that bots have on their systems, nor can they block bots entirely.

There are also some bots that absolutely, positively must be defended against. Credential abuse bots, those that check an email and password against your site login page, are responsible for 43% of all login attempts, according to the Akamai data. There are literally billions of fake login attempts happening every month. And if you're running a hotel or airline website, a significant majority (83%!) of all logins against your site are driven by malicious bots.

Background Radiation
Bots and botnets are all too easy to ignore for many organizations. They're part of constant noise that every site sees, something that quickly gets filtered out of our ability to care about. But that's part of what makes bot traffic so dangerous. Credential abuse attacks have been around since shortly after the first Telnet and Secure Shell servers were exposed to the Internet, and scanners looking for services will probably be some of the last systems to go offline decades from now.

The modern incarnation of account checkers and credential abuse bots have evolved significantly since those early days. Even a few years ago, one of the common ways to detect and protect against these tools was to use rate limits. If you saw dozens or hundreds of login attempts from a single host, you could block that host and move on. In response, bot developers have moved from single/few host models to using whole botnets to host their tools. They circumvent rate limits by using a few nodes of the botnet at a time against a single target, cycling through IP addresses so a single site only sees an IP once in a great while.

A few years ago, it might have taken half an hour for a system exposed to the Internet to see the first login attempts show up in the logs. In today's world, it's often just seconds after the system goes live that the first attacks happen. It's not because attackers are so great that they detect your systems when they first come online. Instead, it's because there's so much bot traffic — acting as a kind of background radiation bouncing around without a specific target — that any system is going to be hit by random attacks from the very start.

Solving the Problem
Organizations looking to solve this problem can look to the efforts in fraud prevention to solve the problem of distributed credential abuse by these botnets. For instance, credit card companies have to look across multiple organizations and look for out-of-the-ordinary behavior. It sounds easy when stated like this, but the reality is that it requires visibility into traffic at a global scale and can't be done by looking at the traffic of just one organization.

If you've ever received a call from your credit card company telling you that it put a hold on your account because it saw a charge coming from Ukraine just minutes after you purchased gas in Boston, you have an idea how this works. By themselves, neither the gas purchase nor the purchase from Eastern Europe are necessarily suspicious. But when intelligence from the two events is combined, a clear picture showing the impossibility of traveling from one location to the other is revealed.

Credential abuse bots can be detected in a similar manner. Traffic from an IP that hits your site once then moves on might not trigger any defenses, because a single event isn't enough to draw conclusions. But if you can combine information from multiple organizations and see a pattern of that IP hitting a series of sites, a clear pattern of abusive behavior can be determined. In turn, this allows for signaling to other organizations, letting them deny the attacking IP automatically.

Bad guys are getting smarter and distributing their attacks. In return, defenders have to maintain controls that rely on what similar organizations are seeing. An attack that looks like it's just part of the background radiation of the Internet takes on an entirely different meaning when you can draw patterns from shared information. Account takeover bots try to hide their activity in the noise of the bots that you want to have access to your site, which means you need to cut through the noise to find them.

Related Content:

Interop ITX 2018

Join Dark Reading LIVE for two cybersecurity summits at Interop ITX. Learn from the industry's most knowledgeable IT security experts. Check out the Interop ITX 2018 agenda here.

Martin McKeay is a Senior Security Advocate at Akamai, having joined the company in 2011. As a member of Akamai's Security Intelligence Team, he is responsible for researching security threats, customer education, and industry intelligence. With more than 15 years ... View Full Bio
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Where Businesses Waste Endpoint Security Budgets
Kelly Sheridan, Staff Editor, Dark Reading,  7/15/2019
US Mayors Commit to Just Saying No to Ransomware
Robert Lemos, Contributing Writer,  7/16/2019
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
Building and Managing an IT Security Operations Program
As cyber threats grow, many organizations are building security operations centers (SOCs) to improve their defenses. In this Tech Digest you will learn tips on how to get the most out of a SOC in your organization - and what to do if you can't afford to build one.
Flash Poll
The State of IT Operations and Cybersecurity Operations
The State of IT Operations and Cybersecurity Operations
Your enterprise's cyber risk may depend upon the relationship between the IT team and the security team. Heres some insight on what's working and what isn't in the data center.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2018-17210
PUBLISHED: 2019-07-20
An issue was discovered in PrinterOn Central Print Services (CPS) through 4.1.4. The core components that create and launch a print job do not perform complete verification of the session cookie that is supplied to them. As a result, an attacker with guest/pseudo-guest level permissions can bypass t...
CVE-2019-12934
PUBLISHED: 2019-07-20
An issue was discovered in the wp-code-highlightjs plugin through 0.6.2 for WordPress. wp-admin/options-general.php?page=wp-code-highlight-js allows CSRF, as demonstrated by an XSS payload in the hljs_additional_css parameter.
CVE-2019-9229
PUBLISHED: 2019-07-20
An issue was discovered on AudioCodes Mediant 500L-MSBR, 500-MBSR, M800B-MSBR and 800C-MSBR devices with firmware versions F7.20A to F7.20A.251. An internal interface exposed to the link-local address 169.254.254.253 allows attackers in the local network to access multiple quagga VTYs. Attackers can...
CVE-2019-12815
PUBLISHED: 2019-07-19
An arbitrary file copy vulnerability in mod_copy in ProFTPD up to 1.3.5b allows for remote code execution and information disclosure without authentication, a related issue to CVE-2015-3306.
CVE-2019-13569
PUBLISHED: 2019-07-19
A SQL injection vulnerability exists in the Icegram Email Subscribers & Newsletters plugin through 4.1.7 for WordPress. Successful exploitation of this vulnerability would allow a remote attacker to execute arbitrary SQL commands on the affected system.