Threat Intelligence

4/12/2018
02:00 PM
Martin McKeay
Martin McKeay
Commentary
50%
50%

The Good, the Bad & the Disruptive: Bots on the Wild, Wild Web

Not all bots are bad -- some are downright helpful -- so you can't block them entirely.

Botnets, with odd names like Mirai and Dorkbot, give bots a bad name. That being said, it's important to understand that just because something is called a bot doesn't mean it's bad. We use the term to refer to almost anything from the spider programs that search engines like Google use to make a searchable index of your site to the most malicious tools hackers use to steal data. The reality is that most tools we call bots are beneficial to the workings of your site and the Internet. Intent and usage make a huge difference, even for the most helpful bots.

IT and security teams must be prepared to manage bots with their eyes open. According to Akamai's Fourth Quarter, 2017 State of the Internet/Security Report, bot traffic accounts for more than 30% of all pure Web traffic (excluding video streaming). Web teams can't afford to ignore the impact that bots have on their systems, nor can they block bots entirely.

There are also some bots that absolutely, positively must be defended against. Credential abuse bots, those that check an email and password against your site login page, are responsible for 43% of all login attempts, according to the Akamai data. There are literally billions of fake login attempts happening every month. And if you're running a hotel or airline website, a significant majority (83%!) of all logins against your site are driven by malicious bots.

Background Radiation
Bots and botnets are all too easy to ignore for many organizations. They're part of constant noise that every site sees, something that quickly gets filtered out of our ability to care about. But that's part of what makes bot traffic so dangerous. Credential abuse attacks have been around since shortly after the first Telnet and Secure Shell servers were exposed to the Internet, and scanners looking for services will probably be some of the last systems to go offline decades from now.

The modern incarnation of account checkers and credential abuse bots have evolved significantly since those early days. Even a few years ago, one of the common ways to detect and protect against these tools was to use rate limits. If you saw dozens or hundreds of login attempts from a single host, you could block that host and move on. In response, bot developers have moved from single/few host models to using whole botnets to host their tools. They circumvent rate limits by using a few nodes of the botnet at a time against a single target, cycling through IP addresses so a single site only sees an IP once in a great while.

A few years ago, it might have taken half an hour for a system exposed to the Internet to see the first login attempts show up in the logs. In today's world, it's often just seconds after the system goes live that the first attacks happen. It's not because attackers are so great that they detect your systems when they first come online. Instead, it's because there's so much bot traffic — acting as a kind of background radiation bouncing around without a specific target — that any system is going to be hit by random attacks from the very start.

Solving the Problem
Organizations looking to solve this problem can look to the efforts in fraud prevention to solve the problem of distributed credential abuse by these botnets. For instance, credit card companies have to look across multiple organizations and look for out-of-the-ordinary behavior. It sounds easy when stated like this, but the reality is that it requires visibility into traffic at a global scale and can't be done by looking at the traffic of just one organization.

If you've ever received a call from your credit card company telling you that it put a hold on your account because it saw a charge coming from Ukraine just minutes after you purchased gas in Boston, you have an idea how this works. By themselves, neither the gas purchase nor the purchase from Eastern Europe are necessarily suspicious. But when intelligence from the two events is combined, a clear picture showing the impossibility of traveling from one location to the other is revealed.

Credential abuse bots can be detected in a similar manner. Traffic from an IP that hits your site once then moves on might not trigger any defenses, because a single event isn't enough to draw conclusions. But if you can combine information from multiple organizations and see a pattern of that IP hitting a series of sites, a clear pattern of abusive behavior can be determined. In turn, this allows for signaling to other organizations, letting them deny the attacking IP automatically.

Bad guys are getting smarter and distributing their attacks. In return, defenders have to maintain controls that rely on what similar organizations are seeing. An attack that looks like it's just part of the background radiation of the Internet takes on an entirely different meaning when you can draw patterns from shared information. Account takeover bots try to hide their activity in the noise of the bots that you want to have access to your site, which means you need to cut through the noise to find them.

Related Content:

Interop ITX 2018

Join Dark Reading LIVE for two cybersecurity summits at Interop ITX. Learn from the industry's most knowledgeable IT security experts. Check out the Interop ITX 2018 agenda here.

Martin McKeay is a Senior Security Advocate at Akamai, having joined the company in 2011. As a member of Akamai's Security Intelligence Team, he is responsible for researching security threats, customer education, and industry intelligence. With more than 15 years ... View Full Bio
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
How the US Chooses Which Zero-Day Vulnerabilities to Stockpile
Ricardo Arroyo, Senior Technical Product Manager, Watchguard Technologies,  1/16/2019
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Current Issue
The Year in Security 2018
This Dark Reading Tech Digest explores the biggest news stories of 2018 that shaped the cybersecurity landscape.
Flash Poll
How Enterprises Are Attacking the Cybersecurity Problem
How Enterprises Are Attacking the Cybersecurity Problem
Data breach fears and the need to comply with regulations such as GDPR are two major drivers increased spending on security products and technologies. But other factors are contributing to the trend as well. Find out more about how enterprises are attacking the cybersecurity problem by reading our report today.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2019-3906
PUBLISHED: 2019-01-18
Premisys Identicard version 3.1.190 contains hardcoded credentials in the WCF service on port 9003. An authenticated remote attacker can use these credentials to access the badge system database and modify its contents.
CVE-2019-3907
PUBLISHED: 2019-01-18
Premisys Identicard version 3.1.190 stores user credentials and other sensitive information with a known weak encryption method (MD5 hash of a salt and password).
CVE-2019-3908
PUBLISHED: 2019-01-18
Premisys Identicard version 3.1.190 stores backup files as encrypted zip files. The password to the zip is hard-coded and unchangeable. An attacker with access to these backups can decrypt them and obtain sensitive data.
CVE-2019-3909
PUBLISHED: 2019-01-18
Premisys Identicard version 3.1.190 database uses default credentials. Users are unable to change the credentials without vendor intervention.
CVE-2019-3910
PUBLISHED: 2019-01-18
Crestron AM-100 before firmware version 1.6.0.2 contains an authentication bypass in the web interface's return.cgi script. Unauthenticated remote users can use the bypass to access some administrator functionality such as configuring update sources and rebooting the device.