Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Attacks/Breaches

9/9/2019
09:00 AM
By Nadav Maman, Co-Founder & Chief Technical Officer at Deep Instinct
By Nadav Maman, Co-Founder & Chief Technical Officer at Deep Instinct
Sponsored Article
50%
50%

Hackers & Artificial Intelligence: A Dynamic Duo

To best defend against an AI attack, security teams will need to adopt the mindset and techniques of a malicious actor.

The amplified efficiency of artificial intelligence (AI) means that once a system is trained and deployed, malicious AI can attack a far greater number of devices and networks more quickly and cheaply than a malevolent human actor. Given sufficient computing power, an AI system could launch many attacks, be more selective in its targets and more devastating in its impact. The potential mass destruction makes a nuclear explosion sound rather limited.

Currently the use of AI for attackers is mainly pursued at an academic level and we’re yet to see AI attacks in the wild. However, there’s a lot of talk in the industry about attackers using AI in their malicious efforts, and defenders using machine learning as a defense technology.

There are three types of attacks in which an attacker can use AI:

AI-based cyberattacks: The malware operates AI algorithms as an integral part of its business logic. This is where AI algorithms are used to detect anomalies and indicate irregular user and system activity patterns. The AI algorithm is trained to identify unusual patterns indicative of malicious activity that can be used to execute malware, increase or decrease evasion and stealth configurations and communication times. An example of this is DeepLocker, demonstrated by IBM security which encrypted ransomware to autonomously decide which computer to attack based on a face recognition algorithm.

AI facilitated cyberattacks: The malicious code and malware running on the victim’s machine does not include AI algorithms, but the AI is used elsewhere in the attacker’s environment. An example of this is Info-stealer malware which uploads a lot of personal information to the C&C server, which then runs an NLP algorithm to cluster and classify sensitive information as interesting (e.g. credit card numbers). Another example of this is spear fishing where an email is sent with a façade the looks legitimate by collecting and using information specifically relevant to the target. 

Adversarial attacks: The use of malicious AI algorithms to subvert the functionality of benign AI algorithms. This is done by using the algorithms and techniques that are built into a traditional machine learning algorithm and “breaking” it by reverse engineering the algorithm. Skylight Cyber recently demonstrated an example of this when they were able to trick Cylance’s AI based antivirus product into detecting a malicious file as benign.

The constructive AI versus malicious AI trend will continue to increase and spread across the opaque border that separates academic proof of concepts from actual full-scale attacks in the wild. This will happen incrementally as computing power (GPUs) and deep learning algorithms become more and more available to the wider public.

To best defend against an AI attack, you need to adopt the mindset and techniques of a malicious actor. Machine learning and deep learning experts need to be familiar with these techniques in order to build robust systems that will defend against them. 

For more examples of how each of the AI types of attack have been discovered, click here to read the full article.

About the Author

Nadav Maman, Co-Founder & Chief Technical Officer, Deep Instinct

Nadav Maman brings 15 years of experience in customer-driven business and technical leadership to his role as co-founder and chief technical officer at Deep Instinct. He has a proven track record in managing technical complex cyber projects, including design, executions and sales. He also has vast hands-on experience with data security, network design, and implementation of complex heterogeneous environments.

 

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Stop Defending Everything
Kevin Kurzawa, Senior Information Security Auditor,  2/12/2020
Small Business Security: 5 Tips on How and Where to Start
Mike Puglia, Chief Strategy Officer at Kaseya,  2/13/2020
5 Common Errors That Allow Attackers to Go Undetected
Matt Middleton-Leal, General Manager and Chief Security Strategist, Netwrix,  2/12/2020
Register for Dark Reading Newsletters
White Papers
Video
Cartoon
Current Issue
6 Emerging Cyber Threats That Enterprises Face in 2020
This Tech Digest gives an in-depth look at six emerging cyber threats that enterprises could face in 2020. Download your copy today!
Flash Poll
How Enterprises Are Developing and Maintaining Secure Applications
How Enterprises Are Developing and Maintaining Secure Applications
The concept of application security is well known, but application security testing and remediation processes remain unbalanced. Most organizations are confident in their approach to AppSec, although others seem to have no approach at all. Read this report to find out more.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2018-16994
PUBLISHED: 2020-02-18
An issue was discovered on PHOENIX CONTACT AXL F BK PN <=1.0.4, AXL F BK ETH <= 1.12, and AXL F BK ETH XC <= 1.11 devices. Incorrect handling of a request with non-standard symbols allows remote attackers to initiate a complete lock up of the bus coupler. Authentication of the request is no...
CVE-2020-7796
PUBLISHED: 2020-02-18
Zimbra Collaboration Suite (ZCS) before 8.8.15 Patch 7 allows SSRF when WebEx zimlet is installed and zimlet JSP is enabled.
CVE-2020-8633
PUBLISHED: 2020-02-18
An issue was discovered in Zimbra Collaboration Suite (ZCS) before 8.8.15 Patch 7. When grantors revoked a shared calendar in Outlook, the calendar stayed mounted and accessible.
CVE-2020-9268
PUBLISHED: 2020-02-18
SoPlanning 1.45 is vulnerable to SQL Injection in the OrderBy clause, as demonstrated by the projets.php?order=nom_createur&by= substring.
CVE-2020-9269
PUBLISHED: 2020-02-18
SOPlanning 1.45 is vulnerable to authenticated SQL Injection that leads to command execution via the users parameter, as demonstrated by export_ical.php.