Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Endpoint

8/6/2020
08:05 PM
Connect Directly
Twitter
LinkedIn
RSS
E-Mail
50%
50%

Researchers Create New Framework to Evaluate User Security Awareness

Approaches based on questionnaires and self-evaluation are not always a good indicator of how well a user can mitigate social engineering threats.

Researchers at Israel's Ben-Gurion University (BGU) have developed a framework for continuously evaluating the resilience of end users to phishing and similar social engineering attacks.

Unlike other security awareness evaluation techniques that rely heavily on questionnaires and the self-reported behavior of users, the new approach is based on actual data gathered from end user smartphones, PCs, network traffic to and from devices, and attack simulation.

In a presentation at the Black Hat USA event this week, Ron Bitton, principal research manager at BGU's cybersecurity research center, said the framework addresses some of the shortcomings of current approaches to evaluating user security awareness.

Often these approaches don't distinguish between different attack types or platforms, and are largely static in nature, he said. "Existing solutions have several limitations," Bitton noted. "For instance, questionnaires and surveys are based on the self-reported behavior of users. These methods tend to be very subjective and biased," he said.

Similarly, simulated attacks that are designed to measure how a user might respond to a social engineering scam tend to be affected by environmental factors. And forced participation in things like awareness-training workshops can often result in low user engagement.

In developing the new framework, the researchers first tried to understand all of the criteria required for a user to be truly security-aware, and then evaluated the importance of different criteria in mitigating different types of attacks.

To do the former, the researchers explored numerous social engineering case studies and identified the human vulnerabilities and technologies that adversaries tend to exploit in social engineering attacks, and the countermeasures than can be used to protect against such exploitation.

The exercise resulted in the researchers coming up with a list of 30 different criteria for a security-aware user. Examples of good security awareness include behavior such as: only downloading apps from trusted sources, not installing apps with dangerous permissions, using only HTTPS sites, avoiding sites flagged by the browser as being dangerous, updating passwords regularly, and not connecting unknown media - such as USB drives - to their computers.

Ranking and Evaluating

After identifying the criteria, the researchers developed a procedure for ranking the effectiveness of each user behavior in mitigating four different types of attacks: password attacks, application-based attacks, phishing, and man-in-the-middle attacks. They discovered that the actions required from a user to mitigate an attack are different for different classes of attacks.

In phishing attacks, for instance, a user could avoid sending sensitive information via HTTP and not insert private information on unvalidated websites. For MITM attacks, on the other hand, deleting unknown certificates from their device and not approving unknown digital certificates made the biggest difference.

After determining the criteria to measure and how to evaluate it, the BGU researchers developed two sensors for profiling user behavior. One was an endpoint agent that collected multiple sensor data from the device, including installed apps, app permissions, app source, ranking, mail activity, security settings, and social network activity.

The researchers also developed a less intrusive, network-based monitor that inspected traffic from and to the end-user device using various methods - including deep-packet inspection and assessment of app-level protocols. The sensors allowed the researchers to build detailed profiles of individual users in terms of their security awareness.

They also developed a simulated attack framework that implemented 20 different types of attacks, including permissions abuse and attacks involving malicious Word macros, PDF documents and phishing emails, and SMS messages. 

The researchers tested the framework on 162 users during a seven- to eight-week period. Each individual first was asked to provide a self-evaluation questionnaire as a baseline. Based on the score derived from the framework each user's security awareness was categorized either as low, medium, or high. The researchers then calculated the success rate each user achieved in mitigating various attacks directed at them via the attack simulation framework.

Users with high scores were substantially more likely to mitigate attacks than users with lower scores, Bitton said. On the other hand, user classifications based on the security questionnaire had little correlation to how likely, or not, a user was in mitigating attacks.

"The self-reported behavior of subjects may differ significantly from their actual behavior," Bitton said. "In contrast, security-awareness scores derived from objective measures such as data collected from endpoint and network-based solutions are highly correlated to user success in mitigating social engineering attacks," he said.

Related Content:

 

Jai Vijayan is a seasoned technology reporter with over 20 years of experience in IT trade journalism. He was most recently a Senior Editor at Computerworld, where he covered information security and data privacy issues for the publication. Over the course of his 20-year ... View Full Bio
 

Recommended Reading:

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Attackers Leave Stolen Credentials Searchable on Google
Kelly Sheridan, Staff Editor, Dark Reading,  1/21/2021
How to Better Secure Your Microsoft 365 Environment
Kelly Sheridan, Staff Editor, Dark Reading,  1/25/2021
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Write a Caption, Win an Amazon Gift Card! Click Here
Latest Comment: We need more votes, check the obituaries.
Current Issue
2020: The Year in Security
Download this Tech Digest for a look at the biggest security stories that - so far - have shaped a very strange and stressful year.
Flash Poll
Assessing Cybersecurity Risk in Today's Enterprises
Assessing Cybersecurity Risk in Today's Enterprises
COVID-19 has created a new IT paradigm in the enterprise -- and a new level of cybersecurity risk. This report offers a look at how enterprises are assessing and managing cyber-risk under the new normal.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2020-4889
PUBLISHED: 2021-01-26
IBM Spectrum Scale 5.0.0 through 5.0.5.4 and 5.1.0 could allow a local user to poison log files which could impact support and development efforts. IBM X-Force ID: 190971.
CVE-2020-4949
PUBLISHED: 2021-01-26
IBM WebSphere Application Server 7.0, 8.0, 8.5, and 9.0 is vulnerable to an XML External Entity Injection (XXE) attack when processing XML data. A remote attacker could exploit this vulnerability to expose sensitive information or consume memory resources. IBM X-Force ID: 192025.
CVE-2021-21275
PUBLISHED: 2021-01-25
The MediaWiki "Report" extension has a Cross-Site Request Forgery (CSRF) vulnerability. Before fixed version, there was no protection against CSRF checks on Special:Report, so requests to report a revision could be forged. The problem has been fixed in commit f828dc6 by making use of Medi...
CVE-2021-21272
PUBLISHED: 2021-01-25
ORAS is open source software which enables a way to push OCI Artifacts to OCI Conformant registries. ORAS is both a CLI for initial testing and a Go Module. In ORAS from version 0.4.0 and before version 0.9.0, there is a "zip-slip" vulnerability. The directory support feature allows the ...
CVE-2021-23901
PUBLISHED: 2021-01-25
An XML external entity (XXE) injection vulnerability was discovered in the Nutch DmozParser and is known to affect Nutch versions < 1.18. XML external entity injection (also known as XXE) is a web security vulnerability that allows an attacker to interfere with an application's processing of XML ...