Vulnerabilities / Threats

4/18/2018
10:30 AM
John Moran
John Moran
Commentary
Connect Directly
LinkedIn
RSS
E-Mail vvv
100%
0%

The Role of KPIs in Incident Response

Using KPIs can have a positive impact on the tactical and strategic functions of a security operations program.

When chief marketing officers want to know if an expensive new campaign inspired people to buy their company's product, they look at the key performance indicators (KPIs) defined for the campaign. When chief information security officers want to know if the current mix of threat prevention and detection technologies are effective, they should see what their security operations program's KPIs are telling them.

KPIs typically are used to measure the success or failure of a business goal, function, or objective. They also provide actionable information that is helpful for decision-making. While KPIs are most commonly used in business categories such as sales, financial, project management, and marketing, they can be useful in security operations as well.

The measurement and analysis of well-considered KPIs can have a positive impact on both the tactical and strategic functions of a security operations program. KPIs help ensure that the program remains effective and that any process or technology gaps are addressed appropriately.

What a security program should measure to develop meaningful KPIs varies from one organization to another. Start by identifying which security operations goals or functions are most critical to the program. Each KPI should have meaning to the organization, add value to the security program, and be "SMART": Simple, Measurable, Actionable, Relevant, and Time-based.

Every successful security operations program has common components. Therefore, KPIs should be targeted at assessing at least some of the following:

Analyst skills: Utilizing KPIs to measure analysts' current skill sets and comparing them to the organization's present needs can identify gaps in training and personnel. Addressing gaps can improve the overall readiness of the security operations team.

Key risks: Organizations face myriad risks and have a limited budget to address them. Using KPIs to help identify which risks pose the greatest potential impact allows the security team to feed actionable information back into the overall risk assessment process, thus maximizing the effectiveness of limited time and financial resources.

Detection success: KPIs that measure the performance of prevention and detection technologies can identify gaps where additional or different technology may benefit the organization, as well as ways to tune existing technologies to increase efficiency.

Mitigation success: Once a security incident has been identified, organizations often use technology in the mitigation process. KPIs measuring the performance of mitigation technologies can identify gaps where the organization could benefit from additional and/or better-tuned technology.

Process success: Utilizing KPIs to measure the performance of a security program's processes and procedures can help ensure they remain optimized and as effective as possible against a range of security incidents.

Workload: Analysts who are overworked are more likely to take shortcuts or miss key indicators of security incidents. KPIs that measure analyst workload can identify staffing inefficiencies that could result in risk to the organization.

The security operations team can brainstorm which KPIs to track; there will be no shortage of suggestions. The key is choosing KPIs that will have a real, practical impact on the organization's security program. Here are a few examples that can inspire ideas to help an organization identify its own important KPIs.


All facets of business are measured with KPIs these days. Even security operations can benefit from deriving actionable information from KPIs and applying it to improve incident response programs.

Related Content:

Interop ITX 2018

Join Dark Reading LIVE for two cybersecurity summits at Interop ITX. Learn from the industry's most knowledgeable IT security experts. Check out the Interop ITX 2018 agenda here.

John Moran is a security operations and incident response expert. He has served as a senior incident response analyst for NTT Security, computer forensic analyst for the Maine State Police Computer Crimes Unit and computer forensics task force officer for the US Department of ... View Full Bio
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
twadenh
100%
0%
twadenh,
User Rank: Apprentice
4/19/2018 | 12:13:24 AM
Never really pondered the idea of KPI's for security teams...
Quick, interesting read that got right to the point, so thank you for that.  This was interesting. As you mentioned, I'm used to seeing KPI's for business goals in sales and marketing efforts, even call centers.  Hadn't really even given a chance into KPI's for security teams.  I think this would give our team a nice subject to brainstorm over in the coming weeks.  We'll have to see where we stand, where KPI's fit into our team and how they can strengthen our security posture and team structure.  Thanks for the straight-to-the-point article!
Google Engineering Lead on Lessons Learned From Chrome's HTTPS Push
Kelly Sheridan, Staff Editor, Dark Reading,  8/8/2018
White Hat to Black Hat: What Motivates the Switch to Cybercrime
Kelly Sheridan, Staff Editor, Dark Reading,  8/8/2018
PGA of America Struck By Ransomware
Dark Reading Staff 8/9/2018
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Write a Caption, Win a Starbucks Card! Click Here
Latest Comment: Now about that mortgage refinance offer from Wells Fargo .....
Current Issue
Flash Poll
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2018-2446
PUBLISHED: 2018-08-14
Admin tools in SAP BusinessObjects Business Intelligence, versions 4.1, 4.2, allow an unauthenticated user to read sensitive information (server name), hence leading to an information disclosure.
CVE-2018-2447
PUBLISHED: 2018-08-14
SAP BusinessObjects Business Intelligence (Launchpad Web Intelligence), version 4.2, allows an attacker to execute crafted InfoObject queries, exposing the CMS InfoObjects database.
CVE-2018-2448
PUBLISHED: 2018-08-14
Admin tools in SAP BusinessObjects Business Intelligence Platform, versions 4.1 and 4.2, allows an unauthenticated user to read sensitive information (server name), hence leading to an information disclosure.
CVE-2018-2449
PUBLISHED: 2018-08-14
SAP SRM MDM Catalog versions 3.73, 7.31, 7.32 in (SAP NetWeaver 7.3) - import functionality does not perform authentication checks for valid repository user. This is an unauthenticated functionality that you can use on windows machines to do SMB relaying.
CVE-2018-2450
PUBLISHED: 2018-08-14
SAP MaxDB (liveCache), versions 7.8 and 7.9, allows an attacker who gets DBM operator privileges to execute crafted database queries and therefore read, modify or delete sensitive data from database.