03:35 PM
Wendy Nather
Wendy Nather

The Plural Of Data Is Not Analytics

When it comes to security monitoring, searching and reporting aren’t always enough. The added value comes from analytics: turning data into information

One of the terms most recently in danger of becoming a buzzword has been "analytics." Put it together with the words "big" and "data," and it starts reaching critical mass. Everyone claims to be doing it; figuring out what's real is harder.

You can think of security analytics as information used to drive risk management or incident response decisions (that is, proactive or reactive security decisions). As such, the information is made security-relevant and useful by using data manipulation such as statistical analysis; comparisons against historical data, policies or other previously made decisions; correlation and connection-mapping with disparate data types; false-positive and false-negative identification; various methods of visualization; and other proprietary algorithms and techniques. The data that is manipulated in this fashion may range from events, states and alerts captured by security products, to the output of quantified risk modeling, social media data, directory listings, world news events, or any other searches that are deemed a part of the decision model.

Please note that this excludes the mechanisms of searches themselves, or formatting processes such as de-duping. The result of these searches is what undergoes further manipulation by the analysis process. There's a distinction between searching and/or reporting versus analytics.

Here are the kinds of decisions or statements you can infer using analytics: many of them involve a comparison against a timeline, a policy, or even a belief.

"This series of events should never have happened within this application."

"This user is providing input too quickly; we think this is automated."

"It's four in the morning in that country, not business hours. Why are we getting traffic from them?"

"It's physically impossible for this user to have logged in from two locations 500 miles away within the space of ten minutes. Something's going on."

"We're not going to put more money into this technology until we see security incidents that cost us at least 50% of our current budget." (I'm not pretending that this makes a lot of sense, but let's go with it.)

Before you can start with analytics, you need to start with a model. What questions do you want to answer, and how will you know when you've gotten an answer? What will you consider to be sufficient accuracy or precision in the answer (these are not the same thing)? From there, you can look at the data you have available, and see whether that data can address your requirements. You also need to think about how you will use that data to get to an answer, whether it's manual analysis, automated, or a combination of both. The industry is full of patent-holding mathematicians and data scientists who have come up with ways of automating analysis that had to be done by people before; this is especially important as the volume of available data goes up and the need for speed increases.

So when you're evaluating an "analytics" product, think about what questions it's assuming you have, and see how it answers them. Even more importantly, make sure it's flexible enough to be able to address new questions as they come along. When used right, analytics can help you make better security decisions.

Wendy Nather is Research Director of the Enterprise Security Practice at the independent analyst firm 451 Research. You can find her on Twitter as @451wendy. Wendy Nather is Research Director of the Enterprise Security Practice at independent analyst firm 451 Research. With over 30 years of IT experience, she has worked both in financial services and in the public sector, both in the US and in Europe. Wendy's coverage areas ... View Full Bio

Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
Register for Dark Reading Newsletters
White Papers
Current Issue
Five Emerging Security Threats - And What You Can Learn From Them
At Black Hat USA, researchers unveiled some nasty vulnerabilities. Is your organization ready?
Flash Poll
Title Partners Role in Perimeter Security
Title Partners Role in Perimeter Security
Considering how prevalent third-party attacks are, we need to ask hard questions about how partners and suppliers are safeguarding systems and data.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
Published: 2015-10-15
The Direct Rendering Manager (DRM) subsystem in the Linux kernel through 4.x mishandles requests for Graphics Execution Manager (GEM) objects, which allows context-dependent attackers to cause a denial of service (memory consumption) via an application that processes graphics data, as demonstrated b...

Published: 2015-10-15
netstat in IBM AIX 5.3, 6.1, and 7.1 and VIOS 2.2.x, when a fibre channel adapter is used, allows local users to gain privileges via unspecified vectors.

Published: 2015-10-15
Cross-site request forgery (CSRF) vulnerability in eXtplorer before 2.1.8 allows remote attackers to hijack the authentication of arbitrary users for requests that execute PHP code.

Published: 2015-10-15
Directory traversal vulnerability in QNAP QTS before 4.1.4 build 0910 and 4.2.x before 4.2.0 RC2 build 0910, when AFP is enabled, allows remote attackers to read or write to arbitrary files by leveraging access to an OS X (1) user or (2) guest account.

Published: 2015-10-15
Cisco Application Policy Infrastructure Controller (APIC) 1.1j allows local users to gain privileges via vectors involving addition of an SSH key, aka Bug ID CSCuw46076.

Dark Reading Radio
Archived Dark Reading Radio
According to industry estimates, about a million new IT security jobs will be created in the next two years but there aren't enough skilled professionals to fill them. On top of that, there isn't necessarily a clear path to a career in security. Dark Reading Executive Editor Kelly Jackson Higgins hosts guests Carson Sweet, co-founder and CTO of CloudPassage, which published a shocking study of the security gap in top US undergrad computer science programs, and Rodney Petersen, head of NIST's new National Initiative for Cybersecurity Education.