Perimeter
9/30/2012
03:35 PM
Wendy Nather
Wendy Nather
Commentary
Connect Directly
RSS
E-Mail
50%
50%

The Plural Of Data Is Not Analytics

When it comes to security monitoring, searching and reporting aren’t always enough. The added value comes from analytics: turning data into information

One of the terms most recently in danger of becoming a buzzword has been "analytics." Put it together with the words "big" and "data," and it starts reaching critical mass. Everyone claims to be doing it; figuring out what's real is harder.

You can think of security analytics as information used to drive risk management or incident response decisions (that is, proactive or reactive security decisions). As such, the information is made security-relevant and useful by using data manipulation such as statistical analysis; comparisons against historical data, policies or other previously made decisions; correlation and connection-mapping with disparate data types; false-positive and false-negative identification; various methods of visualization; and other proprietary algorithms and techniques. The data that is manipulated in this fashion may range from events, states and alerts captured by security products, to the output of quantified risk modeling, social media data, directory listings, world news events, or any other searches that are deemed a part of the decision model.

Please note that this excludes the mechanisms of searches themselves, or formatting processes such as de-duping. The result of these searches is what undergoes further manipulation by the analysis process. There's a distinction between searching and/or reporting versus analytics.

Here are the kinds of decisions or statements you can infer using analytics: many of them involve a comparison against a timeline, a policy, or even a belief.

"This series of events should never have happened within this application."

"This user is providing input too quickly; we think this is automated."

"It's four in the morning in that country, not business hours. Why are we getting traffic from them?"

"It's physically impossible for this user to have logged in from two locations 500 miles away within the space of ten minutes. Something's going on."

"We're not going to put more money into this technology until we see security incidents that cost us at least 50% of our current budget." (I'm not pretending that this makes a lot of sense, but let's go with it.)

Before you can start with analytics, you need to start with a model. What questions do you want to answer, and how will you know when you've gotten an answer? What will you consider to be sufficient accuracy or precision in the answer (these are not the same thing)? From there, you can look at the data you have available, and see whether that data can address your requirements. You also need to think about how you will use that data to get to an answer, whether it's manual analysis, automated, or a combination of both. The industry is full of patent-holding mathematicians and data scientists who have come up with ways of automating analysis that had to be done by people before; this is especially important as the volume of available data goes up and the need for speed increases.

So when you're evaluating an "analytics" product, think about what questions it's assuming you have, and see how it answers them. Even more importantly, make sure it's flexible enough to be able to address new questions as they come along. When used right, analytics can help you make better security decisions.

Wendy Nather is Research Director of the Enterprise Security Practice at the independent analyst firm 451 Research. You can find her on Twitter as @451wendy. Wendy Nather is Research Director of the Enterprise Security Practice at independent analyst firm 451 Research. With over 30 years of IT experience, she has worked both in financial services and in the public sector, both in the US and in Europe. Wendy's coverage areas ... View Full Bio

Comment  | 
Print  | 
More Insights
Register for Dark Reading Newsletters
White Papers
Flash Poll
Current Issue
Cartoon
Video
Slideshows
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2014-0640
Published: 2014-08-20
EMC RSA Archer GRC Platform 5.x before 5.5 SP1 allows remote authenticated users to bypass intended restrictions on resource access via unspecified vectors.

CVE-2014-0641
Published: 2014-08-20
Cross-site request forgery (CSRF) vulnerability in EMC RSA Archer GRC Platform 5.x before 5.5 SP1 allows remote attackers to hijack the authentication of arbitrary users.

CVE-2014-2505
Published: 2014-08-20
EMC RSA Archer GRC Platform 5.x before 5.5 SP1 allows remote attackers to trigger the download of arbitrary code, and consequently change the product's functionality, via unspecified vectors.

CVE-2014-2511
Published: 2014-08-20
Multiple cross-site scripting (XSS) vulnerabilities in EMC Documentum WebTop before 6.7 SP1 P28 and 6.7 SP2 before P14 allow remote attackers to inject arbitrary web script or HTML via the (1) startat or (2) entryId parameter.

CVE-2014-2515
Published: 2014-08-20
EMC Documentum D2 3.1 before P24, 3.1SP1 before P02, 4.0 before P11, 4.1 before P16, and 4.2 before P05 does not properly restrict tickets provided by D2GetAdminTicketMethod and D2RefreshCacheMethod, which allows remote authenticated users to gain privileges via a request for a superuser ticket.

Best of the Web
Dark Reading Radio
Archived Dark Reading Radio
Three interviews on critical embedded systems and security, recorded at Black Hat 2014 in Las Vegas.