Perimeter
9/30/2012
03:35 PM
Wendy Nather
Wendy Nather
Commentary
50%
50%

The Plural Of Data Is Not Analytics

When it comes to security monitoring, searching and reporting aren’t always enough. The added value comes from analytics: turning data into information

One of the terms most recently in danger of becoming a buzzword has been "analytics." Put it together with the words "big" and "data," and it starts reaching critical mass. Everyone claims to be doing it; figuring out what's real is harder.

You can think of security analytics as information used to drive risk management or incident response decisions (that is, proactive or reactive security decisions). As such, the information is made security-relevant and useful by using data manipulation such as statistical analysis; comparisons against historical data, policies or other previously made decisions; correlation and connection-mapping with disparate data types; false-positive and false-negative identification; various methods of visualization; and other proprietary algorithms and techniques. The data that is manipulated in this fashion may range from events, states and alerts captured by security products, to the output of quantified risk modeling, social media data, directory listings, world news events, or any other searches that are deemed a part of the decision model.

Please note that this excludes the mechanisms of searches themselves, or formatting processes such as de-duping. The result of these searches is what undergoes further manipulation by the analysis process. There's a distinction between searching and/or reporting versus analytics.

Here are the kinds of decisions or statements you can infer using analytics: many of them involve a comparison against a timeline, a policy, or even a belief.

"This series of events should never have happened within this application."

"This user is providing input too quickly; we think this is automated."

"It's four in the morning in that country, not business hours. Why are we getting traffic from them?"

"It's physically impossible for this user to have logged in from two locations 500 miles away within the space of ten minutes. Something's going on."

"We're not going to put more money into this technology until we see security incidents that cost us at least 50% of our current budget." (I'm not pretending that this makes a lot of sense, but let's go with it.)

Before you can start with analytics, you need to start with a model. What questions do you want to answer, and how will you know when you've gotten an answer? What will you consider to be sufficient accuracy or precision in the answer (these are not the same thing)? From there, you can look at the data you have available, and see whether that data can address your requirements. You also need to think about how you will use that data to get to an answer, whether it's manual analysis, automated, or a combination of both. The industry is full of patent-holding mathematicians and data scientists who have come up with ways of automating analysis that had to be done by people before; this is especially important as the volume of available data goes up and the need for speed increases.

So when you're evaluating an "analytics" product, think about what questions it's assuming you have, and see how it answers them. Even more importantly, make sure it's flexible enough to be able to address new questions as they come along. When used right, analytics can help you make better security decisions.

Wendy Nather is Research Director of the Enterprise Security Practice at the independent analyst firm 451 Research. You can find her on Twitter as @451wendy. Wendy Nather is Research Director of the Enterprise Security Practice at independent analyst firm 451 Research. With over 30 years of IT experience, she has worked both in financial services and in the public sector, both in the US and in Europe. Wendy's coverage areas ... View Full Bio

Comment  | 
Print  | 
More Insights
Register for Dark Reading Newsletters
White Papers
Cartoon
Current Issue
Dark Reading December Tech Digest
Experts weigh in on the pros and cons of end-user security training.
Flash Poll
Title Partner’s Role in Perimeter Security
Title Partner’s Role in Perimeter Security
Considering how prevalent third-party attacks are, we need to ask hard questions about how partners and suppliers are safeguarding systems and data.
Video
Slideshows
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2014-5426
Published: 2014-11-27
MatrikonOPC OPC Server for DNP3 1.2.3 and earlier allows remote attackers to cause a denial of service (unhandled exception and DNP3 process crash) via a crafted message.

CVE-2014-2037
Published: 2014-11-26
Openswan 2.6.40 allows remote attackers to cause a denial of service (NULL pointer dereference and IKE daemon restart) via IKEv2 packets that lack expected payloads. NOTE: this vulnerability exists because of an incomplete fix for CVE 2013-6466.

CVE-2014-6609
Published: 2014-11-26
The res_pjsip_pubsub module in Asterisk Open Source 12.x before 12.5.1 allows remote authenticated users to cause a denial of service (crash) via crafted headers in a SIP SUBSCRIBE request for an event package.

CVE-2014-6610
Published: 2014-11-26
Asterisk Open Source 11.x before 11.12.1 and 12.x before 12.5.1 and Certified Asterisk 11.6 before 11.6-cert6, when using the res_fax_spandsp module, allows remote authenticated users to cause a denial of service (crash) via an out of call message, which is not properly handled in the ReceiveFax dia...

CVE-2014-7141
Published: 2014-11-26
The pinger in Squid 3.x before 3.4.8 allows remote attackers to obtain sensitive information or cause a denial of service (out-of-bounds read and crash) via a crafted type in an (1) ICMP or (2) ICMP6 packet.

Best of the Web
Dark Reading Radio
Archived Dark Reading Radio
Now that the holiday season is about to begin both online and in stores, will this be yet another season of nonstop gifting to cybercriminals?