04:07 AM


Today's security credentials aren't a great measure of what someone knows and don't embrace specialization

Where do good security people come from? In my book Software Security, I hype up the idea that they come from all sorts of widely divergent backgrounds:

    We are experiencing a time of great creativity in computer security and must seize the opportunity presented by our current situation while we can. The diversity of backgrounds represented by today’s security practitioners may be a high-water mark. Consider that today’s security thought leaders were trained in fields as diverse as biostatistics, divinity, economics, and cognitive science, and thus bring with them interesting new perspectives on the security challenge.

So that's good, right? But it also leaves plenty of room for hacks and hucksters. In fact, I think it is clear that there remains far too much room in our field for snake oil, scare tactics, and plain old bull feathers. There may be some light at the end of the long dark tunnel now that a number of professional certifications are available, but not all certifications are good.

CISSP: Shysters or Knowledgeable Practitioners?
Because the field is young, it can be difficult for inhabitants of Wild West outposts to distinguish purveyors of snake oil from experienced brain surgeons. To combat this difficulty, the idea of certifying practitioners has been adopted. The by-now widespread CISSP certification is one great example. A CISSP certification is an indicator that someone has mastered a common body of practical security knowledge and at least has a pulse. Tests are used to separate those who deserve a CISSP (that is, those who passed the test) from the unwashed masses. Education and certification companies make money both selling test preparation training and administering the test.

To harken back to our doctor analogy for a moment, the problem with the CISSP scheme is that certification doesn’t do much to address the problem of discriminating self-taught homeopaths from doctors or surgeons. In fact, most security surgeons I know scoff at the CISSP certification as not at all useful and a waste of their very precious time. These specialists instead rely on well established academic credentials such as computer science degrees of various levels with a specialty in security from a well-respected academic institution (think Princeton or Purdue).

Because academia can't produce enough surgeons to satisfy all security demands (and indeed because entire armies of less specialized "healthcare professionals" are necessary), the idea of a certification makes plenty of practical sense.

This creates a multi-tiered system of the same sort usually found among professionals, academics, and scientists, where workaday practitioners differ from specialists and have different credentials. In real life, sometimes you need a specialist, and sometimes you don't.

Some kind of balance seems to have been struck in network security, with academics and practitioners both seeking and finding the kinds of credentials that they need. As the field grows up, more standard academic credentials are very likely to replace certifications such as the CISSP (at least for some classes of workers). But because network security is mostly about network operations, things seem to be working just fine.

What's on Your Belly?
When it comes to software security, things are in much worse shape. The problem is that there is no credentialing system for software engineers. In fact, almost anyone can write software today (and many do, including my 12 year old son). Academics are doing what they can to create a class of software professionals, but the going is slow and much work remains to be done. Software security is only the most remote afterthought. What we need is some kind of academic credentialing system for software engineers (which will hopefully include decent coverage of software security touchpoints such as code review and architectural risk analysis).

Into this very obvious vacuum comes a proposed credentialing system for software developers envisioned by SANS (who created a GIAC certification system that competes with the CISSP system but that in many ways is much more detailed). The GSSP (GIAC Secure Software Programmer) is a certification system that purports to tell a developer who can write secure software from one who can't.

I am reminded of one Sylvester McMonkey McBean, the key protagonist of Dr. Seuss's Sneetches story. Just to remind you, here is a snippet from that story:

    Now, the Star-Belly Sneetches
    Had bellies with stars.
    The Plain-Belly Sneetches
    Had none upon thars.

In the story, McBean devised a system for selling stars to the poor discriminated-against Plain-Belly Sneetches. Many such Sneetches rushed to the opportunity to become credentialed. Of course the original Star-Bellies were incensed and the very clever McBean had an answer for that: star removal. Chaos ensued, Sneetches cycled, and McBean got rich.

The analogy between Sneetches and developers with security stars breaks down pretty quickly, but what makes it salient for me is McBean. As far as I can tell from a careful study of the guideline documents produced by SANS, the only thing you can tell about a developer with a GSSP is that they once had $400 to pay for the test.

The multiple choice test itself is one of the problems. I have discussed the idea of using multiple choice to discriminate knowledgeable developers from clueless developers (like the SANS test does) with many professors of computer science. Not one of them thought it was possible.

Some hold out hope that making developers think at all about security will be one of the side effects of the certification idea. I hope they are right, but I remain skeptical. Of course anything that serves to raise awareness of the software security issue is probably good for us, so let the fun and games begin!

Ultimately, the real problem is that in order to be a good software security developer, you need to be a good developer first. There are no tests for that. I wish there were.

Credentials and Other Metrics
Hopefully, this notion of measuring people and capability will be one of the topics of discussion at this year's MetriCon conference. Even if the people question does not come up, I am sure that many other interesting security metrics questions will. I plan to write more on that in a future column, but while you are waiting, please rush out and buy a copy of Andrew Jaquith's great book, Security Metrics: Replacing Fear Uncertainty and Doubt.

Gary McGraw is CTO of Cigital Inc. Special to Dark Reading

Comment  | 
Print  | 
More Insights
Newest First  |  Oldest First  |  Threaded View
Register for Dark Reading Newsletters
White Papers
Current Issue
5 Security Technologies to Watch in 2017
Emerging tools and services promise to make a difference this year. Are they on your company's list?
Flash Poll
New Best Practices for Secure App Development
New Best Practices for Secure App Development
The transition from DevOps to SecDevOps is combining with the move toward cloud computing to create new challenges - and new opportunities - for the information security team. Download this report, to learn about the new best practices for secure application development.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
Published: 2015-10-15
The Direct Rendering Manager (DRM) subsystem in the Linux kernel through 4.x mishandles requests for Graphics Execution Manager (GEM) objects, which allows context-dependent attackers to cause a denial of service (memory consumption) via an application that processes graphics data, as demonstrated b...

Published: 2015-10-15
netstat in IBM AIX 5.3, 6.1, and 7.1 and VIOS 2.2.x, when a fibre channel adapter is used, allows local users to gain privileges via unspecified vectors.

Published: 2015-10-15
Cross-site request forgery (CSRF) vulnerability in eXtplorer before 2.1.8 allows remote attackers to hijack the authentication of arbitrary users for requests that execute PHP code.

Published: 2015-10-15
Directory traversal vulnerability in QNAP QTS before 4.1.4 build 0910 and 4.2.x before 4.2.0 RC2 build 0910, when AFP is enabled, allows remote attackers to read or write to arbitrary files by leveraging access to an OS X (1) user or (2) guest account.

Published: 2015-10-15
Cisco Application Policy Infrastructure Controller (APIC) 1.1j allows local users to gain privileges via vectors involving addition of an SSH key, aka Bug ID CSCuw46076.

Dark Reading Radio
Archived Dark Reading Radio
In past years, security researchers have discovered ways to hack cars, medical devices, automated teller machines, and many other targets. Dark Reading Executive Editor Kelly Jackson Higgins hosts researcher Samy Kamkar and Levi Gundert, vice president of threat intelligence at Recorded Future, to discuss some of 2016's most unusual and creative hacks by white hats, and what these new vulnerabilities might mean for the coming year.