Steven Lipner, the partner director of program management for Microsoft's Trustworthy Computing, had once held the belief that the computer security could be solved in a provable way. After a decade of working on Microsoft security, Lipner is the first to admit his former naivet�. Dark Reading caught up with Lipner before the coming RSA Conference and talked about the success of the SDL and its costs.
DR: In what ways has the SDL paid off for Microsoft and its code base? What sort of metrics does Microsoft look at to gauge success or failure?
Lipner: In terms of measuring success, we look at a couple things. One of them is customer confidence -- do people believe that we are in fact doing the right thing in developing software securely? And on that front, [a decade ago] Microsoft was not in the best position from a security perspective, whereas today we are in a much better position. So from that perspective, we view the initiative as successful.
Internally, we look at numbers, we look at metrics. We look at how many vulnerabilities, how many issues we have to fix. And that includes severity -- how much impact do the vulnerabilities have on customers? We also look at the exploitability index. We have the exploitability index out for more than 18 months, and we are looking at that to say, OK, if there are vulnerabilities out there and they are discovered, how hard is it to exploit them and do harm to our customers?
DR: Adobe's Brad Arkin has frequently said that driving up the cost for attackers to exploit Adobe software is a primary measure for the company. Is that important for Microsoft as well?
Lipner: It is not an exclusive focus, but it is something that we look at. For example, we have also looked at the exploitability index recently and have seen that Windows 7, the exploitability rights, are a lot lower than for older versions of Windows.
If we can drive the severity down, if we can drive the exploitability down, or if we can drive the number of vulnerabilities down, those are all things that we think are measures of success. We are not moving away from trying to drive the numbers of vulnerabilities down, but those other things are also measures of success in our mind.
DR: What has been the cost of implementing the SDL? Can this be seen as a ROI, or is it a pure cost of doing business?
Lipner: Back in the early days of TwC, because of the Windows security push, we shut down the Windows division and said, "We are not going to do anything but security." So it was possible for us to measure and know what that measure cost.
I worked with defense contractors, in my early days in the industry, and they measure what you are doing every 15 minutes or half hour, so it is possible to know costs precisely in that environment. In the commercial vendor environment, we know someone is working on Windows networking ... but we don't measure hours that precisely, so getting fine-grained cost numbers is not easy.
That said, the thing we know about the SDL is that it is affordable. We had it for almost eight years, and we are still doing it. So that says that it is something that is consistent with doing commercial software and the cost burden isn't unaffordable.
In terms of return, we talked about the metric driving the number of vulnerabilities down -- that is clearly a payoff. There have been studies that show that fixing a bug in development is much cheaper than fixing after the product ships. But there is a big return on investment in terms of customer confidence. (See one example with the banking industry.)
DR: Where does SDL go from here?
Lipner: We do an update every year ... generally on October 1. Internally, we are working on what we will call SDL version 6. That will be more secure better tools, easier for product groups to apply, taking advantages of the lessons learned, and doing what we can to make the software more secure.
Back when I started in this business, I thought we were going to build a secure system, prove it was secure mathematically, and we'd be done. But security doesn't work that way, so we continue to have to refine the process and make it more effective and easier to use. And we take what we have learned and make it available to customers and partners.
Have a comment on this story? Please click "Add Your Comment" below. If you'd like to contact Dark Reading's editors directly, send us a message.
| To upload an avatar photo, first complete your Disqus profile. | View the list of supported HTML tags you can use to style comments. | Please read our commenting policy. |
Choosing the Right Vulnerability Scanner for Your Organization
Vulnerability scanners can be used to help detect and fix systemic problems in an organization's security program and monitor the effectiveness of security controls. However, a vulnerability scanner can improve the organization?s security posture only when it is used as part of a vulnerability management program, in which products, processes and people are working together to find, identify, prioritize and mitigate threats. Here are some tips on choosing and implementing vulnerability scanners in your enterprise.
Using Google to Find Vulnerabilities In Your IT Environment
Attackers are increasingly using a simple method for finding flaws in websites and applications: they Google them. Using Google code search, hackers can identify crucial vulnerabilities in application code strings, providing the entry point they need to break through application security. Sound scary? It is, but there is good news: You can use these same methods to find flaws before the bad guys do. In this special report, we outline methods for using search engines such as Google and Bing to identify vulnerabilities in your applications, systems and services--and to fix them before they can be exploited.
Security Pro's Guide to Patch Management
It's no longer sufficient to patch just Windows, Office and IE. With the massive array of applications now residing on enterprise PCs, and the proliferation of mobile and cloud-based applications, your business is far too vulnerable to exploitation unless you have a solid strategy for patch prioritization, deployment and quality assurance. Follow these steps to put your plan in place.
Other reports from the Vulnerability Management Tech Center:
MORE NEWSFEED >>>