Steven Lipner, the partner director of program management for Microsoft's Trustworthy Computing, had once held the belief that the computer security could be solved in a provable way. After a decade of working on Microsoft security, Lipner is the first to admit his former naivet. Dark Reading caught up with Lipner before the coming RSA Conference and talked about the success of the SDL and its costs.
DR: In what ways has the SDL paid off for Microsoft and its code base? What sort of metrics does Microsoft look at to gauge success or failure?
Lipner: In terms of measuring success, we look at a couple things. One of them is customer confidence -- do people believe that we are in fact doing the right thing in developing software securely? And on that front, [a decade ago] Microsoft was not in the best position from a security perspective, whereas today we are in a much better position. So from that perspective, we view the initiative as successful.
Internally, we look at numbers, we look at metrics. We look at how many vulnerabilities, how many issues we have to fix. And that includes severity -- how much impact do the vulnerabilities have on customers? We also look at the exploitability index. We have the exploitability index out for more than 18 months, and we are looking at that to say, OK, if there are vulnerabilities out there and they are discovered, how hard is it to exploit them and do harm to our customers?
DR: Adobe's Brad Arkin has frequently said that driving up the cost for attackers to exploit Adobe software is a primary measure for the company. Is that important for Microsoft as well?
Lipner: It is not an exclusive focus, but it is something that we look at. For example, we have also looked at the exploitability index recently and have seen that Windows 7, the exploitability rights, are a lot lower than for older versions of Windows.
If we can drive the severity down, if we can drive the exploitability down, or if we can drive the number of vulnerabilities down, those are all things that we think are measures of success. We are not moving away from trying to drive the numbers of vulnerabilities down, but those other things are also measures of success in our mind.
DR: What has been the cost of implementing the SDL? Can this be seen as a ROI, or is it a pure cost of doing business?
Lipner: Back in the early days of TwC, because of the Windows security push, we shut down the Windows division and said, "We are not going to do anything but security." So it was possible for us to measure and know what that measure cost.
I worked with defense contractors, in my early days in the industry, and they measure what you are doing every 15 minutes or half hour, so it is possible to know costs precisely in that environment. In the commercial vendor environment, we know someone is working on Windows networking ... but we don't measure hours that precisely, so getting fine-grained cost numbers is not easy.
That said, the thing we know about the SDL is that it is affordable. We had it for almost eight years, and we are still doing it. So that says that it is something that is consistent with doing commercial software and the cost burden isn't unaffordable.
In terms of return, we talked about the metric driving the number of vulnerabilities down -- that is clearly a payoff. There have been studies that show that fixing a bug in development is much cheaper than fixing after the product ships. But there is a big return on investment in terms of customer confidence. (See one example with the banking industry.)
DR: Where does SDL go from here?
Lipner: We do an update every year ... generally on October 1. Internally, we are working on what we will call SDL version 6. That will be more secure better tools, easier for product groups to apply, taking advantages of the lessons learned, and doing what we can to make the software more secure.
Back when I started in this business, I thought we were going to build a secure system, prove it was secure mathematically, and we'd be done. But security doesn't work that way, so we continue to have to refine the process and make it more effective and easier to use. And we take what we have learned and make it available to customers and partners.
Have a comment on this story? Please click "Add Your Comment" below. If you'd like to contact Dark Reading's editors directly, send us a message.