02:05 PM
Dark Reading
Dark Reading
Products and Releases
Connect Directly

NSS Labs Asks, Are Current IPS Products Worth The Money?

Almost 50 percent of products proved to be overpriced once security effectiveness and tested

AUSTIN, Texas – October 4, 2012 - NSS Labs today released the final results and analysis from its 2012 Group Test for IPS, which evaluated 10 leading IPS vendors and 15 products. While testing shows that IPS is a competitive market with several vendors obtaining high marks for security effectiveness, it is apparent from this latest report that enterprise customers could end up paying hundreds of thousands of dollars more than they need to in larger deployments.

View the NSS Labs 2012 Security Value Map, Comparative Analysis and Product Analysis Reports.

Once Security Effectiveness and Performance are Factored In, the Actual Value of an IPS Can Change Dramatically

In order to capture the relative value of devices and facilitate comparisons, NSS Labs has developed unique metrics that enable enterprises to perform value-based comparisons and negotiate more favorable pricing.

· Almost 50% of products proved to be overpriced once security effectiveness & tested (vs. vendor claimed) performance were factored into pricing.

· 33% of products tested proved to be better value for the money being asked by the vendor, with tested performance far exceeding the vendor-rated specifications.

· Vendor throughput claims are often exaggerated, with over 50% testing below their claimed performance (from -9% to as much as -71%)

Management Console Licensing & Architectural Structure Lead to Huge Cost Differences

Management considerations should not be overlooked when making an IPS purchase as architecture and licensing structures can vary greatly by vendor, creating significant cost differences even for the same size deployment.

· For a 10 sensor deployment, first-year management costs ranged from $7k to $40k

· For a 100 sensor deployment, the range was $26k to $110k

· For a 250 sensor deployment, the range was even wider, varying from $31k to $300k

Vendors also vary greatly in licensing structures and the number of devices managed per license package. Therefore, understanding the number of devices needed and how a vendor's management architecture works is critical for customers.

Commentary: NSS Labs Chief Research Officer Bob Walder

"While our 2012 Security Value Map shows that IPS is definitely a mature market, a deeper dive into the Comparative Analysis Reports&trade shows that the market is not as commoditized as it might seem," said Bob Walder, Chief Research Officer at NSS Labs. "There is still significant differentiation - no two products deliver the same security effectiveness or throughput, and with management consoles there are some real pitfalls and traps of which companies need to beware in order to create an effective management infrastructure. Understanding and navigating the hidden costs and trade-offs relative to each IPS has become far more important than comparing speed versus protection in years past and creates more homework for the customer."

The 2012 IPS Security Value Map&trade, Comparative Analysis Reports&trade, and Product Analysis Reports&trade for each vendor are currently available to NSS Labs' subscribers at

The products covered in the 2012 SVM for IPS are:

· CheckPoint 12600

· Fortinet Fortigate 3240C

· HP TippingPoint 6100N

· IBM GX7800

· Juniper IDP 8200

· Juniper SRX 3600

· McAfee M8000

· McAfee XC Cluster

· Palo Alto PA-5020

· SonicWALL SuperMassive

· Sourcefire 3D8120

· Sourcefire 3D8250

· Sourcefire 3D8260

· Sourcefire Virtual IPS

· Stonesoft 1302

NSS Labs did not receive any compensation in return for vendor participation; All testing and research was conducted free of charge.

About NSS Labs, Inc.

NSS Labs, Inc. is the only completely independent research and analyst organization with world-class in-house testing capabilities. Through our subscription-based security intelligence services, we provide the information enterprises need to be secure. Founded in 1991, the company is located in Austin, Texas. For more information, visit

Comment  | 
Print  | 
More Insights
Register for Dark Reading Newsletters
White Papers
Flash Poll
Current Issue
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
Published: 2014-07-11
Dahua DVR 2.608.0000.0 and 2.608.GV00.0 allows remote attackers to bypass authentication and obtain sensitive information including user credentials, change user passwords, clear log files, and perform other actions via a request to TCP port 37777.

Published: 2014-07-11
Cumin (aka MRG Management Console), as used in Red Hat Enterprise MRG 2.5, does not include the HTTPOnly flag in a Set-Cookie header for the session cookie, which makes it easier for remote attackers to obtain potentially sensitive information via script access to this cookie.

Published: 2014-07-11
The REST API in the ovirt-engine in oVirt, as used in Red Hat Enterprise Virtualization (rhevm) 3.4, allows remote authenticated users to read arbitrary files and have other unspecified impact via unknown vectors, related to an XML External Entity (XXE) issue.

Published: 2014-07-11
Docker 1.0.0 uses world-readable and world-writable permissions on the management socket, which allows local users to gain privileges via unspecified vectors.

Published: 2014-07-11
Apache Syncope 1.1.x before 1.1.8 uses weak random values to generate passwords, which makes it easier for remote attackers to guess the password via a brute force attack.

Best of the Web
Dark Reading Radio
Archived Dark Reading Radio
Marilyn Cohodas and her guests look at the evolving nature of the relationship between CIO and CSO.