Dark Reading is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them.Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Vulnerabilities / Threats

5/14/2013
11:21 AM
Vincent Liu
Vincent Liu
Commentary
Connect Directly
Twitter
LinkedIn
RSS
E-Mail
50%
50%

Know Your Pen Tester: The Novice

Beware of the tool-obsessed pen-tester

Part one in a series

Penetration testers put their pants on just like the rest of us, one leg at a time. Except once their pants are on, they break into computers. Not all pen testers, however, are created equal.

Whether you're hiring someone for your security team or you're engaging a consulting firm to conduct a third-party assessment, it's valuable to know how to gauge your pen tester's level of expertise. Don't get charged top dollar for second- or third-rate talent. When choosing any other professional, like a doctor or lawyer, you care more about the expertise and experience of the person doing the work than how many golf tournaments his company sponsors. You also probably don't want the lawyers with the most billboards (or any billboards for that matter). This is why pen tester selection is critical.

Novice Penetration Testers
Most pen testers -- roughly four out of every five -- fall into the novice category. A novice pen tester could be an entry-level security professional just learning the ropes or a more experienced person who simply lacks the skill or motivation to press beyond the simplest types of testing. In any case, novice pen testers tend to exhibit a handful of defining traits: tool-centric testing approach, an overreliance on checklists, and failure to perform proper manual testing.

Failure Of The Tool Jockey
Nobody wants to hire a pen tester who does little more than run a tool and rewrite a canned report. Yet a great deal of the "pen testing" that is sold to unknowing customers amounts to just that and little more. Novice, or proficient, penetration testers often use tools as an end instead of a means to an end. When a scan is done, so is the test.

These testers will often miss more sophisticated or complex vulnerabilities. This is because they don't yet know how to recognize them, they aren't aware that certain vulnerabilities even exist, or they don't know how to properly validate what they do find due to lack of experience or expertise. In addition to being able to use tools, a pen tester must also be able to interpret the tool results correctly.

Another indicator of skill level is how well a person can explain what he does find: the root cause of the vulnerability, the validation process, and the remediation recommendation. A novice can usually provide a canned response, but if you ask him to describe the issue in light of your specific situation or in a nonstandard circumstance, he will often struggle to provide a coherent response.

The greatest danger of the novice's tool-centric approach is the fact that his (and thus your) results will be skewed in light of the tool's own limitations. Many novice penetration testers fall into this trap where they depend entirely on the automated tool to provide them with a list of vulnerabilities.

If you're interviewing someone for a pen testing role on your team, a dead giveaway that they're a novice is if he mentions that he "really likes [insert name of tool]" or that he would "really like to learn how to use [insert name of tool]." That's like interviewing a carpenter to work on your construction team and hearing him say that he really likes hammers or that he wants to learn how to use a measuring tape.

More advanced pen testers know that tools are tools, and just a means to an end. Novices usually give themselves away by showing an undue reverence for tools. Vincent Liu (CISSP) is a Partner at Bishop Fox, a cyber security consulting firm providing services to the Fortune 500, global financial institutions, and high-tech startups. In this role, he oversees firm management, client matters, and strategy consulting. Vincent is a ... View Full Bio

Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
yankwizera
50%
50%
yankwizera,
User Rank: Apprentice
5/14/2013 | 5:26:46 PM
re: Know Your Pen Tester: The Novice
Insightful even for aspiring Pentesters!! Thank you
7 Tips for Infosec Pros Considering A Lateral Career Move
Kelly Sheridan, Staff Editor, Dark Reading,  1/21/2020
For Mismanaged SOCs, The Price Is Not Right
Kelly Sheridan, Staff Editor, Dark Reading,  1/22/2020
Register for Dark Reading Newsletters
White Papers
Video
Cartoon Contest
Write a Caption, Win a Starbucks Card! Click Here
Latest Comment:   It's a PEN test of our cloud security.
Current Issue
IT 2020: A Look Ahead
Are you ready for the critical changes that will occur in 2020? We've compiled editor insights from the best of our network (Dark Reading, Data Center Knowledge, InformationWeek, ITPro Today and Network Computing) to deliver to you a look at the trends, technologies, and threats that are emerging in the coming year. Download it today!
Flash Poll
How Enterprises are Attacking the Cybersecurity Problem
How Enterprises are Attacking the Cybersecurity Problem
Organizations have invested in a sweeping array of security technologies to address challenges associated with the growing number of cybersecurity attacks. However, the complexity involved in managing these technologies is emerging as a major problem. Read this report to find out what your peers biggest security challenges are and the technologies they are using to address them.
Twitter Feed
Dark Reading - Bug Report
Bug Report
Enterprise Vulnerabilities
From DHS/US-CERT's National Vulnerability Database
CVE-2020-5226
PUBLISHED: 2020-01-24
Cross-site scripting in SimpleSAMLphp before version 1.18.4. The www/erroreport.php script allows error reports to be submitted and sent to the system administrator. Starting with SimpleSAMLphp 1.18.0, a new SimpleSAML\Utils\EMail class was introduced to handle sending emails, implemented as a wrapp...
CVE-2019-1517
PUBLISHED: 2020-01-24
** REJECT ** DO NOT USE THIS CANDIDATE NUMBER. ConsultIDs: none. Reason: This candidate was in a CNA pool that was not assigned to any issues during 2019. Notes: none.
CVE-2019-1518
PUBLISHED: 2020-01-24
** REJECT ** DO NOT USE THIS CANDIDATE NUMBER. ConsultIDs: none. Reason: This candidate was in a CNA pool that was not assigned to any issues during 2019. Notes: none.
CVE-2019-1519
PUBLISHED: 2020-01-24
** REJECT ** DO NOT USE THIS CANDIDATE NUMBER. ConsultIDs: none. Reason: This candidate was in a CNA pool that was not assigned to any issues during 2019. Notes: none.
CVE-2019-1520
PUBLISHED: 2020-01-24
** REJECT ** DO NOT USE THIS CANDIDATE NUMBER. ConsultIDs: none. Reason: This candidate was in a CNA pool that was not assigned to any issues during 2019. Notes: none.