Reviewed against OWASP and NIST primary sourcesLast reviewed 4 min read
Kort sagt
- The parts that automate are the parts that were volume rather than judgement.
- What remains is not a smaller version of the role but a differently weighted one.
- Verification becomes the load-bearing skill, because an unverified finding is a hypothesis.
- The genuine problem is the training path: juniors learned on exactly the tasks automating first.
- Accountability does not move, which is why a person still signs the report.
- For buyers this changes what a good report looks like, not how much testing they need.
| Beforeshare of engagement | Afterwhat is scarce | |
|---|---|---|
| Surface enumeration | Large | Automated |
| Running known techniques | Large | Automated |
| Chaining findings into paths | Rationed | Automated |
| Verifying a finding reproduces | Small | The bottleneck |
| Judging business impact | Small | The product |
| Deciding what not to touch | Implicit | Explicit, in scoping |
The left column describes where engagement hours went, which was a rationing outcome rather than a statement about where the value sat. The right column is what remains scarce once the rationing lifts.
What the shift is measured against
- 21.3 %
- of European intrusions began with vulnerability exploitation, the automatable part
- 60 %
- began with phishing, which no amount of automation reaches without scoping it in
Källa: ENISA Threat Landscape 2025
Källa: ENISA Threat Landscape 2025
What the role actually consisted of
Time studies are rare in this field, but the shape is not controversial among practitioners: a large share of engagement hours went to enumeration, running known techniques against a surface, and writing up findings. A smaller share went to the work people describe when asked what the job is, which is figuring out what matters and why.
That distribution is why automation reads as threatening. If most of the hours automate, it looks like most of the job does. But hours and value were never the same distribution, and the hours that automate are disproportionately the ones that were being rationed rather than chosen.
The clearer way to put it is that automation removes the constraint that forced testers to sample. What was scarce was attention, and attention is the input that just got cheaper.
| Activity | Direction | Why |
|---|---|---|
| Surface enumeration | Automates | A coverage problem, and fatigue is the human failure mode |
| Running known techniques | Automates | Deterministic and high volume |
| Chaining findings into paths | Automates | Combinatorial, which suits a machine |
| First-draft write-up | Automates | Structure is repetitive across engagements |
| Verifying a finding reproduces | Grows | Someone has to be accountable for the claim |
| Judging business impact | Grows | Requires context absent from the traffic |
| Scoping and safety boundaries | Grows | A live estate, decided in advance by a person |
| Explaining it to the people who must fix it | Grows | The output is a decision, not a document |
Verification is the skill that appreciates
When findings are cheap to generate, the scarce thing becomes the assurance that a finding is real. That is a different skill from producing it, and it is harder to fake.
OWASP names misinformation as LLM09:2025, which in this context describes a specific and common artefact: a finding that is fluent, plausibly evidenced, and wrong. Distinguishing those from real results requires someone who can reproduce the path by hand and recognise when the evidence is an artefact of the testing setup rather than the estate.
This is also where accountability sits. A report is read by people who will spend money because of it, and somewhere in the chain a person has to be answerable for the claim that the path exists. No amount of automation moves that, which is why the signature at the bottom of a report is not ceremonial.
Every finding is reproduced and verified by a Cryvanta operator before it reaches you. No unranked scanner output, no false-positive triage left on your desk.
The problem nobody has solved: how juniors get good
This is the part of the question worth taking seriously, and it gets the least attention because it is inconvenient for everyone.
Practitioners did not learn judgement in a course. They learned it by doing thousands of hours of enumeration and technique-running, developing intuition about what a surface looks like when something is wrong. Those hours are exactly what automates first, which removes the ladder while leaving the roof.
There is no established answer. Deliberate practice on automated output is one route: reviewing machine findings and being graded on which ones were wrong builds the same discrimination faster, if someone senior invests the time. What does not work is assuming judgement will appear in people who have only ever supervised, because supervision without ground truth is how confident wrong answers get approved.
For a buyer this is not an abstract concern. The quality of the verification you are paying for in five years depends on whether the providers you use today are training anyone.
| Builds judgement | Consumes it | |
|---|---|---|
| Juniors reproduce findings by hand | ✓ | ✕ |
| Machine output is reviewed and graded | ✓ | ✕ |
| Wrong findings are traced back to cause | ✓ | ✕ |
| Seniors spend time teaching | ✓ | ~ |
| Headcount falls with volume | ✕ | ✓ |
| Verification is a named step with an owner | ✓ | ✕ |
The right column is not a strawman. It is the efficient short-run configuration, which is why it is the default outcome unless someone decides otherwise.
What changes for a buyer
The amount of testing you need did not fall. If anything the opposite, since coverage that was previously unaffordable is now in reach and the estate has not become simpler.
What changes is what a good deliverable looks like. Volume of findings was always a weak quality signal and is now close to meaningless, because generating findings is the cheap part. The signals worth reading are whether findings reproduce, whether the impact judgement shows knowledge of your business, and whether the scope decision is written down with its reasoning.
Under NIS2 that alignment is convenient. Article 21 asks for policies to assess whether measures are effective, and an assessment made of reproducible cases is easier to stand behind in front of a supervisory authority than a long list nobody has confirmed.
The numbers around the question
- 21.3 %
- of European intrusions began with vulnerability exploitation
Källa: ENISA Threat Landscape 2025
Questions
Common questions
- Will AI replace penetration testers?
- No. It replaces parts of the work that were volume rather than judgement. What remains is weighted towards verification, impact assessment and scoping, which are the parts a person is accountable for.
- Which parts of the job automate first?
- Surface enumeration, running known techniques, chaining findings into paths, and the first draft of the write-up. All four are high volume and repetitive across engagements.
- What becomes more valuable?
- Verifying that a finding reproduces, judging what it means for a specific business, deciding what is unsafe to touch, and explaining it to the people who have to fix it.
- What is the real risk to the profession?
- The training path. Juniors built judgement on thousands of hours of exactly the tasks that automate first, and no established replacement for that apprenticeship exists yet.
- Should we buy less testing?
- No. Coverage that was previously unaffordable is now reachable and estates have not got simpler. What changes is that findings volume is a weak quality signal and reproducibility is a strong one.
Primärkällor
Källor
Varje regulatoriskt påstående på den här sidan går att spåra till en av källorna nedan. Ingen av dem är en konsultblogg.
- OWASP Top 10 for LLM Applications 2025— Misinformation as the verification hazard
- NIST AI Risk Management Framework— The govern function and accountability
- NIS2 Directive Article 21, EUR-Lex— Assessing whether measures are effective
- NIS2 Directive Article 34, EUR-Lex— The sanction ceilings behind the assessment
- ENISA Threat Landscape 2025— Why coverage requirements are not falling
Further reading
