Two different questions
Up to this point in the phase, the tools have all been chasing the same target: known weaknesses. A scanner fingerprints a service, matches its version against a database, and tells you that version of OpenSSH or Apache has a published vulnerability. That is genuinely useful — but it answers only half the question.
Here is the half it misses. Imagine a server that is perfectly patched: every package is current, every CVE feed comes back clean, the scanner produces a spotless report. That same server can still be wide open — not because of a missing patch, but because of how it was configured. The administrator account still uses the vendor's default password. The SSH daemon permits root login over the network. Every user runs with far more privilege than the job requires. The service negotiates weak, deprecated ciphers because nobody turned them off. None of that is a CVE. All of it is a way in.
What a CIS Benchmark is
The CIS Benchmarks are consensus-developed, prescriptive configuration guides published by the Center for Internet Security. They are not vague advice; each one is a long, specific checklist that says — setting by setting — how a particular technology should be configured to be defensible. There are benchmarks for operating systems (Windows, the major Linux distributions, macOS), cloud platforms (AWS, Azure, GCP), databases, web servers, browsers, container platforms, and more.
Each individual item in a benchmark follows the same disciplined shape, which is what makes them so usable: a precise recommendation ("disable SSH root login," "enforce a minimum password length and complexity policy," "turn off unused services and protocols"), the rationale explaining why it matters, an audit procedure telling you exactly how to check the current state, and a remediation procedure telling you exactly how to fix it. A single benchmark routinely runs to hundreds of these checks.
Benchmarks also recognize that one size does not fit all, so most define two profile levels:
- Level 1 — sensible, low-friction hardening that a typical organization can apply broadly without breaking normal functionality. This is the practical baseline almost everyone should meet.
- Level 2 — defense-in-depth aimed at high-security environments. It clamps down much harder and may sacrifice some convenience or functionality in exchange for a smaller attack surface.
Benchmarks are not the Controls
This is the single most common point of confusion, so it is worth nailing down. The Center for Internet Security publishes two well-known things with similar names, and they operate at completely different altitudes.
- The CIS Critical Security Controls are a prioritized set of 18 broad safeguards for an organization's entire security program — things like "maintain an inventory of assets," "manage access control," "run continuous vulnerability management." They tell you what an organization should be doing at a strategic level. They are device-agnostic and program-wide.
- The CIS Benchmarks are device- and software-specific configuration checklists. They tell you how to set up one particular technology — this Linux distribution, that database, this cloud service — setting by setting.
They are related — hardening a host to its benchmark is one concrete way to satisfy the vulnerability-management and secure-configuration Controls — but the scope is what separates them: Controls govern the program, Benchmarks govern the box.
One more standard belongs in the same mental bucket. The U.S. Department of Defense maintains its own hardening standard, the DISA STIGs (Security Technical Implementation Guides). A STIG is the DoD's equivalent of a configuration benchmark — the same idea of a prescriptive, item-by-item hardening checklist, but issued and mandated by the Defense Information Systems Agency for systems operating in or connected to DoD environments. If you work anywhere near government systems, the STIG is the yardstick you will be measured against.
Auditing against a baseline
A 500-item checklist is useless if a human has to walk it by hand on every host. The good news is that the same vulnerability scanners you have already met can run a benchmark for you. Tools like Nessus and OpenVAS / Greenbone ship compliance and audit policies that encode the CIS Benchmarks (and STIGs) as machine-readable checks.
The key difference from an ordinary scan is that a compliance audit must run credentialed. Checking a host's configuration is not something you can do politely from the outside — the scanner needs to log in (or use an agent) so it can read the actual sshd_config, query the real password policy, and inspect which services are running. Given those credentials, it walks the entire benchmark and produces a pass / fail report on every single setting, turning a 500-line checklist into an automated audit that finishes in minutes and can be re-run on a schedule.
Where the three standards we have discussed sit relative to one another:
| Standard | Scope | Target | Example item |
|---|---|---|---|
| CIS Benchmarks | Per device / software | A specific OS, database, cloud service, browser, or container platform | "Ensure SSH PermitRootLogin is set to no." |
| CIS Controls | Whole organization | The overall security program — 18 prioritized safeguards | "Establish and maintain a secure configuration process for all assets." |
| DISA STIG | Per device / software | Systems in or connected to U.S. DoD environments | "The operating system must disable account identifiers after 35 days of inactivity." |
Read the table left to right and the distinction sharpens: the Benchmarks and the STIG share a row-level scope — one device, many specific settings — while the Controls live a level up, governing the program that decides those hosts should be hardened at all.
Why a tester cares
Configuration auditing can sound like a defender's chore — tidy housekeeping that has nothing to do with breaking in. It is exactly the opposite. A host that fails its benchmark is a host full of the low-hanging fruit attackers love most. Every failed check is a concrete weakness you can usually exploit faster, and more reliably, than a freshly published CVE.
Walk down a typical failed report and you are reading a foothold list. Default credentials left in place hand you an account without an exploit at all. Over-privileged accounts and excessive permissions turn an ordinary user into a path straight to administrator. Legacy protocols and weak ciphers that nobody disabled let you intercept, downgrade, or relay traffic. Network root login and exposed management services give you a door that should never have existed. Benchmark gaps map almost one-to-one onto the footholds and privilege-escalation paths you will chase in the phases ahead.
The same picture explains the defender's behavior. They harden to the benchmark precisely to shrink the attack surface before a scan ever runs — closing the default-credential, weak-cipher, over-privilege gaps so that when a tester (or a real adversary) arrives, the easy wins are already gone and only the harder, noisier paths remain.
That is the bridge out of this phase. Vulnerability analysis — scanning, validating findings, and now measuring configuration against a baseline — has given you a ranked inventory of weaknesses, both the named CVEs and the quiet misconfigurations. The next phase stops cataloging weaknesses and starts using them: taking a foothold a failed benchmark just handed you and turning it into access. That is exploitation.