[ Business value ]

Evaluate an authentication platform using real sender scenarios

Evaluate one platform against a reproducible sender scenario pack rather than a sales demonstration.

By the EmailAuth research team · 3 min read

[ Key points ]

  • Own the decision
  • Preserve reproducibility
  • Control authority and uncertainty
On this page

Source review dated 8 November 2026. This is documentary guidance; account, DNS and received-message acceptance tests below have not been executed.

Choose representative scenarios

Start with the mail your organization must preserve. Include an aligned direct sender, an authenticated but unaligned service, a forwarding path, an unknown source on shared infrastructure and a missing-evidence case. Define what a reviewer should learn from each scenario before showing it to a supplier. Use fictional or appropriately redacted material and keep every candidate on the same evidence version.

A platform evaluation should distinguish protocol interpretation, investigation workflow, evidence export and operational responsibility. A polished dashboard may parse a report correctly while leaving ownership unresolved. Another system may make uncertainty visible but need more operator time. Preserve both observations rather than reducing them to one unexplained score.

Require evidence at each decision

For each scenario, specify the raw input, expected interpretation, acceptable uncertainty, operator action and artifact required to prove completion. For an unaligned service, a useful answer identifies the authenticated domain, visible From domain and missing alignment. It should not declare the service malicious solely because those identities differ. For shared infrastructure, require a confidence label and a verification request to an accountable owner.

The checkpoint's scenario pack supplies explicit expected outcomes and an observed local evaluator result. The evaluator checks only exact-domain identity comparisons and bounded classification rules. It does not parse raw DMARC reports, validate DNS, verify signatures or exercise any commercial platform. The pack is a reproducible starting point for a controlled evaluation, not a benchmark result.

Use acceptance gates before weighting preferences

Treat preservation of raw evidence, correct handling of unknowns and reliable export as gates if they are essential to your operations. Then compare operator effort and usability using recorded tasks and consistent starting conditions. Record interventions by the vendor or test operator because those interventions change what the demonstration proves. Do not substitute unverified product promises for observed outcomes.

No competitor ranking or product-specific assertion is supplied. Use current documentation and authorized tenant tests before drawing a purchasing conclusion. A shared scenario method supports consistent evaluation, but does not substitute for evidence about the particular implementation you are considering.

Completed scenario and effort matrix

The fictional matrix pairs each case with a required classification and retained normalized input. Direct mail requires aligned_exact_domain and an assumed ten operator minutes. An authenticated unaligned service requires unaligned_exact_domain and twenty minutes. Forwarded mail with stipulated surviving aligned DKIM requires aligned_exact_domain and twenty-five minutes. Shared infrastructure without a stipulated aligned authentication path requires unaligned_exact_domain, but its business legitimacy remains unknown; allow thirty minutes for investigation. Missing received evidence requires unknown and fifteen minutes.

These five estimates total one hundred minutes. Observed operator time is deliberately null because no human or commercial workflow was timed. The evaluation mail administrator operates each case, the evaluation owner approves conclusions, and every case requires export of the input, result and unresolved action before exit. The supplied local matrix checks classification only. Owner confirmation, current product capability and live sending evidence remain separate evaluation requirements rather than automatically passed cells.

Reproduce and extend the evidence

From evidence/fixtures/batch0662_v2/ in this review package, run python fixtures.py. Read evidence/fixture_results.json alongside evidence/inputs.json and retain the script and input hashes with any rerun. The script uses only Python standard-library components and performs no external sending, account access or production configuration changes. Its assertions check the stated fictional cases and negative controls. A passing local assertion is evidence of this bounded test, not proof of a provider capability. Before using the method for a live decision, replace invented inputs with authorized observations, preserve the original version and record any deviations from the method.

For the revised matrix, scoped controls and decision ledgers, also run python revision_fixtures.py from that same folder and inspect evidence/revision_results.json. The two proof-of-concept exports preserve baseline and deliberately mutated outputs separately.

Retained local test files

The review package retains the exact original scripts under evidence/fixtures/batch0662_v2/. Original outputs are preserved in prior_evidence/ and the rerun outputs in evidence/ beneath that folder. All relevant scripts were rerun successfully in this review. The SMTP fixtures bind only to 127.0.0.1; the evaluation fixtures are offline. These bounded local outcomes do not demonstrate any public-provider or production-mail result.

Local fixture script and rerun receipt.

[ Takeaway ]

Evaluate one platform against a reproducible sender scenario pack rather than a sales demonstration.

[ By role ]

What this means for you

Choose your role for practical next steps.

IT / Mail Admin

Preserve reproducibility

Record the exact inputs and observations needed to repeat this specific evaluation.

Next steps

  1. Preserve the same scenario pack and raw evidence for every evaluation.
  2. Keep raw evidence separate from interpretation and labels.
  3. Verify any live change through the authorized change process.

CISO / SecOps

Control authority and uncertainty

Prevent incomplete observations from turning into unsupported security or compliance conclusions.

Next steps

  1. Hold unknown shared infrastructure for investigation rather than automatic approval.
  2. Require explicit approval for consequential changes.
  3. Retain unknowns and negative controls in the final decision record.

Founder / Non-technical

Own the decision

Keep the evaluation tied to the business task and the limits of the evidence.

Next steps

  1. Freeze representative sender scenarios before comparing demonstrations.
  2. Assign an accountable owner for unresolved cases.
  3. Review retained workload and exit requirements before committing.

[ FAQs ]

Frequently asked questions

What makes a scenario representative?

It reflects an actual required mail route or a plausible failure mode, with explicit expected evidence and interpretation.

What should every candidate receive?

The same versioned scenario inputs and acceptance criteria.

Is an unaligned sender necessarily hostile?

No. It may be a legitimate configuration needing investigation.

RFC 9989

Can shared IP ownership establish sender ownership?

Not by itself. Require additional evidence and accountable confirmation.

Does the checkpoint compare commercial platforms?

No. It contains fictional local evaluation cases only.

Should missing evidence be a pass?

No. Preserve it as unknown or incomplete according to the predefined gate.

When should weights be chosen?

Before results are viewed, after essential acceptance gates are defined.

What remains before purchase?

Current product proof, authorized workflow testing and review of commercial and exit terms.

[ Sources ]

Sources

  1. RFC 9989

    Sections §4.4 Identifier Alignment Explained · §5.3 Mail Receiver Actions · §10 Privacy Considerations · §11 Security Considerations

  2. RFC 9990

    Sections §3.1 Aggregate Reports · §3.5.1 Definition of Report-ID · §3.5.4 Handling of Duplicates · §7 Privacy Considerations

  3. RFC 7208

    Sections §2.4 Checking Authorization · §10 Security Considerations

[ Glossary ]

Glossary

Alignment
The relationship between an authenticated domain and the visible From domain under the applicable DMARC rules.
Evidence population
The explicitly defined set of observations included in an analysis.
Negative control
A deliberately failing or prohibited case used to check that a test detects the intended problem.

Enterprise provenance

Why top financial institutions and governments retired their email security dashboards.

Traditional email authentication platforms sell you a dashboard and ask your engineers to do the labour. In high-stakes environments, manual oversight means delayed enforcement, configuration drift and unmonitored shadow domains.

EmailAuth is the agentic email provenance platform. Our agents enforce p=reject, keep third-party senders aligned and move your domains to full RFC 9989 compliance, the new DMARC standard,, with human-in-the-loop auditability.

Governments Large enterprises Tier-1 financial institutions

SaaS · Dedicated tenancy · Air-gapped on-prem · BYOK encryption

Knowledge Base