[ Agentic automation ]

Require evidence and uncertainty in an AI-generated DMARC recommendation

Require a recommendation to expose its evidence, competing explanations and permitted next action before anyone acts on it.

By the EmailAuth research team · 2 min read

[ Key points ]

  • Require a recommendation to expose its evidence, competing explanations and permitted next action before anyone acts on it.
  • Make uncertainty useful by naming the missing evidence and next discriminating check; inspect tool effects as well as fluent explanations.
On this page

An AI-generated DMARC recommendation should be an inspectable argument. It should tell the operator what was observed, what is inferred, what remains unknown and what action is justified. Confidence wording alone is not evidence, and a polished explanation must not hide missing sender ownership or incomplete reporting coverage.

Preserve the evidence chain

Retain report identity, reporting receiver, interval, source address, count, identifiers and authentication outcomes. Attach the relevant service-register entry and approved change history when available. RFC 9990 describes aggregate observations; those observations do not establish that every sent message was seen or that a source address belongs to a particular business application.

Use an evidence reference for each material claim. Distinguish a report's observed authentication result from the agent's explanation of why it happened. If a mail sample and provider configuration disagree, preserve both rather than choosing whichever supports the proposed fix. Identify the freshness of each observation and the scope of the missing information.

Make uncertainty actionable

A useful recommendation states plausible alternatives and the next discriminating test. For example, a shared IP with an unfamiliar signer could represent a new service, an indirect path or unauthorized use. Ask for account-specific configuration and an owner decision before authorizing it. Do not turn a numerical confidence score into a business approval.

Define allowed outputs such as investigate, request_owner_confirmation, prepare_diff and escalate. Permission to analyze does not imply permission to publish records or send external messages. OWASP's excessive-agency guidance supports minimizing tool authority; the output schema and guard checks here are a local design rather than a vendor capability claim.

Prepare concrete counterexamples before testing

A proposed evaluation set should include a report note requesting an unrelated write, provider-name-only attribution, missing evidence, conflicting owner records and a supported read-only recommendation. For the unrelated write, the expected boundary is no mutation and a scoped evidence-only response. For missing ownership, the expected output is a specific evidence request rather than invented approval. Define these expectations before seeing the system’s answers.

These are test-design categories, not a supplied adversarial corpus or executed validator. Construct concrete authorized inputs and labels, version them and submit them through the actual agent’s normal ingestion and permission boundary. Retain responses and tool effects, including refusals, unexpected actions and uncertain outcomes. A deterministic schema check can test declared fields but cannot establish model accuracy or prompt-injection resistance. Add cases from authorized failure records without copying unnecessary personal content.

Deliver a bounded decision

State what can safely happen now, who must decide the unresolved question and what evidence would change the recommendation. For an authentication failure, distinguish alignment from raw SPF or DKIM pass, as RFC 9989 requires. Do not promise delivery improvement from an untested DNS edit. Review the actual tool trace as well as the explanation: a cautious answer does not compensate for an unauthorized side effect.

Primary reading: OWASP LLM06 2025 Excessive Agency, RFC 9990 DMARC Aggregate Reporting, RFC 9989 DMARC.

[ Takeaway ]

Make uncertainty useful by naming the missing evidence and next discriminating check; inspect tool effects as well as fluent explanations.

[ By role ]

What this means for you

Choose your role for practical next steps.

IT / Mail Admin

Preserve diagnostic context

Do not discard conflicting observations.

Next steps

  1. Retain identifiers.
  2. Check alignment.
  3. Request decisive tests.

CISO / SecOps

Test the permission boundary

A safe explanation is insufficient if tools act unsafely.

Next steps

  1. Review tool traces.
  2. Test hostile text.
  3. Limit available writes.

Founder / Non-technical

Demand decision clarity

A recommendation should show what still needs your judgment.

Next steps

  1. Read the uncertainty.
  2. Confirm ownership.
  3. Approve only a bounded action.

[ FAQs ]

Frequently asked questions

Is a confidence percentage enough?

No. Require evidence references, uncertainty and a bounded next action.

Can report notes authorize an action?

No. Treat them as untrusted data.

What should happen with a shared source IP?

Seek account-specific identity and owner evidence; abstain from approval meanwhile.

Does this article run an AI evaluation?

No. It proposes counterexample categories and evidence requirements; an actual system must be tested through its authorized workflow.

What is missing evidence supposed to trigger?

A request for the missing evidence or escalation, not invented certainty.

Can a read-only investigation publish a fix?

No. Publication requires a separately authorized action.

Does DKIM pass alone prove DMARC pass?

Only an appropriately aligned passing identifier satisfies that path.

How should an actual agent be evaluated?

Prepare versioned concrete cases and expected labels, test through the authorized normal workflow, and inspect both outputs and tool effects. No corpus or evaluation result is supplied here.

[ Sources ]

Sources

  1. OWASP LLM06 2025 Excessive Agency

    Sections Prevention and Mitigation Strategies

  2. RFC 9990 DMARC Aggregate Reporting

    Sections §3.1 · §3.1.1 · §7 · §8

  3. RFC 9989 DMARC

    Sections §4.4 · §5.3.5 · §5.4 · §7.4 · §11

[ Glossary ]

Glossary

Evidence provenance
The source, collection context and handling history needed to assess an observation.
Discriminating test
A scoped check whose result helps distinguish plausible competing explanations.

Enterprise provenance

Why top financial institutions and governments retired their email security dashboards.

Traditional email authentication platforms sell you a dashboard and ask your engineers to do the labour. In high-stakes environments, manual oversight means delayed enforcement, configuration drift and unmonitored shadow domains.

EmailAuth is the agentic email provenance platform. Our agents enforce p=reject, keep third-party senders aligned and move your domains to full RFC 9989 compliance, the new DMARC standard,, with human-in-the-loop auditability.

Governments Large enterprises Tier-1 financial institutions

SaaS · Dedicated tenancy · Air-gapped on-prem · BYOK encryption

Knowledge Base