../ runs index

Campaign a2a-hermes-v0.6.2-rc.0-v3r5-mtls FAIL

Agent group
hermes (homogeneous)
ai-memory ref
v0.6.2-rc.0
Completed at
2026-04-22T11:04:03Z
Overall pass
false
Skipped reports
0

Infrastructure

Provider
digitalocean
Region
nyc3
Droplet size
s-2vcpu-4gb
Topology
4-node federation mesh (W=2/N=4)
Scenarios started
Scenarios ended
Dispatched by
alphaonedev
Harness SHA
1d6f036b7bb6
Workflow run
https://github.com/alphaonedev/ai-memory-ai2ai-gate/actions/runs/24774791794

Node roster

#RoleAgent IDPublic IPPrivate IP
1agentai:alice
2agentai:bob
3agentai:charlie
4memory-only

Run focus

Campaign failed with no scenario reports recovered.

What this campaign tested: The campaign requested 35 scenarios covering various agent-to-agent memory sharing primitives over mTLS transport, but none were executed or reported due to recovery failure.

What it demonstrated: The run demonstrated a critical failure in the testing harness, as no scenario reports were recovered, proving nothing about agent memory sharing reliability.

AI NHI analysis · Claude Opus 4.7

Campaign failed with no scenario reports recovered.

FAIL — no scenarios executed or reported.

For three audiences

Non-technical end users

This test run didn't work at all because no results were collected from the planned checks. That means we don't know if the AI agents can reliably share memories with each other in this setup. It's like planning a big experiment but losing all the data before seeing it.

C-level decision makers

This failed run indicates high risk in the current testing pipeline, blocking assessment of production readiness for agent memory federation under mTLS. No customer-facing claims can be validated until harness issues are resolved; this is a regression from prior runs where reports were successfully recovered.

Engineers & architects

The campaign harness failed entirely to recover any scenario reports, impacting all requested scenarios (1 through 42, excluding some) across federation mesh topology with mTLS. Probable root cause is in the CI workflow or infra provisioning, as evidenced by empty scenarios array and 'no scenario reports recovered' reason; check harness_sha 1d6f036b7bb68a8ba85760e1f0cb17a7170a1054 for bugs in report aggregation. No specific failure modes in primitives observable due to total absence of data.

What changes going into the next campaign

Implement robust error handling and logging in the CI harness to ensure scenario reports are always recovered and aggregated.

All artifacts