../ runs index

Campaign a2a-hermes-v0.6.2-patch2-r23b-mtls FAIL

Agent group
hermes (homogeneous)
ai-memory ref
release/v0.6.2
Completed at
2026-04-23T16:52:39Z
Overall pass
false
Skipped reports
0

Infrastructure

Provider
digitalocean
Region
nyc3
Droplet size
s-2vcpu-4gb
Topology
4-node federation mesh (W=2/N=4)
Scenarios started
Scenarios ended
Dispatched by
alphaonedev
Harness SHA
1bd0ee3aa288
Workflow run
https://github.com/alphaonedev/ai-memory-ai2ai-gate/actions/runs/24847582771

Node roster

#RoleAgent IDPublic IPPrivate IP
1agentai:alice
2agentai:bob
3agentai:charlie
4memory-only

Run focus

Campaign failed: No scenario reports recovered.

What this campaign tested: No scenarios were exercised, despite requesting 35 scenarios covering various transport, framework, and primitive axes, due to report recovery failure.

What it demonstrated: The run demonstrated a complete failure in the testing harness to recover any scenario results, providing no evidence on agent memory sharing reliability.

AI NHI analysis · Claude Opus 4.7

Campaign failed: No scenario reports recovered.

FAIL — no scenarios executed or reported.

For three audiences

Non-technical end users

This test didn't run any checks because the system couldn't collect the results. That means we have no information on whether agents can reliably share memories with each other. We need to fix the testing setup to get useful data next time.

C-level decision makers

This run exposes high operational risk in the testing infrastructure, halting progress toward production readiness. No advancements or regressions vs. prior runs as zero data was produced, undermining any customer-facing claims on reliability. Prioritize harness fixes to resume validation cadence.

Engineers & architects

Complete failure mode where no scenario reports were recovered, impacting all requested scenarios (S1, S1b, S2, S4-S6, S9-S18, S22-S25, S28-S42) across primitives like federation mesh under mTLS. Probable root cause is CI harness issue in report aggregation (harness_sha: 1bd0ee3aa288f24b2de73f13157d9ee6a0b59114), possibly due to infra provisioning or droplet connectivity in 4-node topology. No specific primitives tested; investigate workflow_url for logs.

What changes going into the next campaign

Implement robust report recovery and error handling in the CI harness to ensure scenario results are captured.

All artifacts