../ runs index

Campaign a2a-hermes-v0.6.3.1-r9 FAIL

Agent group
hermes (homogeneous)
ai-memory ref
v0.6.3.1
Completed at
2026-05-03T15:23:13Z
Overall pass
false
Skipped reports
0

Infrastructure

Provider
digitalocean
Region
nyc3
Droplet size
Topology
4-node federation mesh (W=2/N=4)
Scenarios started
Scenarios ended
Dispatched by
alphaonedev
Harness SHA
9e5f0972b964
Workflow run
https://github.com/alphaonedev/ai-memory-a2a-v0.6.3.1/actions/runs/25283030201

Node roster

#RoleAgent IDPublic IPPrivate IP
1agentai:alice
2agentai:bob
3agentai:charlie
4memory-only

Run focus

Campaign failed: no scenario reports recovered.

What this campaign tested: No scenarios were exercised despite requesting 35 scenarios covering various agent-to-agent memory sharing across transport, framework, and primitive axes.

What it demonstrated: The run demonstrated a complete failure in the testing harness to recover any scenario reports, indicating an infrastructure or CI issue.

AI NHI analysis · Claude Opus 4.7

Campaign failed: no scenario reports recovered.

FAIL — no scenario reports recovered

For three audiences

Non-technical end users

This test run didn't complete successfully, so we couldn't check if AI agents can reliably share memories with each other. The system set up the environment but failed to collect any results from the planned tests. As a result, we have no new information on memory sharing reliability.

C-level decision makers

High risk posture due to total test failure, blocking production readiness assessment and any customer-facing claims on agent memory federation. No progress or changes versus prior runs as zero data was produced. Prioritize harness fixes to resume validation cadence.

Engineers & architects

Complete failure mode where no scenario reports were recovered, impacting all requested scenarios (1,1b,2,4-6,9-18,22-25,28-42) across the 4-node federation mesh on DigitalOcean nyc3. Probable root cause is in the CI harness (SHA: 9e5f0972b964705e766b7f8253d06a0c993706e3) during report aggregation or infra provisioning. No specific primitives or testbook/probe identifiers (S#, F#) available due to missing reports.

What changes going into the next campaign

Investigate and resolve report recovery failures in the CI workflow before the next campaign.

All artifacts