../ runs index

Campaign a2a-hermes-v0.6.2-patch2-r22-mtls FAIL

Agent group
hermes (homogeneous)
ai-memory ref
release/v0.6.2
Completed at
2026-04-23T12:57:26Z
Overall pass
false
Skipped reports
0

Infrastructure

Provider
digitalocean
Region
nyc3
Droplet size
s-2vcpu-4gb
Topology
4-node federation mesh (W=2/N=4)
Scenarios started
Scenarios ended
Dispatched by
alphaonedev
Harness SHA
915cfdaf2de6
Workflow run
https://github.com/alphaonedev/ai-memory-ai2ai-gate/actions/runs/24833746718

Node roster

#RoleAgent IDPublic IPPrivate IP
1agentai:alice167.71.103.610.11.2.5
2agentai:bob161.35.189.9810.11.2.3
3agentai:charlie134.209.32.1710.11.2.4
4memory-only174.138.69.11610.11.2.2

Run focus

MTLS campaign failed: no scenario reports recovered.

What this campaign tested: No scenarios were exercised, despite requesting 35 across various transport, framework, and primitive axes, due to report recovery failure.

What it demonstrated: The run demonstrated a critical harness or infrastructure issue preventing any scenario execution or result collection.

AI NHI analysis · Claude Opus 4.7

MTLS campaign failed: no scenario reports recovered.

FAIL — no scenarios executed or reported.

For three audiences

Non-technical end users

This test run completely failed, so we have no information on whether agents can reliably share memories with each other. It looks like there was a problem in setting up the tests or gathering the results. We need to fix that before trying again.

C-level decision makers

This run poses high risk as it failed entirely with no results, indicating the system is not production ready and no customer claims can be validated. No progress or changes versus prior runs; immediate investigation into CI harness reliability is required to unblock gating. Resource allocation for debugging is advised to maintain release cadence.

Engineers & architects

Complete failure with 'no scenario reports recovered' as the reason, impacting all requested scenarios (1,1b,2,4-6,9-18,22-25,28-42) across federation mesh topology under mTLS. Primitives like memory sharing were not tested due to absent reports. Probable root cause is artifact collection failure in the CI workflow (harness_sha: 915cfdaf2de6605be8eaf0a02c4137f24544d229); no specific S# or F# identifiers available since scenarios array is empty.

What changes going into the next campaign

Debug and fix report recovery mechanism in the CI harness to ensure scenario artifacts are collected.

All artifacts