Campaign a2a-hermes-v0.6.1-r15 FAIL
Infrastructure
Node roster
| # | Role | Agent ID | Public IP | Private IP |
|---|---|---|---|---|
| 1 | agent | ai:alice | 104.131.175.180 | 10.252.0.3 |
| 2 | agent | ai:bob | 45.55.150.191 | 10.252.0.2 |
| 3 | agent | ai:charlie | 134.122.4.163 | 10.252.0.4 |
| 4 | memory-only | — | 134.122.12.244 | 10.252.0.5 |
Baseline attestation BASELINE OK
Per the authoritative baseline spec, every agent node must emit a self-attestation before any scenario is permitted to run. This run's attestation:
Spec version: 1.2.0 — see authoritative baseline.
| Node | Agent | Framework | Authentic | MCP ai-memory | xAI cfg | xAI default | Agent ID | Federation | UFW off | iptables | dead-man | F1 xAI | F2a substrate | F2b agent (non-gating) | Config SHA | Pass |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| node-1 | ai:alice | hermes Hermes Agent v0.10.0 (2026.4.16) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | — | fa358f9a9059 | PASS |
| node-2 | ai:bob | hermes Hermes Agent v0.10.0 (2026.4.16) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | — | 21635cf63640 | PASS |
| node-3 | ai:charlie | hermes Hermes Agent v0.10.0 (2026.4.16) | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | — | ce52d772ef5a | PASS |
a2a-baseline.json
{
"baseline_pass": true,
"per_node": [
{
"spec_version": "1.2.0",
"agent_type": "hermes",
"agent_id": "ai:alice",
"node_index": "1",
"framework_version": "Hermes Agent v0.10.0 (2026.4.16)",
"ai_memory_version": "0.6.1",
"peer_urls": "http://10.252.0.2:9077,http://10.252.0.4:9077,http://10.252.0.5:9077",
"config_file_sha256": "fa358f9a90597243fb96224babd541399bd7b1e972f364605308ab1e2d9dd2c7",
"config_attestation": {
"framework_is_authentic": true,
"mcp_server_ai_memory_registered": true,
"llm_backend_is_xai_grok": true,
"llm_is_default_provider": true,
"mcp_command_is_ai_memory": true,
"agent_id_stamped": true,
"federation_live": true,
"ufw_disabled": true,
"iptables_flushed": true,
"dead_man_switch_scheduled": true
},
"negative_invariants": {
"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory. Any true here = thesis-preserving.",
"a2a_protocol_off": true,
"sub_agent_or_sessions_spawn_off": true,
"alternative_channels_off": true,
"tool_allowlist_is_memory_only": true,
"a2a_gate_profile_locked": true
},
"functional_probes": {
"xai_grok_chat_reachable": true,
"xai_grok_sample_reply": "READY",
"substrate_http_canary_f2a": true,
"substrate_http_canary_uuid": "aa15bf8c-cc14-44a9-a014-e9cd6396a254",
"agent_mcp_canary_f2b": false,
"agent_mcp_canary_uuid": "5a949af0-35e0-47f9-8b8e-4ddd721aaee1",
"agent_canary_response_head": "Traceback (most recent call last): File \"/usr/local/bin/hermes\", line 11, in <module> main() File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 8679, in main args.func(args) File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 1083, in cmd_chat if not _has_any_provider_configured(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 222, in _has_any_provider_configured from hermes_cli.auth import get_auth_sta",
"_f2b_note": "F2b is LLM-dependent and non-blocking. F2a (deterministic HTTP substrate) gates baseline_pass.",
"mesh_connectivity_f4": true,
"mesh_edges_ok": 3,
"mesh_edges_total": 3,
"mesh_edges_detail": "10.252.0.2:9077:OK,10.252.0.4:9077:OK,10.252.0.5:9077:OK",
"_f4_note": "F4 verifies this local nodes N-1 OUTBOUND mesh edges to every peer via both GET health and POST sync_push dry_run. Aggregator ANDs across N nodes to confirm full N*(N-1) bidirectional reachability. Gates baseline_pass.",
"agent_mcp_ai_memory_canary": true,
"canary_uuid": "aa15bf8c-cc14-44a9-a014-e9cd6396a254",
"canary_namespace": "_baseline_canary_f2a"
},
"baseline_pass": true
},
{
"spec_version": "1.2.0",
"agent_type": "hermes",
"agent_id": "ai:bob",
"node_index": "2",
"framework_version": "Hermes Agent v0.10.0 (2026.4.16)",
"ai_memory_version": "0.6.1",
"peer_urls": "http://10.252.0.3:9077,http://10.252.0.4:9077,http://10.252.0.5:9077",
"config_file_sha256": "21635cf6364057fd2a004d28aac89abf8438671d85f9fd2ed1e654d812d23ff1",
"config_attestation": {
"framework_is_authentic": true,
"mcp_server_ai_memory_registered": true,
"llm_backend_is_xai_grok": true,
"llm_is_default_provider": true,
"mcp_command_is_ai_memory": true,
"agent_id_stamped": true,
"federation_live": true,
"ufw_disabled": true,
"iptables_flushed": true,
"dead_man_switch_scheduled": true
},
"negative_invariants": {
"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory. Any true here = thesis-preserving.",
"a2a_protocol_off": true,
"sub_agent_or_sessions_spawn_off": true,
"alternative_channels_off": true,
"tool_allowlist_is_memory_only": true,
"a2a_gate_profile_locked": true
},
"functional_probes": {
"xai_grok_chat_reachable": true,
"xai_grok_sample_reply": "READY",
"substrate_http_canary_f2a": true,
"substrate_http_canary_uuid": "3da008e0-d800-4221-9c84-b1bc7c1a9d13",
"agent_mcp_canary_f2b": false,
"agent_mcp_canary_uuid": "48c6e6b2-7e45-4c71-aa9d-73fb1586fd43",
"agent_canary_response_head": "Traceback (most recent call last): File \"/usr/local/bin/hermes\", line 11, in <module> main() File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 8679, in main args.func(args) File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 1083, in cmd_chat if not _has_any_provider_configured(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 222, in _has_any_provider_configured from hermes_cli.auth import get_auth_sta",
"_f2b_note": "F2b is LLM-dependent and non-blocking. F2a (deterministic HTTP substrate) gates baseline_pass.",
"mesh_connectivity_f4": true,
"mesh_edges_ok": 3,
"mesh_edges_total": 3,
"mesh_edges_detail": "10.252.0.3:9077:OK,10.252.0.4:9077:OK,10.252.0.5:9077:OK",
"_f4_note": "F4 verifies this local nodes N-1 OUTBOUND mesh edges to every peer via both GET health and POST sync_push dry_run. Aggregator ANDs across N nodes to confirm full N*(N-1) bidirectional reachability. Gates baseline_pass.",
"agent_mcp_ai_memory_canary": true,
"canary_uuid": "3da008e0-d800-4221-9c84-b1bc7c1a9d13",
"canary_namespace": "_baseline_canary_f2a"
},
"baseline_pass": true
},
{
"spec_version": "1.2.0",
"agent_type": "hermes",
"agent_id": "ai:charlie",
"node_index": "3",
"framework_version": "Hermes Agent v0.10.0 (2026.4.16)",
"ai_memory_version": "0.6.1",
"peer_urls": "http://10.252.0.3:9077,http://10.252.0.2:9077,http://10.252.0.5:9077",
"config_file_sha256": "ce52d772ef5a00968db29fb80eea7a14206b0a258a00ff2165db725405474618",
"config_attestation": {
"framework_is_authentic": true,
"mcp_server_ai_memory_registered": true,
"llm_backend_is_xai_grok": true,
"llm_is_default_provider": true,
"mcp_command_is_ai_memory": true,
"agent_id_stamped": true,
"federation_live": true,
"ufw_disabled": true,
"iptables_flushed": true,
"dead_man_switch_scheduled": true
},
"negative_invariants": {
"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory. Any true here = thesis-preserving.",
"a2a_protocol_off": true,
"sub_agent_or_sessions_spawn_off": true,
"alternative_channels_off": true,
"tool_allowlist_is_memory_only": true,
"a2a_gate_profile_locked": true
},
"functional_probes": {
"xai_grok_chat_reachable": true,
"xai_grok_sample_reply": "READY",
"substrate_http_canary_f2a": true,
"substrate_http_canary_uuid": "e22c1f96-5ad3-4943-b870-fd0314c7e624",
"agent_mcp_canary_f2b": false,
"agent_mcp_canary_uuid": "0a1c6d43-55f9-4088-8a24-d6dfb49af539",
"agent_canary_response_head": "Traceback (most recent call last): File \"/usr/local/bin/hermes\", line 11, in <module> main() File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 8679, in main args.func(args) File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 1083, in cmd_chat if not _has_any_provider_configured(): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File \"/root/.hermes/hermes-agent/hermes_cli/main.py\", line 222, in _has_any_provider_configured from hermes_cli.auth import get_auth_sta",
"_f2b_note": "F2b is LLM-dependent and non-blocking. F2a (deterministic HTTP substrate) gates baseline_pass.",
"mesh_connectivity_f4": true,
"mesh_edges_ok": 3,
"mesh_edges_total": 3,
"mesh_edges_detail": "10.252.0.3:9077:OK,10.252.0.2:9077:OK,10.252.0.5:9077:OK",
"_f4_note": "F4 verifies this local nodes N-1 OUTBOUND mesh edges to every peer via both GET health and POST sync_push dry_run. Aggregator ANDs across N nodes to confirm full N*(N-1) bidirectional reachability. Gates baseline_pass.",
"agent_mcp_ai_memory_canary": true,
"canary_uuid": "e22c1f96-5ad3-4943-b870-fd0314c7e624",
"canary_namespace": "_baseline_canary_f2a"
},
"baseline_pass": true
}
]
}
F3 — peer A2A via shared memory F3 OK
Workflow-level probe answering "can agents communicate through ai-memory?". Writer ai:alice posted canary UUID 8fd35a4a-6ae4-4401-b149-6af2de99f565 to namespace _baseline_peer_canary via node-1's local ai-memory serve HTTP. After W=2 fanout settle, probe confirmed the canary on each of the 3 peer nodes via their local GET /api/v1/memories.
f3-peer-a2a.json
{
"probe": "F3",
"name": "peer-a2a-via-shared-memory",
"description": "Writer agent posts a canary via local ai-memory HTTP on node-1; verifies the row propagates to the 3 peer nodes (W=2/N=4 quorum) before scenarios run.",
"canary_uuid": "8fd35a4a-6ae4-4401-b149-6af2de99f565",
"canary_namespace": "_baseline_peer_canary",
"writer_agent": "ai:alice",
"pass": true
}
AI NHI analysis
No per-campaign narrative recorded yet. scripts/analyze_run.py will generate one on the next dispatch.
Tests performed in this run
Every scenario that produced a JSON report in this campaign, in testbook order. Click a row's scenario id to jump to its full report below. See the Every test performed page for the authoritative catalog.
| ID | Title | Result | Reason |
|---|---|---|---|
| S1 | Per-agent write + read (MCP stdio) | ? | |
| S1b | Per-agent write + read (HTTP) | PASS | |
| S2 | Shared-context handoff | PASS | |
| S4 | Federation-aware concurrent writes | PASS | |
| S5 | Consolidation + curation | ? | |
| S6 | Contradiction detection | PASS | |
| S9 | Mutation round-trip | PASS | |
| S10 | Deletion propagation | PASS | |
| S11 | Link integrity | ? | |
| S12 | Agent registration | ? | |
| S13 | Concurrent write contention | PASS | |
| S14 | Partition tolerance | PASS | |
| S15 | Read-your-writes | PASS | |
| S16 | Tier promotion | PASS | |
| S17 | Stats consistency | PASS | |
| S18 | Semantic query expansion | ? |
Scenario 1 — Per-agent write + read (MCP stdio) UNKNOWN
scenario-1.json (report)
scenario-1.log (console trace)
[scenario-1 hermes] phase A: each agent writes 10 memories via MCP
[scenario-1 hermes] agent ai:alice on node-a (104.131.175.180)
Traceback (most recent call last):
File "/usr/local/bin/hermes", line 11, in <module>
main()
File "/root/.hermes/hermes-agent/hermes_cli/main.py", line 8679, in main
args.func(args)
File "/root/.hermes/hermes-agent/hermes_cli/main.py", line 1083, in cmd_chat
if not _has_any_provider_configured():
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/.hermes/hermes-agent/hermes_cli/main.py", line 222, in _has_any_provider_configured
from hermes_cli.auth import get_auth_status
File "/root/.hermes/hermes-agent/hermes_cli/auth.py", line 38, in <module>
import httpx
ModuleNotFoundError: No module named 'httpx'
Scenario 1b — Per-agent write + read (HTTP) PASS
scenario-1b.json (report)
{
"scenario": "1b",
"pass": true,
"agent_group": "hermes",
"path": "serve-http",
"expected_per_reader": 20,
"per_agent": {
"ai:alice": {
"recall": 20
},
"ai:bob": {
"recall": 20
},
"ai:charlie": {
"recall": 20
}
},
"reasons": []
}
scenario-1b.log (console trace)
[scenario-1b hermes] phase A: each agent POSTs 10 memories to local serve [scenario-1b hermes] agent ai:alice on node-a (104.131.175.180) [scenario-1b hermes] agent ai:bob on node-b (45.55.150.191) [scenario-1b hermes] agent ai:charlie on node-c (134.122.4.163) [scenario-1b hermes] settle 15s for W=2/N=4 convergence [scenario-1b hermes] phase B: each reader counts rows in the OTHER two namespaces via local serve [scenario-1b hermes] ai:alice sees 20 rows from the other two namespaces [scenario-1b hermes] ai:bob sees 20 rows from the other two namespaces [scenario-1b hermes] ai:charlie sees 20 rows from the other two namespaces [scenario-1b hermes] phase C: cross-cluster identity verification via node-4 [scenario-1b hermes] ns=scenario1b-ai:alice count=10 wrong_agent_id=0 [scenario-1b hermes] ns=scenario1b-ai:bob count=10 wrong_agent_id=0 [scenario-1b hermes] ns=scenario1b-ai:charlie count=10 wrong_agent_id=0
Scenario 2 — Shared-context handoff PASS
scenario-2.json (report)
{
"scenario": "2",
"pass": true,
"agent_group": "hermes",
"path": "serve-http",
"per_agent": {
"ai:bob": {
"sees_handoff": 1
},
"ai:alice": {
"sees_ack": 1
}
},
"handoff_uuid": "b986bce0-420b-408a-bb90-ba61ce7c3c4e",
"ack_uuid": "56630229-a26e-4c66-a0d5-80173e6c733a",
"reasons": []
}
scenario-2.log (console trace)
[scenario-2 hermes] phase A: ai:alice writes handoff to ai:bob (uuid=b986bce0-420b-408a-bb90-ba61ce7c3c4e) [scenario-2 hermes] settle 8s for quorum fanout [scenario-2 hermes] phase B: ai:bob reads handoff on node-2 [scenario-2 hermes] ai:bob sees 1 handoff memories from ai:alice [scenario-2 hermes] phase C: ai:bob writes acknowledgement (uuid=56630229-a26e-4c66-a0d5-80173e6c733a) [scenario-2 hermes] settle 8s for reverse-direction fanout [scenario-2 hermes] phase D: ai:alice reads ack on node-1 [scenario-2 hermes] ai:alice sees 1 ack memories from ai:bob
Scenario 4 — Federation-aware concurrent writes PASS
scenario-4.json (report)
{
"scenario": "4",
"pass": true,
"agent_group": "hermes",
"expected_per_agent": 30,
"per_agent": {
"ai:alice": {
"count": 30,
"wrong_agent_id": 0
},
"ai:bob": {
"count": 30,
"wrong_agent_id": 0
},
"ai:charlie": {
"count": 30,
"wrong_agent_id": 0
}
},
"reasons": []
}
scenario-4.log (console trace)
[scenario-4 hermes] phase A: launching concurrent 30-row bursts from 3 agents [scenario-4 hermes] all 3 bursts complete; settle 20s for W=2 fanout convergence [scenario-4 hermes] phase B: querying node-4 aggregator for per-agent counts [scenario-4 hermes] ai:alice: count=30 (expected 30) wrong_agent_id=0 [scenario-4 hermes] ai:bob: count=30 (expected 30) wrong_agent_id=0 [scenario-4 hermes] ai:charlie: count=30 (expected 30) wrong_agent_id=0
Scenario 5 — Consolidation + curation FAIL
Reasons: consolidated_from_agents missing ai:alice | consolidated_from_agents missing ai:bob | consolidated_from_agents missing ai:charlie
scenario-5.json (report)
{
"scenario": "5",
"pass": false,
"agent_group": "hermes",
"consolidated_id": "0bbdaf10-6764-4a13-a565-f429718548f6",
"consolidate_http_code": "201",
"consolidated_from_agents": "[]",
"reasons": [
"consolidated_from_agents missing ai:alice",
"consolidated_from_agents missing ai:bob",
"consolidated_from_agents missing ai:charlie"
]
}
scenario-5.log (console trace)
[scenario-5 hermes] phase A: each agent writes 3 related memories [scenario-5 hermes] ai:alice on 104.131.175.180 [scenario-5 hermes] ai:bob on 45.55.150.191 [scenario-5 hermes] ai:charlie on 134.122.4.163 [scenario-5 hermes] phase B: collect source memory IDs on node-1, then trigger consolidate [scenario-5 hermes] source ids: ["b3fd777e-f801-4416-b9dd-8bd315c0dab2","c5776512-0ecb-4acd-9dc0-9c7efcb82b91","af393bb1-b29b-47bc-bfc0-85f3a6409d24","abf15e33-2318-4486-86e0-d75ef77452e1","7d65ea36-546c-4020-acbe-16bd9484526c","43f9b2be-01ad-48f6-ab1e-e20d4169e8b4","d86bcf69-249b-4fdd-9108-23d1ea815a95","a1076dbd-d839-4e40-bda6-1241e85ca145","fd847582-d0dc-4751-a206-da5f2c2a8f0f"] [scenario-5 hermes] consolidate returned HTTP 201 [scenario-5 hermes] consolidated memory id=0bbdaf10-6764-4a13-a565-f429718548f6 [scenario-5 hermes] phase C: verifying consolidated_from_agents on node-4 [scenario-5 hermes] consolidated_from_agents=[]
Scenario 6 — Contradiction detection PASS
scenario-6.json (report)
{
"scenario": "6",
"pass": true,
"agent_group": "hermes",
"topic": "sky-color-2ff89578",
"alice_id": "2f0496b6-d07c-4f4a-987f-669520e9ff2d",
"bob_id": "a69c953c-6669-49bf-9de8-31af2c914392",
"detect_http_code": "200",
"charlie_sees_both_memories": 1,
"charlie_sees_contradicts_link": 1,
"reasons": []
}
scenario-6.log (console trace)
[scenario-6 hermes] alice writes claim: "sky-color-2ff89578 is blue" on node-1 [scenario-6 hermes] bob writes contradicting claim: "sky-color-2ff89578 is red" on node-2 [scenario-6 hermes] alice.id=2f0496b6-d07c-4f4a-987f-669520e9ff2d bob.id=a69c953c-6669-49bf-9de8-31af2c914392 [scenario-6 hermes] charlie queries memory_detect_contradiction on node-3 [scenario-6 hermes] HTTP 200; body length=1117 [scenario-6 hermes] sees both memories: 1; sees contradicts link: 1
Scenario 9 — Mutation round-trip PASS
scenario-9.json (report)
{
"scenario": "9",
"pass": true,
"agent_group": "hermes",
"m1_id": "fc43b876-75e7-4958-b653-0ce189ccd591",
"v1_uuid": "5e4212aa-9cf2-4a77-b928-632238525db2",
"v2_uuid": "f1ef8d05-cbc6-4c57-ae8c-2adab77dd630",
"put_http_code": "200",
"charlie_view": {
"content": "f1ef8d05-cbc6-4c57-ae8c-2adab77dd630",
"agent_id": "ai:alice"
},
"reasons": []
}
scenario-9.log (console trace)
[scenario-9 hermes] alice writes M1 content=5e4212aa-9cf2-4a77-b928-632238525db2 on node-1 [scenario-9 hermes] created memory id=fc43b876-75e7-4958-b653-0ce189ccd591 [scenario-9 hermes] bob updates M1 content=f1ef8d05-cbc6-4c57-ae8c-2adab77dd630 on node-2 via PUT [scenario-9 hermes] PUT returned HTTP 200 [scenario-9 hermes] charlie reads M1 on node-3 and checks content + provenance [scenario-9 hermes] charlie sees content="f1ef8d05-cbc6-4c57-ae8c-2adab77dd630" agent_id="ai:alice"
Scenario 10 — Deletion propagation PASS
scenario-10.json (report)
{
"scenario": "10",
"pass": true,
"agent_group": "hermes",
"m1_id": "003312f1-6c2a-4d39-9f89-16fe21f03383",
"uuid": "a92304de-17cc-4a44-ad67-3afac35003c1",
"delete_http_code": "200",
"pre_delete_visible_peers": 3,
"post_delete_still_visible_peers": 0,
"reasons": []
}
scenario-10.log (console trace)
[scenario-10 hermes] alice writes M1 content=a92304de-17cc-4a44-ad67-3afac35003c1 on node-1 [scenario-10 hermes] created memory id=003312f1-6c2a-4d39-9f89-16fe21f03383 [scenario-10 hermes] pre-delete: verifying M1 is visible on all peers [scenario-10 hermes] pre-delete node-2 sees 1 [scenario-10 hermes] pre-delete node-3 sees 1 [scenario-10 hermes] pre-delete node-4 sees 1 [scenario-10 hermes] alice deletes M1 on node-1 [scenario-10 hermes] DELETE returned HTTP 200 [scenario-10 hermes] post-delete: verifying M1 is GONE from all peers [scenario-10 hermes] post-delete node-2 sees 0 (expected 0) [scenario-10 hermes] post-delete node-3 sees 0 (expected 0) [scenario-10 hermes] post-delete node-4 sees 0 (expected 0)
Scenario 11 — Link integrity FAIL
Reasons: charlie could not see M1->M2 link after settle
scenario-11.json (report)
{
"scenario": "11",
"pass": false,
"agent_group": "hermes",
"m1_id": "61e00dff-a951-47bc-80b4-0f5566de762a",
"m2_id": "790a3c8f-f6ca-4ad6-a1f2-59fa33172fbc",
"relation": "related_to",
"link_http_code": "201",
"charlie_sees_link": 0,
"reasons": [
"charlie could not see M1->M2 link after settle"
]
}
scenario-11.log (console trace)
[scenario-11 hermes] alice writes M1 on node-1 [scenario-11 hermes] bob writes M2 on node-2 [scenario-11 hermes] M1=61e00dff-a951-47bc-80b4-0f5566de762a M2=790a3c8f-f6ca-4ad6-a1f2-59fa33172fbc [scenario-11 hermes] alice links M1 -> M2 with relation=related_to [scenario-11 hermes] link POST returned HTTP 201 [scenario-11 hermes] charlie queries links of M1 on node-3 [scenario-11 hermes] charlie sees M1->M2 link: 0 (expected >=1)
Scenario 12 — Agent registration UNKNOWN
scenario-12.json (report)
scenario-12.log (console trace)
[scenario-12 hermes] alice registers new agent ai:dave-probe-f5acaec3 on node-1 [scenario-12 hermes] POST /api/v1/agents returned HTTP 422
Scenario 13 — Concurrent write contention PASS
scenario-13.json (report)
{
"scenario": "13",
"pass": true,
"agent_group": "hermes",
"m1_id": "bcc7e6f3-7447-45bb-b8ae-e36b9257f546",
"submitted": {
"v0": "22d7afd0-8b21-4387-8045-a299d3b2fc82",
"vA_alice": "243edee5-13a0-4581-9731-c7de788a54aa",
"vB_bob": "2b24cd3f-35b9-46a1-9165-a97b4f8c2107"
},
"peer_view": {
"node_1": "243edee5-13a0-4581-9731-c7de788a54aa",
"node_2": "243edee5-13a0-4581-9731-c7de788a54aa",
"node_3": "243edee5-13a0-4581-9731-c7de788a54aa",
"node_4": "243edee5-13a0-4581-9731-c7de788a54aa"
},
"reasons": []
}
scenario-13.log (console trace)
[scenario-13 hermes] alice writes M1 content=v0 on node-1 [scenario-13 hermes] M1 id=bcc7e6f3-7447-45bb-b8ae-e36b9257f546 [scenario-13 hermes] alice + bob issue concurrent PUTs (vA=243edee5-13a0-4581-9731-c7de788a54aa from alice, vB=2b24cd3f-35b9-46a1-9165-a97b4f8c2107 from bob) [scenario-13 hermes] settle 10s for quorum convergence [scenario-13 hermes] node-1 sees content=243edee5-13a0-4581-9731-c7de788a54aa [scenario-13 hermes] node-2 sees content=243edee5-13a0-4581-9731-c7de788a54aa [scenario-13 hermes] node-3 sees content=243edee5-13a0-4581-9731-c7de788a54aa [scenario-13 hermes] node-4 sees content=243edee5-13a0-4581-9731-c7de788a54aa
Scenario 14 — Partition tolerance PASS
scenario-14.json (report)
{
"scenario": "14",
"pass": true,
"agent_group": "hermes",
"partition_target": "node-3",
"expected_post_recovery": 20,
"node3_saw": 20,
"reasons": []
}
scenario-14.log (console trace)
[scenario-14 hermes] suspending ai-memory on node-3 (SIGSTOP) [scenario-14 hermes] writing 10 memories each from alice + bob during node-3 outage [scenario-14 hermes] resuming ai-memory on node-3 (SIGCONT) [scenario-14 hermes] settle 20s for post-partition catchup [scenario-14 hermes] checking node-3 caught up [scenario-14 hermes] node-3 sees 20 memories in scenario14-partition (expected 20)
Scenario 15 — Read-your-writes PASS
scenario-15.json (report)
{
"scenario": "15",
"pass": true,
"agent_group": "hermes",
"uuid": "74379f01-6c7b-4401-9781-fc45a1bf8beb",
"writer_sees_own_write": 1,
"reasons": []
}
scenario-15.log (console trace)
[scenario-15 hermes] alice writes + immediately reads M1 on node-1 (uuid=74379f01-6c7b-4401-9781-fc45a1bf8beb) [scenario-15 hermes] alice sees 1 (expected 1) immediately after write
Scenario 16 — Tier promotion PASS
scenario-16.json (report)
{
"scenario": "16",
"pass": true,
"agent_group": "hermes",
"m1_id": "f7e9841a-80b1-4c34-9a57-f3ef8fc50b4d",
"promote_http_code": "200",
"bob_sees_tier": "long",
"reasons": []
}
scenario-16.log (console trace)
[scenario-16 hermes] alice writes M1 tier=short on node-1 [scenario-16 hermes] M1 id=f7e9841a-80b1-4c34-9a57-f3ef8fc50b4d [scenario-16 hermes] alice promotes M1 to tier=long [scenario-16 hermes] promote returned HTTP 200 [scenario-16 hermes] bob reads M1 on node-2 and checks tier [scenario-16 hermes] bob sees tier=long (expected long)
Scenario 17 — Stats consistency PASS
scenario-17.json (report)
{
"scenario": "17",
"pass": true,
"agent_group": "hermes",
"expected_count": 15,
"per_peer": {
"node_1": 15,
"node_2": 15,
"node_3": 15,
"node_4": 15
},
"reasons": []
}
scenario-17.log (console trace)
[scenario-17 hermes] phase A: each of 3 agents writes 5 memories to scenario17-stats [scenario-17 hermes] ai:alice on 104.131.175.180 [scenario-17 hermes] ai:bob on 45.55.150.191 [scenario-17 hermes] ai:charlie on 134.122.4.163 [scenario-17 hermes] settle 15s for W=2 fanout [scenario-17 hermes] phase B: querying count on every peer [scenario-17 hermes] node-1 count=15 (expected 15) [scenario-17 hermes] node-2 count=15 (expected 15) [scenario-17 hermes] node-3 count=15 (expected 15) [scenario-17 hermes] node-4 count=15 (expected 15)
Scenario 18 — Semantic query expansion FAIL
Reasons: semantic query did not surface alice's memory | semantic query did not surface bob's memory
scenario-18.json (report)
{
"scenario": "18",
"pass": false,
"agent_group": "hermes",
"query": "morning outdoor exercise routine",
"writers": [
{
"agent": "ai:alice",
"marker": "alice-sunrise-b2af611b-507e-42f6-a0c7-5ec3f52d7134",
"seen_by_charlie": 0
},
{
"agent": "ai:bob",
"marker": "bob-daybreak-46281deb-46f3-48dc-bb53-486e854940a0",
"seen_by_charlie": 0
}
],
"reasons": [
"semantic query did not surface alice's memory",
"semantic query did not surface bob's memory"
]
}
scenario-18.log (console trace)
[scenario-18 hermes] alice writes A on node-1 [scenario-18 hermes] bob writes B on node-2 [scenario-18 hermes] settle 15s for fanout + index rebuild [scenario-18 hermes] charlie queries on node-3 with semantically-related prompt [scenario-18 hermes] charlie sees alice's memory: 0 (expected >=1) [scenario-18 hermes] charlie sees bob's memory: 0 (expected >=1)
All artifacts
- a2a-baseline.json
- a2a-summary.json
- campaign.meta.json
- f3-peer-a2a.json
- scenario-1.json
- scenario-10.json
- scenario-11.json
- scenario-12.json
- scenario-13.json
- scenario-14.json
- scenario-15.json
- scenario-16.json
- scenario-17.json
- scenario-18.json
- scenario-1b.json
- scenario-2.json
- scenario-4.json
- scenario-5.json
- scenario-6.json
- scenario-9.json
- scenario-1.log
- scenario-10.log
- scenario-11.log
- scenario-12.log
- scenario-13.log
- scenario-14.log
- scenario-15.log
- scenario-16.log
- scenario-17.log
- scenario-18.log
- scenario-1b.log
- scenario-2.log
- scenario-4.log
- scenario-5.log
- scenario-6.log
- scenario-9.log