../ runs index

Campaign a2a-openclaw-v0.6.3.1-r1 PASS

Agent group
openclaw (homogeneous)
ai-memory ref
release/v0.6.3.1
Completed at
2026-05-04T04:14:13Z
Overall pass
true
Skipped reports
0

Infrastructure

Provider
local-docker
Region
local-docker
Droplet size
n/a (container mem_limit=16g per openclaw agent; 4g for aggregator)
Topology
4-node Docker bridge network (10.88.1.0/24) — 3 openclaw agent containers + 1 memory-only aggregator
Scenarios started
2026-05-04T04:04:10Z
Scenarios ended
2026-05-04T04:14:13Z
Dispatched by
?
Harness SHA
?

Tested on a local Docker mesh (3 openclaw agents + 1 memory-only aggregator on a single workstation). NOT a DigitalOcean campaign — no DO infrastructure was provisioned. See docs/local-docker-mesh.md for full reproducibility. Every byte of config, build recipe, harness, and scenario is committed in this repo.

Node roster

#RoleAgent IDPublic IPPrivate IP
1agentai:alicen/a (container)10.88.1.11
2agentai:bobn/a (container)10.88.1.12
3agentai:charlien/a (container)10.88.1.13
4memory-only—n/a (container)10.88.1.14

Baseline attestation BASELINE OK

Per the authoritative baseline spec, every agent node must emit a self-attestation before any scenario is permitted to run. This run's attestation:

Spec version: 1.4.0 — see authoritative baseline.

NodeAgentFrameworkAuthenticMCP ai-memoryxAI cfgxAI defaultAgent IDFederationUFW offiptablesdead-manF1 xAIF2a substrateF2b agent (non-gating)Config SHAPass
node-1ai:aliceopenclaw OpenClaw 2026.5.2 (8b2a6e5)✅✅✅✅✅✅✅✅—❌✅——PASS
node-2ai:bobopenclaw OpenClaw 2026.5.2 (8b2a6e5)✅✅✅✅✅✅✅✅—❌✅——PASS
node-3ai:charlieopenclaw OpenClaw 2026.5.2 (8b2a6e5)✅✅✅✅✅✅✅✅—❌✅——PASS
node-4aggregator ✅✅✅✅✅✅✅✅—❌✅——PASS
a2a-baseline.json 
{
	"baseline_pass": true,
	"per_node": [
		{
			"spec_version": "1.4.0",
			"agent_type": "openclaw",
			"agent_id": "ai:alice",
			"node_index": "1",
			"framework_version": "OpenClaw 2026.5.2 (8b2a6e5)",
			"ai_memory_version": "0.6.3+patch.1",
			"peer_urls": "http://node-2:9077,http://node-3:9077,http://node-4:9077",
			"config_attestation": {
				"framework_is_authentic": true,
				"mcp_server_ai_memory_registered": true,
				"llm_backend_is_xai_grok": true,
				"llm_is_default_provider": true,
				"mcp_command_is_ai_memory": true,
				"agent_id_stamped": true,
				"federation_live": true,
				"ufw_disabled": true,
				"iptables_flushed": true,
				"dead_man_switch_scheduled": "N/A (local-docker)",
				"topology": "local-docker"
			},
			"negative_invariants": {
				"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory.",
				"a2a_protocol_off": true,
				"sub_agent_or_sessions_spawn_off": true,
				"alternative_channels_off": true,
				"tool_allowlist_is_memory_only": true,
				"a2a_gate_profile_locked": true
			},
			"functional_probes": {
				"substrate_http_canary_f2a": true,
				"mesh_connectivity_f4": true,
				"tls_handshake_f6": true,
				"mtls_enforcement_f7": true,
				"embedder_loaded_f8": true
			},
			"baseline_pass": true
		},
		{
			"spec_version": "1.4.0",
			"agent_type": "openclaw",
			"agent_id": "ai:bob",
			"node_index": "2",
			"framework_version": "OpenClaw 2026.5.2 (8b2a6e5)",
			"ai_memory_version": "0.6.3+patch.1",
			"peer_urls": "http://node-1:9077,http://node-3:9077,http://node-4:9077",
			"config_attestation": {
				"framework_is_authentic": true,
				"mcp_server_ai_memory_registered": true,
				"llm_backend_is_xai_grok": true,
				"llm_is_default_provider": true,
				"mcp_command_is_ai_memory": true,
				"agent_id_stamped": true,
				"federation_live": true,
				"ufw_disabled": true,
				"iptables_flushed": true,
				"dead_man_switch_scheduled": "N/A (local-docker)",
				"topology": "local-docker"
			},
			"negative_invariants": {
				"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory.",
				"a2a_protocol_off": true,
				"sub_agent_or_sessions_spawn_off": true,
				"alternative_channels_off": true,
				"tool_allowlist_is_memory_only": true,
				"a2a_gate_profile_locked": true
			},
			"functional_probes": {
				"substrate_http_canary_f2a": true,
				"mesh_connectivity_f4": true,
				"tls_handshake_f6": true,
				"mtls_enforcement_f7": true,
				"embedder_loaded_f8": true
			},
			"baseline_pass": true
		},
		{
			"spec_version": "1.4.0",
			"agent_type": "openclaw",
			"agent_id": "ai:charlie",
			"node_index": "3",
			"framework_version": "OpenClaw 2026.5.2 (8b2a6e5)",
			"ai_memory_version": "0.6.3+patch.1",
			"peer_urls": "http://node-1:9077,http://node-2:9077,http://node-4:9077",
			"config_attestation": {
				"framework_is_authentic": true,
				"mcp_server_ai_memory_registered": true,
				"llm_backend_is_xai_grok": true,
				"llm_is_default_provider": true,
				"mcp_command_is_ai_memory": true,
				"agent_id_stamped": true,
				"federation_live": true,
				"ufw_disabled": true,
				"iptables_flushed": true,
				"dead_man_switch_scheduled": "N/A (local-docker)",
				"topology": "local-docker"
			},
			"negative_invariants": {
				"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory.",
				"a2a_protocol_off": true,
				"sub_agent_or_sessions_spawn_off": true,
				"alternative_channels_off": true,
				"tool_allowlist_is_memory_only": true,
				"a2a_gate_profile_locked": true
			},
			"functional_probes": {
				"substrate_http_canary_f2a": true,
				"mesh_connectivity_f4": true,
				"tls_handshake_f6": true,
				"mtls_enforcement_f7": true,
				"embedder_loaded_f8": true
			},
			"baseline_pass": true
		},
		{
			"spec_version": "1.4.0",
			"agent_type": "aggregator",
			"agent_id": "",
			"node_index": "4",
			"framework_version": "",
			"ai_memory_version": "0.6.3+patch.1",
			"peer_urls": "http://node-1:9077,http://node-2:9077,http://node-3:9077",
			"config_attestation": {
				"framework_is_authentic": true,
				"mcp_server_ai_memory_registered": true,
				"llm_backend_is_xai_grok": true,
				"llm_is_default_provider": true,
				"mcp_command_is_ai_memory": true,
				"agent_id_stamped": true,
				"federation_live": true,
				"ufw_disabled": true,
				"iptables_flushed": true,
				"dead_man_switch_scheduled": "N/A (local-docker)",
				"topology": "local-docker"
			},
			"negative_invariants": {
				"_description": "Alternative A2A channels must be OFF so a passing scenario is only passing via ai-memory shared memory.",
				"a2a_protocol_off": true,
				"sub_agent_or_sessions_spawn_off": true,
				"alternative_channels_off": true,
				"tool_allowlist_is_memory_only": true,
				"a2a_gate_profile_locked": true
			},
			"functional_probes": {
				"substrate_http_canary_f2a": true,
				"mesh_connectivity_f4": true,
				"tls_handshake_f6": true,
				"mtls_enforcement_f7": true,
				"embedder_loaded_f8": true
			},
			"baseline_pass": true
		}
	]
}

raw file

F3 — peer A2A via shared memory F3 OK

Workflow-level probe answering "can agents communicate through ai-memory?". Writer ai:alice posted canary UUID 71efd90f-c0f3-43cb-958f-cac1f8b4304a to namespace _baseline_peer_canary via node-1's local ai-memory serve HTTP. After W=2 fanout settle, probe confirmed the canary on each of the 3 peer nodes via their local GET /api/v1/memories.

f3-peer-a2a.json 
{
	"probe": "F3",
	"name": "peer-a2a-via-shared-memory",
	"description": "Writer posts a canary via ai-memory HTTP on node-1; verifies propagation to peers (W=2/N=4 quorum) before scenarios run.",
	"canary_uuid": "71efd90f-c0f3-43cb-958f-cac1f8b4304a",
	"canary_namespace": "_baseline_peer_canary",
	"writer_agent": "ai:alice",
	"peers_seen": {
		"node-2": true,
		"node-3": true,
		"node-4": true
	},
	"pass": true,
	"topology": "local-docker"
}

raw file

Run focus

Substrate-only path verified after volume-pollution RCA — 35/35 GREEN on truly clean state

What this campaign tested: OpenClaw substrate testbook v3.0.0 (35 scenarios) on release/v0.6.3.1 binary against the local-docker mesh — 4 nodes, 16 GB per openclaw container, all on a single 93 GB / 14-CPU workstation. Scope=openclaw per Principle 6 — Phase 0 (preflight), F3 peer-A2A canary, then 35 substrate scenarios across MCP stdio + HTTP REST surfaces. Different scope from DO IronClaw/Hermes runs which exercise the v0.6.3.1-new S-prefixed scenarios additionally.

What it demonstrated: ai-memory v0.6.3.1 (binary 0.6.3+patch.1) holds the testbook v3.0.0 invariants on the openclaw mesh under federation (W=2 of N=4 quorum). Scenario 1 (per-agent MCP write+read), 1b (HTTP write+read), 2 (handoff), 4 (federation burst), 11 (link integrity), 13 (concurrent contention), 14 (partition tolerance), 15 (read-your-writes), 17 (stats consistency), 22-24 (security/byzantine), 28-42 (full MCP + HTTP surface) all green. Cross-cluster identity stamping intact. F3 peer canary green.

AI NHI analysis · Claude Opus 4.7

Substrate-only path verified after volume-pollution RCA — 35/35 GREEN on truly clean state

GREEN. overall_pass=true, 35 scenarios pass, 0 failure reasons, baseline + F3 canary green, on release/v0.6.3.1 binary, scope=openclaw, topology=local-docker.

For three audiences

Non-technical end users

ai-memory v0.6.3.1 was tested with a different agent framework (OpenClaw) on a different infrastructure (one workstation instead of cloud) and passed every test. Same release, same software, three runs in a row, no failures. This is the kind of evidence that says "this runs reliably," because the test was run multiple times and the result was the same every time.

C-level decision makers

Cost control + reproducibility. By running OpenClaw on a workstation Docker mesh instead of DigitalOcean General Purpose tier (16 GB+ droplets), we avoid the per-test infrastructure cost while preserving the technical fidelity of the test. Three consecutive green runs satisfy the streak criterion. Operationally: OpenClaw evidence joins IronClaw + Hermes via release linkage at the verdict layer, never collapsed.

Engineers & architects

scripts/scenarios/{1..42}_*.py exercised on docker-compose.openclaw.yml mesh (10.88.1.0/24 bridge, ai-memory-base:local + ai-memory-openclaw:local images rebuilt today against /root/ai-memory-mcp/target/release/ai-memory v0.6.3+patch.1). State-reset between rounds via `docker compose down -v && up -d` (the in-place `rm -f a2a.db*` pattern was non-functional — see PR #46 for RCA). All three runs: overall_pass=true, baseline_pass=true (all 4 nodes), F3 pass=true (W=2 quorum verified). agent_id stamping verified across 3 framework_is_authentic + mcp_server_ai_memory_registered + llm_backend_is_xai_grok attestations.

What changes going into the next campaign

Substrate-only path is now stable. Next: openclaw Phase 3 NHI behavioral evidence (currently out-of-scope per drive_agent_autonomous.sh:84). Requires entrypoint.sh openclaw config rewrite to match 2026.5.x gateway-centric schema (existing schema rejected even by 2026.4.22). Also TLS / mTLS retest on local-docker for full v0.6.3.1 cell parity.

Tests performed in this run

Every scenario that produced a JSON report in this campaign, in testbook order. Click a row's scenario id to jump to its full report below. See the Every test performed page for the authoritative catalog.

IDTitleResultReason
S1Per-agent write + read (MCP stdio)PASS
S1bPer-agent write + read (HTTP)PASS
S2Shared-context handoffPASS
S4Federation-aware concurrent writesPASS
S5Consolidation + curationPASS
S6Contradiction detectionPASS
S9Mutation round-tripPASS
S10Deletion propagationPASS
S11Link integrityPASS
S12Agent registrationPASS
S13Concurrent write contentionPASS
S14Partition tolerancePASS
S15Read-your-writesPASS
S16Tier promotionPASS
S17Stats consistencyPASS
S18Semantic query expansionPASS
S22Identity spoofing resistancePASS
S23Malicious content fuzzPASS
S24Byzantine peerPASS
S25Clock skew tolerancePASS
S28memory_search keywordPASS
S29memory_archive lifecyclePASS
S30memory_capabilities handshakePASS
S31memory_gc quiescencePASS
S32memory_inbox + notifyPASS
S33memory_subscribe pub/subPASS
S34memory_pending governancePASS
S35memory_namespace standardsPASS
S36memory_session_startPASS
S37memory_get_links bidirectionalPASS
S38/export + /importPASS
S39/sync/since deltaPASS
S40/memories/bulkPASS
S41/metrics PrometheusPASS
S42/namespaces enumerationPASS

Scenario 1 — Per-agent write + read (MCP stdio) PASS

scenario-1.json (report) 
{
	"agent_group": "openclaw",
	"expected_per_reader": 20,
	"pass": true,
	"per_agent": {
		"ai:alice": {
			"recall": 20
		},
		"ai:bob": {
			"recall": 20
		},
		"ai:charlie": {
			"recall": 20
		}
	},
	"per_namespace_node4": {
		"scenario1-ai:alice": {
			"count": 10,
			"wrong_agent_id": 0
		},
		"scenario1-ai:bob": {
			"count": 10,
			"wrong_agent_id": 0
		},
		"scenario1-ai:charlie": {
			"count": 10,
			"wrong_agent_id": 0
		}
	},
	"reasons": [],
	"scenario": "1",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-1.log (console trace) 
phase A: each agent writes 10 memories via MCP
  ai:alice on a2a-node-1
  ai:bob on a2a-node-2
  ai:charlie on a2a-node-3
settle 15s for W=2/N=4 convergence
phase B: each agent counts rows in the OTHER two namespaces
  ai:alice recalled 20 rows from the other two namespaces
  ai:bob recalled 20 rows from the other two namespaces
  ai:charlie recalled 20 rows from the other two namespaces
phase C: cross-cluster identity check on node-4
  ns=scenario1-ai:alice count=10 wrong_agent_id=0
  ns=scenario1-ai:bob count=10 wrong_agent_id=0
  ns=scenario1-ai:charlie count=10 wrong_agent_id=0

raw file

Scenario 1b — Per-agent write + read (HTTP) PASS

scenario-1b.json (report) 
{
	"agent_group": "openclaw",
	"expected_per_reader": 20,
	"pass": true,
	"path": "serve-http",
	"per_agent": {
		"ai:alice": {
			"recall": 20
		},
		"ai:bob": {
			"recall": 20
		},
		"ai:charlie": {
			"recall": 20
		}
	},
	"per_namespace_node4": {
		"scenario1b-ai:alice": {
			"count": 10,
			"wrong_agent_id": 0
		},
		"scenario1b-ai:bob": {
			"count": 10,
			"wrong_agent_id": 0
		},
		"scenario1b-ai:charlie": {
			"count": 10,
			"wrong_agent_id": 0
		}
	},
	"reasons": [],
	"scenario": "1b",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-1b.log (console trace) 
phase A: each agent POSTs 10 memories to local serve
  ai:alice on a2a-node-1
  ai:bob on a2a-node-2
  ai:charlie on a2a-node-3
settle 15s for W=2/N=4 convergence
phase B: count rows in other two namespaces via local serve HTTP
  ai:alice sees 20 rows from the other two namespaces
  ai:bob sees 20 rows from the other two namespaces
  ai:charlie sees 20 rows from the other two namespaces
phase C: cross-cluster identity check on node-4
  ns=scenario1b-ai:alice count=10 wrong_agent_id=0
  ns=scenario1b-ai:bob count=10 wrong_agent_id=0
  ns=scenario1b-ai:charlie count=10 wrong_agent_id=0

raw file

Scenario 2 — Shared-context handoff PASS

scenario-2.json (report) 
{
	"ack_uuid": "a-1ce0abd52079476aab3b09604cb2e239",
	"agent_group": "openclaw",
	"handoff_uuid": "h-9cf8c10d8d4644a485975924e88a8398",
	"pass": true,
	"path": "serve-http",
	"per_agent": {
		"ai:alice": {
			"sees_ack": 1
		},
		"ai:bob": {
			"sees_handoff": 1
		}
	},
	"reasons": [],
	"scenario": "2",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-2.log (console trace) 
phase A: ai:alice writes handoff to ai:bob (uuid=h-9cf8c10d8d4644a485975924e88a8398)
settle 8s for quorum fanout
phase B: ai:bob reads handoff on node-2
  ai:bob sees 1 handoff memories from ai:alice
phase C: ai:bob writes acknowledgement (uuid=a-1ce0abd52079476aab3b09604cb2e239)
settle 8s for reverse-direction fanout
phase D: ai:alice reads ack on node-1
  ai:alice sees 1 ack memories from ai:bob

raw file

Scenario 4 — Federation-aware concurrent writes PASS

scenario-4.json (report) 
{
	"agent_group": "openclaw",
	"expected_per_agent": 30,
	"pass": true,
	"per_agent": {
		"ai:alice": {
			"count": 30,
			"wrong_agent_id": 0
		},
		"ai:bob": {
			"count": 30,
			"wrong_agent_id": 0
		},
		"ai:charlie": {
			"count": 30,
			"wrong_agent_id": 0
		}
	},
	"reasons": [],
	"scenario": "4",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-4.log (console trace) 
phase A: launching concurrent 30-row bursts from 3 agents
  ai:alice burst ok=30/30
  ai:bob burst ok=30/30
  ai:charlie burst ok=30/30
settle 20s for W=2 fanout convergence
phase B: querying node-4 aggregator for per-agent counts
  ai:alice: count=30 (expected 30) wrong_agent_id=0
  ai:bob: count=30 (expected 30) wrong_agent_id=0
  ai:charlie: count=30 (expected 30) wrong_agent_id=0

raw file

Scenario 5 — Consolidation + curation PASS

scenario-5.json (report) 
{
	"agent_group": "openclaw",
	"consolidate_http_code": 201,
	"consolidated_from_agents": [
		"ai:charlie",
		"ai:bob",
		"ai:alice"
	],
	"consolidated_id": "eecb1a1b-a3a9-4e26-af33-0dd1b4480869",
	"pass": true,
	"reasons": [],
	"scenario": "5",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-5.log (console trace) 
phase A: each agent writes 3 related memories
  ai:alice on a2a-node-1
  ai:bob on a2a-node-2
  ai:charlie on a2a-node-3
settle 8s for quorum fanout
phase B: collect source ids on node-1, then trigger consolidate
  source ids (count=9): ['1df9598a-d9c7-4951-a976-c5ef91afac4d', '18fcf3d9-941a-4d95-a58a-6af21552d25f', '57867490-e2d3-496d-8285-b6f1d16bae11', '6387ef29-cd84-40f1-8084-8f9181df1ae3', '2546809c-2a83-4fe2-bc2d-61d3e1e05555']...
  consolidate HTTP 201, consolidated_id=eecb1a1b-a3a9-4e26-af33-0dd1b4480869
settle 10s for consolidation fanout
phase C: verifying consolidated_from_agents on node-4
  consolidated_from_agents=['ai:charlie', 'ai:bob', 'ai:alice']

raw file

Scenario 6 — Contradiction detection PASS

scenario-6.json (report) 
{
	"agent_group": "openclaw",
	"alice_id": "a1a82ca5-ee5a-4dc1-9e72-27098762c3b7",
	"bob_id": "3572cc8b-1c4f-4a70-bebf-b06452423cf5",
	"charlie_sees_both_memories": true,
	"charlie_sees_contradicts_link": true,
	"detect_http_code": 200,
	"pass": true,
	"reasons": [],
	"scenario": "6",
	"skipped": false,
	"tls_mode": "off",
	"topic": "sky-color-3791aede"
}

raw file

scenario-6.log (console trace) 
alice writes claim: "sky-color-3791aede is blue" on node-1
bob writes contradicting claim: "sky-color-3791aede is red" on node-2
  alice.id=a1a82ca5-ee5a-4dc1-9e72-27098762c3b7 bob.id=3572cc8b-1c4f-4a70-bebf-b06452423cf5
settle 10s for quorum fanout + contradiction indexing
charlie queries /api/v1/contradictions on node-3
  HTTP 200
  sees both memories: True; sees contradicts link: True

raw file

Scenario 9 — Mutation round-trip PASS

scenario-9.json (report) 
{
	"agent_group": "openclaw",
	"charlie_view": {
		"agent_id": "ai:alice",
		"content": "v2-0f686947816a4ab3b9927c413256f55c"
	},
	"m1_id": "8c1ece04-f0cc-4807-af77-35bc5dc2a60b",
	"pass": true,
	"put_http_code": 200,
	"reasons": [],
	"scenario": "9",
	"skipped": false,
	"tls_mode": "off",
	"v1_uuid": "v1-6a5ae41f697b4dd4b3bc29b1eb685f80",
	"v2_uuid": "v2-0f686947816a4ab3b9927c413256f55c"
}

raw file

scenario-9.log (console trace) 
alice writes M1 content=v1-6a5ae41f697b4dd4b3bc29b1eb685f80 on node-1
  M1 id=8c1ece04-f0cc-4807-af77-35bc5dc2a60b
settle 5s for initial replication
bob updates M1 content=v2-0f686947816a4ab3b9927c413256f55c on node-2 via PUT
  PUT returned HTTP 200
settle 8s for update fanout
charlie reads M1 on node-3 and checks content + provenance
  charlie sees content="v2-0f686947816a4ab3b9927c413256f55c" agent_id="ai:alice"

raw file

Scenario 10 — Deletion propagation PASS

scenario-10.json (report) 
{
	"agent_group": "openclaw",
	"delete_http_code": 200,
	"m1_id": "e0902f62-b8c8-4e45-bbf1-4d034be21879",
	"pass": true,
	"post_delete_hits": {
		"node-2": 0,
		"node-3": 0,
		"node-4": 0
	},
	"post_delete_still_visible_peers": 0,
	"pre_delete_visible_peers": 3,
	"reasons": [],
	"scenario": "10",
	"skipped": false,
	"tls_mode": "off",
	"uuid": "d-9ef915befce444ac8b77e94571b7b447"
}

raw file

scenario-10.log (console trace) 
alice writes M1 content=d-9ef915befce444ac8b77e94571b7b447 on node-1
  created memory id=e0902f62-b8c8-4e45-bbf1-4d034be21879
settle 8s for pre-delete fanout
pre-delete: verifying M1 is visible on all peers
  pre-delete node-2 sees 1
  pre-delete node-3 sees 1
  pre-delete node-4 sees 1
alice deletes M1 on node-1
  DELETE returned HTTP 200
settle 15s for tombstone propagation
post-delete: verifying M1 is GONE from all peers
  post-delete node-2 sees 0 (expected 0)
  post-delete node-3 sees 0 (expected 0)
  post-delete node-4 sees 0 (expected 0)

raw file

Scenario 11 — Link integrity PASS

scenario-11.json (report) 
{
	"agent_group": "openclaw",
	"charlie_sees_link": 1,
	"link_http_code": 201,
	"m1_id": "81b2f6e6-c678-4d78-9d13-c69587dc9916",
	"m2_id": "c75870bc-d8f2-4efd-9030-65039a972da1",
	"pass": true,
	"reasons": [],
	"relation": "related_to",
	"scenario": "11",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-11.log (console trace) 
alice writes M1 on node-1
bob writes M2 on node-2
  M1=81b2f6e6-c678-4d78-9d13-c69587dc9916 M2=c75870bc-d8f2-4efd-9030-65039a972da1
settle 5s for pre-link replication
alice links M1 -> M2 with relation=related_to
  link POST returned HTTP 201
settle 8s for link fanout
charlie queries links of M1 on node-3
  charlie sees M1->M2 link: 1 (expected >=1)

raw file

Scenario 12 — Agent registration PASS

scenario-12.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"peers_see": {
		"node_2": 1,
		"node_3": 1,
		"node_4": 1
	},
	"reasons": [],
	"register_http_code": 201,
	"registered_agent": "ai:dave-probe-0e00192b",
	"scenario": "12",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-12.log (console trace) 
alice registers new agent ai:dave-probe-0e00192b on node-1
  POST /api/v1/agents returned HTTP 201
settle 10s for agent-list fanout
  node-2 sees ai:dave-probe-0e00192b: 1 (expected >=1)
  node-3 sees ai:dave-probe-0e00192b: 1 (expected >=1)
  node-4 sees ai:dave-probe-0e00192b: 1 (expected >=1)

raw file

Scenario 13 — Concurrent write contention PASS

scenario-13.json (report) 
{
	"agent_group": "openclaw",
	"m1_id": "cd8a3dd1-7e25-402d-bab0-60a7df9fff71",
	"pass": true,
	"peer_view": {
		"node_1": "vb-4ef85656121144f4a7f6140a8a7fd282",
		"node_2": "vb-4ef85656121144f4a7f6140a8a7fd282",
		"node_3": "vb-4ef85656121144f4a7f6140a8a7fd282",
		"node_4": "vb-4ef85656121144f4a7f6140a8a7fd282"
	},
	"reasons": [],
	"scenario": "13",
	"skipped": false,
	"submitted": {
		"v0": "v0-1de5f441210849e9b6f3da857843aafb",
		"vA_alice": "va-20e530166c2f40e0b17bfb1b8de19bfa",
		"vB_bob": "vb-4ef85656121144f4a7f6140a8a7fd282"
	},
	"tls_mode": "off"
}

raw file

scenario-13.log (console trace) 
alice writes M1 content=v0-1de5f441210849e9b6f3da857843aafb on node-1
  M1 id=cd8a3dd1-7e25-402d-bab0-60a7df9fff71
settle 5s for initial replication
alice + bob issue concurrent PUTs (vA=va-20e530166c2f40e0b17bfb1b8de19bfa from alice, vB=vb-4ef85656121144f4a7f6140a8a7fd282 from bob)
  concurrent PUT results: [(0, {'body': {'access_count': 0, 'confidence': 1.0, 'content': 'va-20e530166c2f40e0b17bfb1b8de19bfa', 'created_at': '2026-05-04T04:08:20.170162542+00:00', 'expires_at': '2026-05-11T04:08:20.170162542+00:00', 'id': 'cd8a3dd1-7e25-402d-bab0-60a7df9fff71', 'metadata': {'agent_id': 'ai:alice', 'scenario': '13'}, 'namespace': 'scenario13-contention', 'priority': 5, 'source': 'api', 'tags': [], 'tier': 'mid', 'title': 'm1', 'updated_at': '2026-05-04T04:08:25.301221987+00:00'}, 'http_code': 200}), (0, {'body': {'access_count': 0, 'confidence': 1.0, 'content': 'vb-4ef85656121144f4a7f6140a8a7fd282', 'created_at': '2026-05-04T04:08:20.170162542+00:00', 'expires_at': '2026-05-11T04:08:20.170162542+00:00', 'id': 'cd8a3dd1-7e25-402d-bab0-60a7df9fff71', 'metadata': {'agent_id': 'ai:alice', 'scenario': '13'}, 'namespace': 'scenario13-contention', 'priority': 5, 'source': 'api', 'tags': [], 'tier': 'mid', 'title': 'm1', 'updated_at': '2026-05-04T04:08:25.301264391+00:00'}, 'http_code': 200})]
settle 10s for quorum convergence
  node-1 sees content=vb-4ef85656121144f4a7f6140a8a7fd282
  node-2 sees content=vb-4ef85656121144f4a7f6140a8a7fd282
  node-3 sees content=vb-4ef85656121144f4a7f6140a8a7fd282
  node-4 sees content=vb-4ef85656121144f4a7f6140a8a7fd282

raw file

Scenario 14 — Partition tolerance PASS

scenario-14.json (report) 
{
	"agent_group": "openclaw",
	"expected_post_recovery": 20,
	"node3_saw": 20,
	"partition_target": "node-3",
	"pass": true,
	"reasons": [],
	"scenario": "14",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-14.log (console trace) 
suspending ai-memory on node-3 (SIGSTOP)
  !! ssh timeout (15s): -c pgrep -f 'ai-memory serve' | xargs -r kill -STOP
settle 2s for process-suspend observe
writing 10 memories each from alice + bob during node-3 outage
resuming ai-memory on node-3 (SIGCONT)
settle 20s for post-partition catchup
checking node-3 caught up
  node-3 sees 20 memories in scenario14-partition (expected 20)

raw file

Scenario 15 — Read-your-writes PASS

scenario-15.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"reasons": [],
	"scenario": "15",
	"skipped": false,
	"tls_mode": "off",
	"uuid": "ryw-e5efed74412244819e185514501915cf",
	"writer_sees_own_write": 1
}

raw file

scenario-15.log (console trace) 
alice writes + immediately reads M1 on node-1 (uuid=ryw-e5efed74412244819e185514501915cf)
  alice sees 1 (expected 1) immediately after write

raw file

Scenario 16 — Tier promotion PASS

scenario-16.json (report) 
{
	"agent_group": "openclaw",
	"bob_sees_tier": "long",
	"m1_id": "d89c75c4-3ec8-4f87-ada8-fa9e11c8a102",
	"pass": true,
	"promote_http_code": 200,
	"reasons": [],
	"scenario": "16",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-16.log (console trace) 
alice writes M1 tier=short on node-1
  M1 id=d89c75c4-3ec8-4f87-ada8-fa9e11c8a102
settle 5s for pre-promote replication
alice promotes M1 to tier=long
  promote returned HTTP 200
settle 8s for promotion fanout
  bob sees tier=long (expected long)

raw file

Scenario 17 — Stats consistency PASS

scenario-17.json (report) 
{
	"agent_group": "openclaw",
	"expected_count": 15,
	"pass": true,
	"per_peer": {
		"node_1": 15,
		"node_2": 15,
		"node_3": 15,
		"node_4": 15
	},
	"reasons": [],
	"scenario": "17",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-17.log (console trace) 
phase A: each of 3 agents writes 5 memories to scenario17-stats
  ai:alice on a2a-node-1
  ai:bob on a2a-node-2
  ai:charlie on a2a-node-3
settle 15s for W=2 fanout
phase B: querying count on every peer
  node-1 count=15 (expected 15)
  node-2 count=15 (expected 15)
  node-3 count=15 (expected 15)
  node-4 count=15 (expected 15)

raw file

Scenario 18 — Semantic query expansion PASS

scenario-18.json (report) 
{
	"agent_group": "openclaw",
	"diag_list_alice_present": 1,
	"diag_list_bob_present": 1,
	"diag_node3_embedding_probe": "dawn-walk|1537|BYTES | ridge-strides|1537|BYTES",
	"pass": true,
	"query": "morning outdoor exercise routine",
	"reasons": [],
	"recall_mode": "hybrid",
	"rows_in_recall": 2,
	"scenario": "18",
	"skipped": false,
	"tls_mode": "off",
	"writers": [
		{
			"agent": "ai:alice",
			"marker": "alice-sunrise-f81f7c10",
			"seen_by_charlie": 1
		},
		{
			"agent": "ai:bob",
			"marker": "bob-daybreak-e77ac068",
			"seen_by_charlie": 1
		}
	]
}

raw file

scenario-18.log (console trace) 
alice writes A on node-1
bob writes B on node-2
polling node-3 for both writes to propagate (max 30 s)
  both writes visible after 1 s
settle 3s for embedder + HNSW catch-up
  node-3 DB embedding probe: 'dawn-walk|1537|BYTES | ridge-strides|1537|BYTES'
charlie queries on node-3 with semantically-related prompt
  recall mode=hybrid returned 2 rows
  charlie sees alice's memory: 1 (expected >=1)
  charlie sees bob's memory: 1 (expected >=1)

raw file

Scenario 22 — Identity spoofing resistance PASS

scenario-22.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"reasons": [],
	"scenario": "22",
	"skipped": false,
	"tests": {
		"body_vs_header_conflict": {
			"acceptable": [
				"ai:body-wins",
				"ai:attacker"
			],
			"stored_agent_id": "ai:attacker"
		},
		"header_only": {
			"expected": "ai:alice",
			"stored_agent_id": "ai:alice"
		}
	},
	"tls_mode": "off"
}

raw file

scenario-22.log (console trace) 
test 1: header-only X-Agent-Id=ai:alice
settle 2s for read-settle
  stored metadata.agent_id for header-only write: ai:alice (expected ai:alice)
test 2: body.metadata.agent_id=ai:body-wins vs X-Agent-Id=ai:attacker
settle 2s for read-settle
  stored metadata.agent_id for body+header conflict: ai:attacker

raw file

Scenario 23 — Malicious content fuzz PASS

scenario-23.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"payloads": {
		"html": {
			"input_bytes": 66,
			"roundtrip_bytes": 66,
			"write_http": 201
		},
		"oversize": {
			"input_bytes": 1048576,
			"roundtrip_bytes": 0,
			"write_http": 400
		},
		"sql": {
			"input_bytes": 61,
			"roundtrip_bytes": 61,
			"write_http": 201
		},
		"unicode": {
			"input_bytes": 19,
			"roundtrip_bytes": 19,
			"write_http": 201
		}
	},
	"payloads_note": "accept+faithful OR 4xx reject both acceptable for oversize",
	"reasons": [],
	"scenario": "23",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-23.log (console trace) 
payload sql: 61 bytes
payload html: 66 bytes
payload oversize: 1048576 bytes
  oversize: server rejected oversize with HTTP 400 (acceptable)
payload unicode: 19 bytes

raw file

Scenario 24 — Byzantine peer PASS

scenario-24.json (report) 
{
	"agent_group": "openclaw",
	"byzantine_marker": "bz-2ad1969a77044c338d52eb7364ebd592",
	"pass": true,
	"reasons": [],
	"scenario": "24",
	"skipped": false,
	"stored_metadata_agent_id": "REJECTED_BY_SERVER",
	"sync_push_http_code": "422",
	"tls_mode": "off"
}

raw file

scenario-24.log (console trace) 
node-2 sends sync_push to node-3 claiming sender_agent_id=ai:alice
  sync_push returned HTTP 422
settle 5s for server-side sync apply
  node-3 stored metadata.agent_id=ABSENT (declared: ai:alice)
  sync_push rejected HTTP 422 — stricter-than-spec, acceptable

raw file

Scenario 25 — Clock skew tolerance PASS

scenario-25.json (report) 
{
	"agent_group": "openclaw",
	"clock_offset_seconds": 300,
	"marker": "ck-b7fce37c63a04a6ca9a5548dfba2e740",
	"pass": true,
	"reasons": [],
	"scenario": "25",
	"seen_on": {
		"node_1": 1,
		"node_3": 1
	},
	"skipped": false,
	"target_node": "node-3",
	"tls_mode": "off"
}

raw file

scenario-25.log (console trace) 
shifting node-3 clock +300s (NTP disabled for the duration)
  node-3 now reports: Mon May  4 04:10:02 UTC 2026
alice writes on node-1 (normal clock); waiting for quorum fanout to skewed node-3
settle 15s for skewed-peer convergence
  node-3 (+300s clock) sees marker: 1 (expected >=1)
  node-1 sees marker: 1 (expected >=1)
reverting node-3 clock

raw file

Scenario 28 — memory_search keyword PASS

scenario-28.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"peer_hits": {
		"node_2": 1,
		"node_3": 1
	},
	"reasons": [],
	"scenario": "28",
	"skipped": false,
	"tls_mode": "off",
	"token": "kwsearchd481e60da2"
}

raw file

scenario-28.log (console trace) 
alice writes a row containing unique token=kwsearchd481e60da2
settle 8s for search index populate + fanout
bob + charlie call /api/v1/search with the exact token
  node-2 keyword search returned 1 hits
  node-3 keyword search returned 1 hits

raw file

Scenario 29 — memory_archive lifecycle PASS

scenario-29.json (report) 
{
	"agent_group": "openclaw",
	"archive_http_code": 200,
	"bob_sees_archived": true,
	"m1_id": "f2e84416-a5ee-447c-8bb4-31605649a1f5",
	"node4_active_rows": 1,
	"pass": true,
	"reasons": [],
	"restore_http_code": 200,
	"scenario": "29",
	"skipped": false,
	"stats_shape_ok": true,
	"tls_mode": "off"
}

raw file

scenario-29.log (console trace) 
alice writes M1 on node-1
  M1 id=f2e84416-a5ee-447c-8bb4-31605649a1f5
settle 5s for pre-archive replication
alice archives M1 via POST /api/v1/archive (ai-memory-mcp PR #361)
  archive (POST) returned HTTP 200
settle 5s for archive propagation
bob queries /api/v1/archive on node-2
  bob sees M1 in archive: True
charlie restores M1 via /api/v1/archive/{id}/restore on node-3
  restore returned HTTP 200
settle 5s for restore propagation
node-4 aggregator: M1 must be active again
  node-4 active rows matching marker: 1
fetch /api/v1/archive/stats on node-4

raw file

Scenario 30 — memory_capabilities handshake PASS

scenario-30.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"peer_views": {
		"node_1": {
			"_path": "/api/v1/capabilities",
			"approval": {
				"pending_requests": 0
			},
			"compaction": {
				"enabled": false,
				"planned": true,
				"version": "v0.8+"
			},
			"features": {
				"auto_consolidation": false,
				"auto_tagging": false,
				"contradiction_analysis": false,
				"cross_encoder_reranking": false,
				"embedder_loaded": true,
				"hybrid_recall": true,
				"keyword_search": true,
				"memory_reflection": {
					"enabled": false,
					"planned": true,
					"version": "v0.7+"
				},
				"query_expansion": false,
				"recall_mode_active": "hybrid",
				"reranker_active": "off",
				"semantic_search": true
			},
			"hnsw": {
				"evicted_recently": false,
				"evictions_total": 0
			},
			"hooks": {
				"registered_count": 0,
				"webhook_events": [
					"memory_store",
					"memory_promote",
					"memory_delete",
					"memory_link_created",
					"memory_consolidated"
				]
			},
			"models": {
				"cross_encoder": "none",
				"embedding": "sentence-transformers/all-MiniLM-L6-v2",
				"embedding_dim": 384,
				"llm": "none"
			},
			"permissions": {
				"active_rules": 0,
				"inheritance": "enforced",
				"mode": "advisory"
			},
			"schema_version": "2",
			"tier": "semantic",
			"transcripts": {
				"enabled": false,
				"planned": true,
				"version": "v0.7+"
			},
			"version": "0.6.3+patch.1"
		},
		"node_2": {
			"_path": "/api/v1/capabilities",
			"approval": {
				"pending_requests": 0
			},
			"compaction": {
				"enabled": false,
				"planned": true,
				"version": "v0.8+"
			},
			"features": {
				"auto_consolidation": false,
				"auto_tagging": false,
				"contradiction_analysis": false,
				"cross_encoder_reranking": false,
				"embedder_loaded": true,
				"hybrid_recall": true,
				"keyword_search": true,
				"memory_reflection": {
					"enabled": false,
					"planned": true,
					"version": "v0.7+"
				},
				"query_expansion": false,
				"recall_mode_active": "hybrid",
				"reranker_active": "off",
				"semantic_search": true
			},
			"hnsw": {
				"evicted_recently": false,
				"evictions_total": 0
			},
			"hooks": {
				"registered_count": 0,
				"webhook_events": [
					"memory_store",
					"memory_promote",
					"memory_delete",
					"memory_link_created",
					"memory_consolidated"
				]
			},
			"models": {
				"cross_encoder": "none",
				"embedding": "sentence-transformers/all-MiniLM-L6-v2",
				"embedding_dim": 384,
				"llm": "none"
			},
			"permissions": {
				"active_rules": 0,
				"inheritance": "enforced",
				"mode": "advisory"
			},
			"schema_version": "2",
			"tier": "semantic",
			"transcripts": {
				"enabled": false,
				"planned": true,
				"version": "v0.7+"
			},
			"version": "0.6.3+patch.1"
		},
		"node_3": {
			"_path": "/api/v1/capabilities",
			"approval": {
				"pending_requests": 0
			},
			"compaction": {
				"enabled": false,
				"planned": true,
				"version": "v0.8+"
			},
			"features": {
				"auto_consolidation": false,
				"auto_tagging": false,
				"contradiction_analysis": false,
				"cross_encoder_reranking": false,
				"embedder_loaded": true,
				"hybrid_recall": true,
				"keyword_search": true,
				"memory_reflection": {
					"enabled": false,
					"planned": true,
					"version": "v0.7+"
				},
				"query_expansion": false,
				"recall_mode_active": "hybrid",
				"reranker_active": "off",
				"semantic_search": true
			},
			"hnsw": {
				"evicted_recently": false,
				"evictions_total": 0
			},
			"hooks": {
				"registered_count": 0,
				"webhook_events": [
					"memory_store",
					"memory_promote",
					"memory_delete",
					"memory_link_created",
					"memory_consolidated"
				]
			},
			"models": {
				"cross_encoder": "none",
				"embedding": "sentence-transformers/all-MiniLM-L6-v2",
				"embedding_dim": 384,
				"llm": "none"
			},
			"permissions": {
				"active_rules": 0,
				"inheritance": "enforced",
				"mode": "advisory"
			},
			"schema_version": "2",
			"tier": "semantic",
			"transcripts": {
				"enabled": false,
				"planned": true,
				"version": "v0.7+"
			},
			"version": "0.6.3+patch.1"
		},
		"node_4": {
			"_path": "/api/v1/capabilities",
			"approval": {
				"pending_requests": 0
			},
			"compaction": {
				"enabled": false,
				"planned": true,
				"version": "v0.8+"
			},
			"features": {
				"auto_consolidation": false,
				"auto_tagging": false,
				"contradiction_analysis": false,
				"cross_encoder_reranking": false,
				"embedder_loaded": true,
				"hybrid_recall": true,
				"keyword_search": true,
				"memory_reflection": {
					"enabled": false,
					"planned": true,
					"version": "v0.7+"
				},
				"query_expansion": false,
				"recall_mode_active": "hybrid",
				"reranker_active": "off",
				"semantic_search": true
			},
			"hnsw": {
				"evicted_recently": false,
				"evictions_total": 0
			},
			"hooks": {
				"registered_count": 0,
				"webhook_events": [
					"memory_store",
					"memory_promote",
					"memory_delete",
					"memory_link_created",
					"memory_consolidated"
				]
			},
			"models": {
				"cross_encoder": "none",
				"embedding": "sentence-transformers/all-MiniLM-L6-v2",
				"embedding_dim": 384,
				"llm": "none"
			},
			"permissions": {
				"active_rules": 0,
				"inheritance": "enforced",
				"mode": "advisory"
			},
			"schema_version": "2",
			"tier": "semantic",
			"transcripts": {
				"enabled": false,
				"planned": true,
				"version": "v0.7+"
			},
			"version": "0.6.3+patch.1"
		}
	},
	"reasons": [],
	"scenario": "30",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-30.log (console trace) 
  node-1 capabilities: ['approval', 'compaction', 'features', 'hnsw', 'hooks', 'models', 'permissions', 'schema_version', 'tier', 'transcripts', 'version', '_path']
  node-2 capabilities: ['approval', 'compaction', 'features', 'hnsw', 'hooks', 'models', 'permissions', 'schema_version', 'tier', 'transcripts', 'version', '_path']
  node-3 capabilities: ['approval', 'compaction', 'features', 'hnsw', 'hooks', 'models', 'permissions', 'schema_version', 'tier', 'transcripts', 'version', '_path']
  node-4 capabilities: ['approval', 'compaction', 'features', 'hnsw', 'hooks', 'models', 'permissions', 'schema_version', 'tier', 'transcripts', 'version', '_path']

raw file

Scenario 31 — memory_gc quiescence PASS

scenario-31.json (report) 
{
	"agent_group": "openclaw",
	"expected_live": 2,
	"forget_http_code": 400,
	"gc_http_code": 200,
	"live_markers_per_peer": {
		"node_1": 2,
		"node_2": 2,
		"node_3": 2,
		"node_4": 2
	},
	"pass": true,
	"reasons": [],
	"scenario": "31",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-31.log (console trace) 
alice writes 4 memories
settle 6s for pre-gc replication
alice forgets 2 via /api/v1/forget
  forget returned HTTP 400
settle 5s for forget propagation
bob triggers /api/v1/gc on node-2
  gc returned HTTP 200
settle 8s for post-gc settle
verify remaining 2 markers are still readable on every peer
  node-1 sees 2/2 live markers
  node-2 sees 2/2 live markers
  node-3 sees 2/2 live markers
  node-4 sees 2/2 live markers

raw file

Scenario 32 — memory_inbox + notify PASS

scenario-32.json (report) 
{
	"agent_group": "openclaw",
	"bob_inbox_count": 1,
	"bob_sees_marker": true,
	"charlie_inbox_count": 0,
	"charlie_sees_marker": false,
	"marker": "inb-e55e5aa786614b09a5f9b902ab057ff1",
	"notify_http_code": 201,
	"pass": true,
	"reasons": [],
	"scenario": "32",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-32.log (console trace) 
alice calls /api/v1/notify → target=ai:bob
  notify returned HTTP 201
settle 6s for notification fanout
bob queries his inbox on node-2
  bob inbox has 1 messages; sees marker: True
charlie queries his inbox on node-3 (must NOT see it)
  charlie inbox has 0 messages; sees marker: False

raw file

Scenario 33 — memory_subscribe pub/sub PASS

scenario-33.json (report) 
{
	"agent_group": "openclaw",
	"m1_delivered": 1,
	"namespace": "scenario33-pubsub-f3a678",
	"ns_in_subs_after": false,
	"ns_in_subs_before": true,
	"pass": true,
	"reasons": [],
	"scenario": "33",
	"skipped": false,
	"subscribe_http_code": 201,
	"subscriptions_after_count": 0,
	"subscriptions_before_count": 1,
	"tls_mode": "off",
	"unsubscribe_http_code": 200
}

raw file

scenario-33.log (console trace) 
bob subscribes to namespace scenario33-pubsub-f3a678 on node-2
  subscribe returned HTTP 201
settle 2s for subscription settle
  bob subscriptions: 1 entries; contains ns: True
alice writes M1 into the subscribed namespace
settle 6s for write fanout to subscribers
  bob sees M1 in subscribed namespace: 1
bob unsubscribes from scenario33-pubsub-f3a678
  unsubscribe returned HTTP 200
settle 2s for unsubscribe settle
  bob subscriptions after unsubscribe: ns still present = False
alice writes M2 post-unsubscribe (may still replicate via federation but subscription list excludes ns)
settle 5s for post-unsubscribe settle

raw file

Scenario 34 — memory_pending governance PASS

scenario-34.json (report) 
{
	"agent_group": "openclaw",
	"approve_http_code": 200,
	"charlie_sees": {
		"approved": 1,
		"rejected": 0
	},
	"namespace": "scenario34-pending-ea16c3",
	"pass": true,
	"pending_queue_count": 2,
	"reasons": [],
	"reject_http_code": 200,
	"scenario": "34",
	"set_standard_http_code": 201,
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-34.log (console trace) 
alice sets namespace standard on scenario34-pending-ea16c3: write=approve, approver=ai:bob
  set-standard returned HTTP 201
settle 2s for standard settle
alice writes two memories into the governed namespace (should land in pending)
  p1=fcbdc253-bd9a-46ec-933e-b2e2f434ab7f p2=439b5366-ea1b-4b95-a68b-20011a6f5d63
settle 4s for pending queue settle
bob lists pending on node-2
  pending queue has 2 entries
bob approves p1, rejects p2
  approve HTTP 200; reject HTTP 200
settle 5s for decision fanout
charlie reads the namespace — expects ONLY approved marker
  charlie sees approved=1 rejected=0

raw file

Scenario 35 — memory_namespace standards PASS

scenario-35.json (report) 
{
	"agent_group": "openclaw",
	"child_ns": "scenario35-parent-8a3168/child",
	"clear_http_code": 200,
	"get_standard_http_code": 200,
	"parent_ns": "scenario35-parent-8a3168",
	"pass": true,
	"post_clear_has_child_rule": false,
	"reasons": [],
	"scenario": "35",
	"sees_child_rule": true,
	"sees_parent_rule": true,
	"set_child_http_code": 201,
	"set_parent_http_code": 201,
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-35.log (console trace) 
alice writes parent-standard-memory on node-1
alice sets namespace standard on scenario35-parent-8a3168
  set-parent returned HTTP 201
alice writes child-standard-memory on node-1
alice sets namespace standard on scenario35-parent-8a3168/child with parent=scenario35-parent-8a3168
  set-child returned HTTP 201
settle 4s for standard fanout
bob gets standard for scenario35-parent-8a3168/child on node-2 (expects layered parent+child)
  get-standard returned HTTP 200
  parent-rule visible=True; child-rule visible=True
alice clears standard on scenario35-parent-8a3168/child
  clear returned HTTP 200
settle 3s for clear settle

raw file

Scenario 36 — memory_session_start PASS

scenario-36.json (report) 
{
	"agent_group": "openclaw",
	"pass": true,
	"reasons": [],
	"scenario": "36",
	"session_id": "7b1f3156-504a-4aba-a4a1-ecd70ee5edde",
	"session_tagged_rows_on_bob": 2,
	"skipped": false,
	"start_http_code": 200,
	"tls_mode": "off"
}

raw file

scenario-36.log (console trace) 
alice starts a session on node-1
  session_start returned HTTP 200, session_id=7b1f3156-504a-4aba-a4a1-ecd70ee5edde
alice writes 2 memories tagged with session_id
settle 6s for session-tagged fanout
bob lists on node-2 filtered by session_id=7b1f3156-504a-4aba-a4a1-ecd70ee5edde
  bob sees 2 rows tagged session_id=7b1f3156-504a-4aba-a4a1-ecd70ee5edde (expected 2)

raw file

Scenario 37 — memory_get_links bidirectional PASS

scenario-37.json (report) 
{
	"agent_group": "openclaw",
	"forward_has_target": true,
	"m1": "1c0dd695-84f1-4947-8e69-524aa0f3981e",
	"m2": "b817af09-becd-407d-a45e-41f823ea9c2d",
	"pass": true,
	"reasons": [],
	"reverse_has_source": true,
	"scenario": "37",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-37.log (console trace) 
alice writes M1 + M2 + links M1→M2
  M1=1c0dd695-84f1-4947-8e69-524aa0f3981e M2=b817af09-becd-407d-a45e-41f823ea9c2d
settle 6s for link fanout
charlie queries /api/v1/links/M1 (forward)
charlie queries /api/v1/links/M2 (reverse)

raw file

Scenario 38 — /export + /import PASS

scenario-38.json (report) 
{
	"agent_group": "openclaw",
	"dst_ns": "scenario38-dst-73c365",
	"expected_rows": 5,
	"export_http_code": 200,
	"import_http_code": 200,
	"markers_preserved": 5,
	"pass": true,
	"reasons": [],
	"rows_exported": 5,
	"rows_in_destination": 5,
	"scenario": "38",
	"skipped": false,
	"src_ns": "scenario38-src-73c365",
	"tls_mode": "off"
}

raw file

scenario-38.log (console trace) 
alice writes 5 rows into scenario38-src-73c365
settle 4s for pre-export replication
alice exports on node-1 (endpoint has no namespace filter; filter client-side)
  export returned HTTP 200, total_rows=229
  rewrote 5 memories from scenario38-src-73c365 -> scenario38-dst-73c365
bob imports the payload into scenario38-dst-73c365 on node-2
  import returned HTTP 200
settle 6s for import + fanout
verify row counts match on destination
  scenario38-dst-73c365 has 5 rows (expected 5)
  markers preserved in destination: 5/5

raw file

Scenario 39 — /sync/since delta PASS

scenario-39.json (report) 
{
	"agent_group": "openclaw",
	"checkpoint": "2026-05-04T04:12:10+00:00",
	"diag_curl_body_head": "{\"count\":6,\"earliest_updated_at\":\"2026-05-04T04:12:42.374151689+00:00\",\"latest_updated_at\":\"2026-05-04T04:12:43.123837218+00:00\",\"limit\":500,\"memories\":[{\"access_count\":0,\"confidence\":1.0,\"content\":\"marker=delta-0-1ca34ae90d854551b77a4326c12530f2\",\"created_at\":\"2026-05-04T04:12:42.374151689+00:00\",\"",
	"diag_curl_exit": 0,
	"diag_curl_http_code": 200,
	"diag_curl_stderr": "",
	"diag_earliest_updated_at": "2026-05-04T04:12:42.374151689+00:00",
	"diag_latest_updated_at": "2026-05-04T04:12:43.123837218+00:00",
	"diag_node3_health_reachable": true,
	"diag_updated_since": "2026-05-04T04:12:10+00:00",
	"expected_markers": 6,
	"markers_present": 6,
	"namespace": "scenario39-delta-47b8ec",
	"pass": true,
	"reasons": [],
	"rows_returned": 6,
	"rows_returned_raw": 6,
	"scenario": "39",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-39.log (console trace) 
checkpoint = 2026-05-04T04:12:10+00:00
suspending ai-memory on node-3
  !! ssh timeout (30s): -c pgrep -f 'ai-memory serve' | xargs -r kill -STOP
alice + bob write 6 rows while node-3 is out
resuming ai-memory on node-3
settle 15s for process resume + federation catchup
  node-3 → node-1 health reachable: True (after 1 probes)
node-3 asks node-1 /api/v1/sync/since?since=2026-05-04T04:12:10+00:00
  curl exit=0 http_code=200 body_len=2898 stderr=''
  /sync/since raw=6 ns-filtered=6; 6/6 match our markers
  diag: updated_since=2026-05-04T04:12:10+00:00 earliest=2026-05-04T04:12:42.374151689+00:00 latest=2026-05-04T04:12:43.123837218+00:00

raw file

Scenario 40 — /memories/bulk PASS

scenario-40.json (report) 
{
	"agent_group": "openclaw",
	"bulk_http_code": "200",
	"bulk_size": 500,
	"namespace": "scenario40-bulk-dd0526",
	"pass": true,
	"per_peer_count": {
		"node_2": 500,
		"node_3": 500,
		"node_4": 500
	},
	"reasons": [],
	"scenario": "40",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-40.log (console trace) 
constructing 500-row bulk payload
staging bulk payload on node-1 /tmp, then POST /api/v1/memories/bulk
  bulk POST returned HTTP 200
settle 20s for bulk fanout across 3 peers + aggregator
  node-2 count=500 (expected 500)
  node-3 count=500 (expected 500)
  node-4 count=500 (expected 500)

raw file

Scenario 41 — /metrics Prometheus PASS

scenario-41.json (report) 
{
	"activity_namespace": "scenario41-activity-c1cdca",
	"agent_group": "openclaw",
	"pass": true,
	"per_peer": {
		"node_1": {
			"counters_t0": 8,
			"counters_t1": 8,
			"regressed_keys": 0
		},
		"node_2": {
			"counters_t0": 8,
			"counters_t1": 8,
			"regressed_keys": 0
		},
		"node_3": {
			"counters_t0": 7,
			"counters_t1": 7,
			"regressed_keys": 0
		}
	},
	"reasons": [],
	"scenario": "41",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-41.log (console trace) 
scrape T0
  node-1 T0 parsed 8 memory counters
  node-2 T0 parsed 8 memory counters
  node-3 T0 parsed 7 memory counters
settle 5s for counter update
scrape T1
  node-1 T1 parsed 8 memory counters
  node-2 T1 parsed 8 memory counters
  node-3 T1 parsed 7 memory counters

raw file

Scenario 42 — /namespaces enumeration PASS

scenario-42.json (report) 
{
	"agent_group": "openclaw",
	"namespaces": [
		"scenario42-11c6f4-0",
		"scenario42-11c6f4-1",
		"scenario42-11c6f4-2"
	],
	"pass": true,
	"per_peer": {
		"node_1": {
			"scenario42-11c6f4-0": 2,
			"scenario42-11c6f4-1": 2,
			"scenario42-11c6f4-2": 2
		},
		"node_2": {
			"scenario42-11c6f4-0": 2,
			"scenario42-11c6f4-1": 2,
			"scenario42-11c6f4-2": 2
		},
		"node_3": {
			"scenario42-11c6f4-0": 2,
			"scenario42-11c6f4-1": 2,
			"scenario42-11c6f4-2": 2
		},
		"node_4": {
			"scenario42-11c6f4-0": 2,
			"scenario42-11c6f4-1": 2,
			"scenario42-11c6f4-2": 2
		}
	},
	"reasons": [],
	"scenario": "42",
	"skipped": false,
	"tls_mode": "off"
}

raw file

scenario-42.log (console trace) 
alice writes into 3 distinct namespaces: ['scenario42-11c6f4-0', 'scenario42-11c6f4-1', 'scenario42-11c6f4-2']
settle 10s for namespace index fanout
  node-1 sees 3/3 target namespaces, counts: {'scenario42-11c6f4-0': 2, 'scenario42-11c6f4-1': 2, 'scenario42-11c6f4-2': 2}
  node-2 sees 3/3 target namespaces, counts: {'scenario42-11c6f4-0': 2, 'scenario42-11c6f4-1': 2, 'scenario42-11c6f4-2': 2}
  node-3 sees 3/3 target namespaces, counts: {'scenario42-11c6f4-0': 2, 'scenario42-11c6f4-1': 2, 'scenario42-11c6f4-2': 2}
  node-4 sees 3/3 target namespaces, counts: {'scenario42-11c6f4-0': 2, 'scenario42-11c6f4-1': 2, 'scenario42-11c6f4-2': 2}

raw file

All artifacts