ai-memory v1.0.0 — Test Results & Reproducibility

Certification & acceptance evidence for the AI-agent endpoint-memory substrate. Every result below is reproducible from the commands given; this page is the living record and reaches all-green before the v1.0.0 tag is cut.

◆ Data integrity● Security▲ Performance■ Reliability

Release tip 9b84c2a8 · certified triple PostgreSQL 18.6 / Apache AGE 1.8.0 / sqlx 0.8.6 · ENTERPRISE_FEDERATION_CHECK_COUNT=20 · repo alphaonedev/ai-memory-mcp

1 · Methodology — adversarially engineered, not vibe-coded

Built by a structured organization of AI agents with an enforced separation of powers: the agent that writes code is never the one that reviews it, and never the one that merges it. A single conductor decomposes work, dispatches it, performs code + security review, and is the only actor permitted to merge (signed, branch-protection re-armed, verify-at-tip). Coders work in isolated worktrees, each loading the Rust-1.98 engineering standard and the CodeGraph index before touching a file. A GLM-5.3-Flash swarm (via OpenRouter) is a pure verification workload — it never writes product code. Judgment calls go to a 3×7 adversarial vote (7 lenses × 3 rounds). Full methodology: How ai-memory Is Built.

2 · Infrastructure under test

Hardware data tiers (native)

f2 — Linux, 93 GB RAM · cert pg+AGE+pgvector :15432 (reference module)
f1 — macOS, 32 GB RAM · cert pg+AGE+pgvector :5445 (smaller-module baseline)

Cloud data tier

DigitalOcean — the certified enterprise-federation stack on droplets; minimal footprint: DO hosts only the data tier, the GLM NHIs are OpenRouter API calls driven off-DO. Provisioned via infra/do-hive/ Terraform.

Encryption in transit (mandatory)

All communications encrypted, as customers deploy: mTLS federation + agent→daemon HTTPS (fingerprint-pinned client certs) + PostgreSQL sslmode=verify-full. At-rest: LUKS (kernel) on the encrypted config; per-record crypto-erase.

Test swarm/hive

GLM-5.3-Flash (z-ai/glm-5.3-flash via OpenRouter) — N lightweight NHIs, each with its own Ed25519 key, namespace-confined + fail-closed. Executes only Fable-authored scenarios; emits a coverage matrix + structured JSON. GLM-5.3-Flash executes tests only — it never writes code, submits PRs, or touches the codebase.

ai-memory configuration under test — mirrored on every agent

Every node and agent wired into ai-memory runs the byte-identical fleet-standard TOML below (only db and key-file paths differ per node). All traffic routes through OpenRouter; Ollama is not used on any node. The embedder gemini-embedding-001 and gemini-embedding-2 were verified to be orthogonal vector spaces (cosine 0.06); the fleet standardizes on gemini-embedding-2 so every node shares one space. The reflection LLM gemini-3.7-flash was verified reflection-capable (valid structured JSON, correct contradiction detection).

tier = "autonomous"
db   = "<node>/.claude/ai-memory.db"          # node-specific

[embeddings]
backend      = "openrouter"
model        = "google/gemini-embedding-2"    # 3072 native -> 768 (Matryoshka)
dim          = 768                            # matches pgvector(768)
base_url     = "https://openrouter.ai/api/v1"
api_key_file = "<node>/openrouter-api.key"    # node-specific

[llm]
backend      = "openrouter"
base_url     = "https://openrouter.ai/api/v1"
model        = "google/gemini-3.7-flash"      # reflection/consolidate

[reranker]
enabled = true
model   = "ms-marco-MiniLM-L-6-v2"

[mcp]
profile = "full"

[storage]
default_namespace = "global"
max_memory_mb     = 4096

Starting condition — Atlas Corpus pre-loaded

The swarm/hive does not start from an empty store. Both nodes carry the Atlas Corpus — 7,912 copyright-clean memories (namespace atlas-corpus; kinds: 4,212 claim + 3,700 concept; sha256 b0b61fa5…, pinned in deploy/do-1461/atlas/CORPUS_MANIFEST.json for reproducibility) plus accumulated working memories — f1 ≈ 25.5k, f2 ≈ 10k+, so testing reflects a real-world memory volume (tens of thousands) rather than a cold store.

3 · Results dashboard

Status legend: GREEN measured & passing · PENDING in the running campaign · honest by design — nothing is marked green until it is measured.

Code & certification gates

GateStatusEvidence / reproduce
CI on release tip 9b84c2a8GREEN51 checks pass, 0 fail (incl. Certified Postgres+AGE+pgvector, macos-fed, SAL-only, coverage). gh api repos/alphaonedev/ai-memory-mcp/commits/9b84c2a8/check-runs
Enterprise-federation cert posture (20 checks)GREEN20-check recapture on the 18.6/1.8.0/0.8.6 triple → docs/compliance/evidence/cert-55/; green cert-postgres-age.yml run cited in the cert doc.
#3329 — non-blocking MCP boot backfill + macOS config-pathGREENMerged; both macos-fed legs green. Coder→review→merge pipeline, 13 new tests.
#3132 — pg/sqlite SYSTEM_PRINCIPAL parity + cert recaptureGREENVerified non-divergent at tip (SYSTEM_PRINCIPAL=="system", one shared authz predicate); parity guard test lands to lock it.
f1⇄f2 cross-host mTLS federation + A2A acceptanceGREEN9/9 (T1–T5 + A2A) over live mTLS. infra/do-hive/crypto/test-federation-mtls.sh, test-fed-write-sig-attestation.sh.

Acceptance campaign — full features · regression · A2A · capacity (encrypted, GLM-5.3-Flash)

DimensionStatusWhat it proves
Feature coverage matrix (100% of drivable tool surface)PENDINGEvery ai-memory capability exercised end-to-end by the swarm over mTLS; coverage matrix as evidence.
Regression suite (fixed-bug / Big-10 invariants)PENDINGThe shipped guarantees stay held; a regression is caught, not silently passed.
A2A choreographies (signals · exactly-one-winner claims · leases · quorum · governance · replay-guard)PENDINGMulti-NHI coordination invariants hold under concurrency, cross-node.
Security / red-team — can a bad memory infect the swarm/hive?PENDINGAdversarial memory poisoning: inject malicious / prompt-injection / false-fact memories as a hostile NHI and prove the swarm/hive does not get infected — cross-agent isolation holds (namespace-confined, fail-closed), unsigned/forged writes are convicted, an operator Deny stays Deny, and a wrong idea does not cascade into groupthink (corroboration independence + poison quarantine). Also: tenant-scope leak attempts, capability-token attenuation abuse, at-rest/in-transit boundary probes. The #3266 contamination concern, tested directly.
Per-module capacity — max NHIs at certified-budget latencyPENDINGMeasures what the cert currently only estimates: the agent-unit number one certified module sustains (p50/p95/p99).
Module scaling curve (exponential via federation)PENDINGThe real per-module multiplier as modules are added.
Hard stop/start continuity — swarm/hive survives aggressive kill cyclesPENDINGThe headline resilience proof. A swarm/hive is put on a multi-step mission (goals · purpose · objectives · plan stored in ai-memory), then hard-killed mid-work and cold-restarted, repeatedly. Each restart must recover the mission, goals, purpose, objectives, and last-worked-on state from federated memory (recover-previous-session + session-boot) and pick up exactly where it left off — no re-doing completed work, no lost context, no drift. Measured over multiple aggressive cycles.
Experiential AI-NHI audit — the agents assess the substrate they usePENDINGBeyond mechanical coverage: GLM-5.3-Flash NHIs do realistic multi-step work using ai-memory as their working memory, then reflect and surface structured insights from the AI-agent's own perspective — does recall return the right context when needed, does it preserve continuity across a task, does A2A coordination actually help, what is confusing / missing / valuable. Findings → Fable validity gate → 3×7 vote; usability/roadmap insights captured here.
Config-1..5 on DigitalOcean (incl. LUKS-encrypted) + GLM swarm/hivePENDINGThe certified enterprise-federation config at cloud scale, plaintext and machine-proven-encrypted.
OS-tier matrix (Ubuntu/Fedora/CentOS/macOS + mobile clients)PENDINGBuild + daemon + federation acceptance across the supported host/client matrix.

4 · Reproduce it yourself

Certification posture (20 checks, native cert pg)

cd infra/do-hive/crypto
./gen-certs.sh                 # mTLS material (CA + server + client-good/bad)
./run-all-local.sh            # posture: mTLS · write-sig attestation · pg verify-full · semantic recall

Encrypted capacity ramp (per-module agent number)

# daemon: release ai-memory, cert pg+AGE+pgvector, TLS+mTLS endpoint
export SWARM_BASE_URL=https://<daemon>:<port>   # mTLS client cert
export OPENROUTER_API_KEY=<key>                # GLM-5.3-Flash NHIs
python3 -m swarm --agents N --scenario coverage   # Fable-authored suite -> coverage matrix
infra/pillar4-envelope/measure-capacity-ramp.sh   # concurrency ramp -> USL fit -> knee

Results, raw JSON, and the coverage matrix are committed under docs/compliance/evidence/ and linked here as each phase completes.

Generated by Fable 5 (conductor). Honest-by-construction: PENDING rows become GREEN only when measured. Last updated as the campaign runs.