Jev-Mem
graph memory whose decisions are taken by a small System-One model. https://github.com/libingzheren/Jev-Mem
- Core
- 58% · 31.9 / 55 (mean)
- Core (public2)
- 67% · 37.1 / 55 (mean)
- Private set
- no drop detected (±4.8) · δ 3 · shift −2.1 from 5 other memories · public2 5 builds, private 3 · holdout-v1 3cd42b9f
- Full
- 64% · 41.9 / 65 · 65 of 100 measured
- Runs
- 6 · core 28.9–33.0 · the details below are the median run
- Common with gbrain
- 42.1 vs 50.4 on 65
- Chars per answer
- 943 · answer after 204
- Write → visible
- 3.4 s · p95 4.7 s
- Write-back
- 2 of 2 degraded answers came back
- Reached through
- Python library
- Model on write
- yes: a small System-One model (Laya, local)
- Key needed
- none (Laya)
- Where it runs
- local
- License
- MIT
- Deterministic
- no: the same input builds different links
Configuration
| Version | not stated |
| Mode | Python library from a git checkout, local decision profile, no API key, run through a JSON-lines bridge in Jev-Mem's own Python |
| Door | QueryEngine.query(question, top_k=5): the ranked evidence block, each item with its date; no answer model |
| Results | top_k 5 (the value JevMemSystem.query uses), no cut |
| Model inside | Laya (convaiinnovations/laya), local System-One model: memory decisions (typing, relations, routing, stopping); no answer model |
| Embeddings | all-MiniLM-L6-v2, 384 dimensions, local |
| Storage | Jev-Mem's own store on disk: graph, vectors and keyword index (format not stated) |
| Not default | decision profile config/laya_mem.json (local Laya, no key) instead of the default profile, which calls TypeSafe's Jev API; OPENAI_API_KEY removed in the bridge so no answer model runs (the benchmark measures what reaches the model) |
Notes: Laya local decisions (config/laya_mem.json), embeddings all-MiniLM-L6-v2, no answer model. Run 2026-09-29, door evidence,
fingerprint b4aa97e819. Report:
examples/jevmem_report/reference.md · All runs: examples/jevmem_report/repeats.json · public2: examples/jevmem_report/reference_public2.md
Sections
door | 18.8 of 25 · 6 pass · 2 fail | FAIL Which version of MailBridge is installed for the mailbox? — STALE value delivered next to the current one: 1.3.0 FAIL What is the owner's phone number? — missing +39 |
cards | not measured | section not measured: no entity cards in this memory |
updates | 3.3 of 10 · 1 pass · 2 fail | FAIL a new write with a changed value replaces the old one at the door (no id given) — new value served in 2924 ms; STALE: the old value is still delivered (28 reads with both) FAIL restating the current value does not pile up a second copy — 6 copies delivered |
time | 6.7 of 10 · 4 pass · 2 fail | FAIL semantic memories carry their age (14/35) — 40% FAIL «what did pc2 do?» finds the episodes signed [pc2] — 3 episodes in the answer |
live state | 10.0 of 10 · 7 pass · 0 fail | |
abstention | 3.3 of 10 · 0 pass · 4 fail | FAIL What is the Zarpetta module? — episodes presented as direct matches; 3 keyword facts for something that does not exist FAIL Who is Ottavio Brambillesco? — episodes presented as direct matches; 4 keyword facts for something that does not exist FAIL Which port does the Fulmicotone service use? — episodes presented as direct matches; 4 keyword facts for something that does not exist FAIL What does the calendar plugin Girandola do? — episodes presented as direct matches; 4 keyword facts for something that does not exist |
file search | not measured | section not measured: no repo configured (--repo) |
graph | not measured | section not measured: no case with evidence (all SKIP or no cases) |