Nemp
Claude Code plugin: a JSON file in the project, and the model itself as the engine. https://github.com/SukinShetty/Nemp-memory
- Core
- 58% · 32.1 / 55
- Full
- 56% · 36.4 / 65 · 65 of 100 measured
- Common with gbrain
- 36.4 vs 50.4 on 65
- Chars per answer
- 29,530 · answer after 1,471
- Write → visible
- 70.5 s · p95 71.3 s
- Write-back
- not measured: 2 of 2 degraded answers were not stored by the write path
- Reached through
- inside Claude Code
- Model on write
- yes: every operation is a model turn
- Key needed
- Claude Code
- Runs
- local file
- License
- MIT
- Deterministic
- no: every operation is a model turn
Configuration: measured inside Claude Code: every operation is one claude -p turn (sonnet), Nemp loaded with --plugin-dir. Run 2026-09-29, door context,
fingerprint b2e3bde38a. Report:
examples/nemp_report/reference.md
Sections
door | 18.8 of 25 · 6 pass · 2 fail | FAIL Which version of MailBridge is installed for the mailbox? — STALE value delivered next to the current one: 1.3.0 FAIL What is the owner's phone number? — missing +39 |
cards | not measured | section not measured: no entity cards in this memory |
updates | 3.3 of 10 · 1 pass · 2 fail | FAIL a new write with a changed value replaces the old one at the door (no id given) — new value served in 13145 ms; STALE: the old value is still delivered (18 reads with both) FAIL restating the current value does not pile up a second copy — 3 copies delivered |
time | 2.5 of 10 · 1 pass · 3 fail | FAIL semantic memories carry their age (0/35) — 0% FAIL an imported memory reaches the door with its original date — served with no date FAIL «what did pc2 do?» finds the episodes signed [pc2] — 0 episodes in the answer |
live state | 4.3 of 10 · 3 pass · 4 fail | FAIL the canary just written is served through the retrieval door — write-to-serve 70470 ms (over the 30 s budget) FAIL 3 canaries served within the budget — p50 70470 ms · p95 71304 ms · 2 not served within 30 s FAIL after overwriting the canary the door serves the new value, never the old one — overwrite-to-visible 65479 ms (over the 30 s budget) FAIL two writes in quick succession: the door settles on the second, never back on the first — second write visible in 105744 ms (over the 30 s budget) |
abstention | 7.5 of 10 · 1 pass · 3 fail | FAIL Who is Ottavio Brambillesco? — 1 keyword facts for something that does not exist FAIL Which port does the Fulmicotone service use? — 4 keyword facts for something that does not exist FAIL What does the calendar plugin Girandola do? — 2 keyword facts for something that does not exist |
file search | not measured | section not measured: no repo configured (--repo) |
graph | not measured | section not measured: no case with evidence (all SKIP or no cases) |