©2026 adebench · adecubedbuilt 2026-11-04 from the reports in the repo

← leaderboard

Memoose

local knowledge graph in SQLite, triples plus lexical chunks, 26 MCP tools. https://github.com/AndrewNgo-ini/memoose

Core
63% · 34.6 / 55 (mean)
Core (public2)
56% · 30.7 / 55 (mean)
Private set
no drop detected (±5.9) · δ 3 · shift −2.8 from 5 other memories · public2 3 builds, private 1 · holdout-v1 3cd42b9f
Full
76% · 68.3 / 90 · 90 of 100 measured
Runs
3 · core 34.6–34.6 · the details below are the median run
Common with gbrain
68.4 vs 75.4 on 90
Chars per answer
1,760 · answer after 97
Write → visible
2.1 s · p95 2.1 s
Write-back
not run
Reached through
CLI / SQLite
Model on write
no
Key needed
none
Where it runs
local
License
Apache-2.0
Deterministic
yes
Configuration
Versionmemoose 0.4.0 with fastembed 0.8.1
Modeengine only, no model harness (the skills a model runs on top are out of the picture)
Doormemoose --json -d adebench recall <query> -n 10 (routed mode: entities, facts as triples, chunk summaries), plus the session's standing context
Results-n 10 (adapter's choice; Memoose's default not stated), no relevance threshold, no cut
Model insidenone
Embeddingsfastembed, local (model and dimensions not stated)
StorageSQLite (one dataset file, 'adebench')
Not defaultfastembed installed (without it the vectors fall back to a hash)

Notes: engine only (no model harness), fastembed vectors. Run 2026-09-30, door recall, fingerprint d7609ff060. Report: examples/memoose_report/reference.md · All runs: examples/memoose_report/repeats.json · public2: examples/memoose_report/reference_public2.md

Sections
door
18.8
of 25 · 6 pass · 2 fail
FAIL Which version of MailBridge is installed for the mailbox? — STALE value delivered next to the current one: 1.3.0
FAIL What is the owner's phone number? — missing +39
cards
15.0
of 15 · 28 pass · 0 fail
updates
5.0
of 10 · 2 pass · 2 fail
FAIL sandbox: a new value retires the old one on its own
FAIL sandbox: the retired values never reach the door again
time
5.0
of 10 · 1 pass · 1 fail
FAIL semantic memories carry their age (64/160) — 40%
live state
8.8
of 10 · 7 pass · 1 fail
FAIL mail_non_lette refreshed less than 30 minutes ago — key absent
abstention
5.8
of 10 · 0 pass · 4 fail
FAIL What is the Zarpetta module? — 20 keyword facts for something that does not exist
FAIL Who is Ottavio Brambillesco? — 20 keyword facts for something that does not exist
FAIL Which port does the Fulmicotone service use? — 20 keyword facts for something that does not exist
FAIL What does the calendar plugin Girandola do? — produced an entity card; 20 keyword facts for something that does not exist
file search
not measuredsection not measured: no repo configured (--repo)
graph
10.0
of 10 · 15 pass · 0 fail