©2026 adebench · adecubedbuilt 2026-09-30 from the reports in the repo

← leaderboard

cognee

knowledge graph plus vector index built from what is added (cognify). https://github.com/topoteretes/cognee

Core
61% · 33.7 / 55
Full
67% · 43.7 / 65 · 65 of 100 measured
Common with gbrain
43.7 vs 50.4 on 65
Chars per answer
4,725 · answer after 294
Write → visible
883 ms · p95 926 ms
Write-back
2 of 2 degraded answers came back
Reached through
Python library
Model on write
yes: graph extraction (Gemini)
Key needed
LLM provider
Runs
local
License
Apache-2.0
Deterministic
no: extraction is a model call

Configuration: 1.6.1, gemini-3-flash-preview and gemini-embedding-001, door = recall context (only_context), dates shown through include_external_metadata, fresh session per call; reference = median of three builds (45.4, 43.7, 43.7). Run 2026-09-30, door context, fingerprint 9c9c8684e6. Report: examples/cognee_report/reference.md

Sections
door
18.8
of 25 · 6 pass · 2 fail
FAIL Which version of MailBridge is installed for the mailbox? — STALE value delivered next to the current one: 1.3.0
FAIL What is the owner's phone number? — missing +39
cards
not measuredsection not measured: no entity cards in this memory
updates
3.3
of 10 · 1 pass · 2 fail
FAIL a new write with a changed value replaces the old one at the door (no id given) — new value served in 1056 ms; STALE: the old value is still delivered (14 reads with both)
FAIL restating the current value does not pile up a second copy — 3 copies delivered
time
8.3
of 10 · 5 pass · 1 fail
FAIL semantic memories carry their age (53/66) — 80%
live state
10.0
of 10 · 7 pass · 0 fail
abstention
3.3
of 10 · 0 pass · 4 fail
FAIL What is the Zarpetta module? — episodes presented as direct matches; 9 keyword facts for something that does not exist
FAIL Who is Ottavio Brambillesco? — episodes presented as direct matches; 8 keyword facts for something that does not exist
FAIL Which port does the Fulmicotone service use? — episodes presented as direct matches; 8 keyword facts for something that does not exist
FAIL What does the calendar plugin Girandola do? — episodes presented as direct matches; 9 keyword facts for something that does not exist
file search
not measuredsection not measured: no repo configured (--repo)
graph
not measuredsection not measured: no case with evidence (all SKIP or no cases)