Project Mantis · Research note
Executive Track Record Engine
HybridRAG over real SEC DEF 14A / 8-K filings — graph is truth; LLM narrates only hard-linked facts.
ETR · GRAPHRAG
July 2026
Author: Alex Behm
Gold graph25 execs · 71 edges
Hybrid entity100%
vs vector-only+12.5 / +37.5 pp
Memo hall rate0.0
EDGAR → Gold → Extract → Neo4j+Qdrant → Hybrid → Memo Local qwen3:8b · no fine-tune

Thesis: Vector RAG confuses name similarity with fact. A knowledge graph enforces entity identity and tenure; vector search only supports the pack; the language model may not invent employers or dates.

1. Problem

Executive track records live in unstructured proxy biographies and 8-K appointment notices. Nearest-neighbor retrieval attaches the wrong employer or wrong decade because embeddings optimize semantic proximity, not temporal or entity structure.

2. Pipeline

1. Real EDGAR corpus (fixed 10 large-caps) · 2. Hand gold graph (25 executives) · 3. Local extraction vs gold · 4. Neo4j + Qdrant · 5. Hybrid retrieval (1–2 hop + ticker filter) · 6. Citation-bound memo + post-hoc verifier.

MetricBarMeasured
Entity resolution (hybrid)≥90%100% (8 fixtures)
Temporal accuracy (hybrid)≥85%100%
Hallucination-free (hybrid)100%100% (vector-only 62.5%)
Memo unlinked claims00.0 rate

3. HybridRAG vs vector-only

On eight gold fixtures, HybridRAG matched or beat vector-only on every portfolio metric. The gain is entity routing (+12.5 pp) and hallucination control (+37.5 pp). Temporal year-in-text can look strong for pure vectors on this small set; hard-linked edges still pass 100%.

Hybrid vs vector bar chart

4. Extraction (no fine-tune)

Entity recall
100%
25/25 execs
WORKED_AT
90.6%
recall · P 87.9%
HELD_ROLE
87.5%
recall
Stores
77 / 3,954
Neo4j n · Qdrant pts

5. Economics & limits

Cloud GPU $0 (base 8B cleared extraction bars). Inference local Ollama. Limits: 10 issuers; hand gold N=25; initiative recall ~33%; short memo form only.

Design rule Graph authorizes claims · LLM narrates · verifier rejects unlinked companies and bad citations.

Full markdown source: 01_Research_Note.md · Sample memos under memos/