Skip to content

Add MemoryHub memory provider - #34

Open
rdwj wants to merge 3 commits into
vectorize-io:mainfrom
rdwj:memoryhub-provider
Open

Add MemoryHub memory provider#34
rdwj wants to merge 3 commits into
vectorize-io:mainfrom
rdwj:memoryhub-provider

Conversation

@rdwj

@rdwj rdwj commented Aug 22, 2026

Copy link
Copy Markdown

Closes #33

Summary

Adds MemoryHub as a memory provider for AMB. MemoryHub is a Kubernetes-native agent memory component for OpenShift AI. Apache 2.0 licensed, self-hostable.

Architecture: verbatim conversation storage in PostgreSQL + pgvector. Hybrid search via vector + keyword + BM25 with cross-encoder reranking and reciprocal-rank fusion. Embeddings are server-side (Granite via the MemoryHub pipeline).

Results -- PersonaMem 32k

Answer LLM: gemini-3.1-pro-preview, judge: gemini-3.5-flash-lite.

Dataset / split Accuracy
personamem / 32k 83.7% (493/589)

What's included

  • src/memory_bench/memory/memoryhub.py -- provider adapter (~130 lines). Connects via the memoryhub Python SDK over streamable-HTTP (MCP protocol).
  • Registry entry in src/memory_bench/memory/__init__.py and display entry in catalog.json.
  • pyproject.toml -- memoryhub>=0.15 dependency.
  • outputs/personamem/memoryhub/rag/32k.json.gz -- committed run results.
  • results-manifest.json -- manifest entry.

Reproduce

pip install memoryhub
export MEMORYHUB_URL=https://your-instance/mcp/
export MEMORYHUB_API_KEY=your-api-key
export GEMINI_API_KEY=...
export OMB_ANSWER_LLM=gemini
export OMB_ANSWER_MODEL=gemini-3.1-pro-preview
export OMB_JUDGE_MODEL=gemini-3.5-flash-lite

amb run --dataset personamem --split 32k --memory memoryhub

Requires a running MemoryHub instance. The memoryhub SDK handles MCP session management, authentication, and search.

rdwj added 3 commits August 21, 2026 20:01
Adapter: clean 130-line provider derived from our internal 503-line
version. Strips ablation config to 4 env vars (URL, key, project, k).

Also adds lab notes documenting reproduction protocol, a PR draft
template, and the run-repro.sh convenience script.

Assisted-by: Claude Code (Opus 4.6)
493/589 correct on PersonaMem 32k with Gemini 3.1 Pro Preview.
Hybrid vector + keyword search with cross-encoder reranking.

Assisted-by: Claude Code (Opus 4.6)
@vercel

vercel Bot commented Aug 22, 2026

Copy link
Copy Markdown

@rdwj is attempting to deploy a commit to the Vectorize Team on Vercel.

A member of the Team first needs to authorize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add MemoryHub as an AMB memory provider

1 participant