Skip to content

Milvus + local-Postgres documentation gaps from tire-kick session #1238

Description

@phernandez

Docs follow-ups from the Milvus tire-kick session (#1235)

Verified gaps in docs/semantic-search.md (and adjacent), all observed hands-on:

  • No local-Postgres user quickstart. Everything Postgres in the repo is framed as
    test infrastructure; a user enabling Milvus must reverse-engineer
    docker-compose-postgres.yml + BASIC_MEMORY_DATABASE_BACKEND/DATABASE_URL from the
    justfile. One short "run Postgres locally" section would unblock the whole Milvus path.
  • Fresh-switch step is undocumented: flipping semantic_vector_index requires
    bm reindex --embeddings (incremental suffices — verified: 8,689 chunks re-owned in
    ~3 min); the docs only mention reindex in the migration-cleanup narrative.
  • The pre-reindex degraded window is undocumented (see Vector search silently degrades when configured index has no ready manifest rows #1236): vector returns
    nothing and hybrid quietly serves FTS-only until the reindex runs.
  • Milvus Lite .db reality: pymilvus hard-requires the .db suffix and an existing
    parent directory, and what it creates is a directory tree (collections/, databases/,
    LOCK), not a file. Errors for bad shapes are raw pymilvus exceptions with no pointer to
    the milvus_uri setting.
  • milvus_database is ignored by Milvus Lite (no named-database support); it's
    passed unconditionally as db_name.
  • Stale rows after pgvector→milvus: the old pgvector projection
    (search_vector_embeddings, 8,689 rows in the session) remains on disk indefinitely;
    document the manual cleanup or note the disk cost until a cleanup command exists.

Positive findings worth stating in docs while editing: identical vector rankings and
scores (4-decimal agreement) across sqlite-vec/pgvector/Milvus Lite on a 222-entity
corpus; dimension-mismatch refusal message is excellent; missing-extra error is excellent;
30s timeout honored on unreachable servers; collections reload across processes (#1185).

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions