Skip to content

docs: clarify BL-036/BL-047 implementation details#55

Merged
tryweb merged 2 commits intomainfrom
docs/bl-036-bl-047-vector-search-observability
Apr 3, 2026
Merged

docs: clarify BL-036/BL-047 implementation details#55
tryweb merged 2 commits intomainfrom
docs/bl-036-bl-047-vector-search-observability

Conversation

@tryweb
Copy link
Copy Markdown
Owner

@tryweb tryweb commented Apr 3, 2026

Summary

Clarify implementation details for BL-036 (LanceDB ANN fast-path) and BL-047 (search mode observability) in roadmap and backlog documentation.

Changes

BL-036 - LanceDB ANN fast-path for large scopes

  • Add LANCEDB_OPENCODE_PRO_VECTOR_INDEX_THRESHOLD env var (default: 1000)
  • When scope entries >= threshold, automatically create IVF_PQ vector index
  • Expose searchMode field in memory_stats tool (in-memory-cosine | native-ivf)
  • Emit warning when pruneScope exceeds maxEntriesPerScope

BL-047 - Embedding fallback & search mode observability

  • Expand scope to cover both embedding fallback AND search mode visibility
  • memory_stats to disclose current vector search mode
  • Embedding fallback retains graceful degradation with structured warnings + metrics

Motivation

Based on codebase analysis, the current design uses in-memory cosine similarity for all vector searches. As scopes grow (up to 3000 entries), users should be aware of:

  1. Current search mode behavior
  2. When automatic index promotion occurs
  3. Potential latency implications

This PR provides implementation guidance for future BL-036/BL-047 work.

OpenCode Dev added 2 commits April 3, 2026 07:04
…20623

- Create OPENCODE_COMPATIBILITY.md with detailed diagnosis and solutions
- Document Issue #20623: OpenCode plugin loader breaks native NAPI addons in v1.3.8+
- Add troubleshooting checklist and decision tree
- Update README with compatibility badge and new issues section
- Update QUICK_START with version note and error reference
- Update docs/README with new compatibility document

NAPI Issue Details:
- Affected: OpenCode v1.3.8 - v1.3.13
- Root cause: PR #20112 plugin loader refactor
- Workaround: Downgrade to v1.3.7
- Status: Issue #20623 open, no ETA for fix

Solutions provided:
1. Downgrade to v1.3.7 (immediate)
2. Improve error messaging (interim)
3. Migrate to pure JS backend (long-term)
…observability

- BL-036: Add env var LANCEDB_OPENCODE_PRO_VECTOR_INDEX_THRESHOLD (default 1000)
  for automatic IVF_PQ index creation when scope entries exceed threshold
  - memory_stats to expose searchMode field (in-memory-cosine | native-ivf)
  - pruneScope to emit warning when exceeding maxEntriesPerScope

- BL-047: Expand to cover both embedding fallback AND search mode observability
  - memory_stats searchMode field to disclose current vector search mode
  - embedding fallback retains graceful degradation with structured warnings
@tryweb tryweb merged commit 3b7eaac into main Apr 3, 2026
9 checks passed
@tryweb tryweb deleted the docs/bl-036-bl-047-vector-search-observability branch April 3, 2026 00:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant