Skip to content

Harden and run 10M sharded Qdrant evidence#21

Merged
CaspianG merged 3 commits into
mainfrom
benchmark/qdrant-sharded-10m-strict
Jul 11, 2026
Merged

Harden and run 10M sharded Qdrant evidence#21
CaspianG merged 3 commits into
mainfrom
benchmark/qdrant-sharded-10m-strict

Conversation

@CaspianG

Copy link
Copy Markdown
Owner

Scope

  • bound sharded Qdrant upsert memory by streaming per-shard chunks
  • resume completed checkpoints without regenerating vectors
  • support per-shard gRPC ports and query timeouts
  • apply scalar INT8 quantization and quantized search parameters
  • refresh reproducible 10M and 100M sharded run plans

Validation so far

  • 60 focused tests passed, 2 optional FAISS tests skipped
  • real two-service Qdrant 1.18.2 smoke: recall@10 1.000, p99 5.59 ms
  • complete checkpoint resume: no re-ingest, p99 6.90 ms

The strict 10M sharded artifact will be added after the full run completes.

@CaspianG CaspianG marked this pull request as ready for review July 11, 2026 06:18
@CaspianG CaspianG merged commit 5461f89 into main Jul 11, 2026
16 checks passed
@CaspianG CaspianG deleted the benchmark/qdrant-sharded-10m-strict branch July 11, 2026 06:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant