Skip to content

New bulk scorer for binary quantized vectors via optimized scalar quantization #127189

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Apr 29, 2025

Conversation

benwtrent
Copy link
Member

Certain vector formats will benefit from bulk scoring and storing of binary quantized vectors. This is a first pass at a bulk scoring vector scorer that scores multiple vectors that are stored in a give bulk size

It is currently unused.

@benwtrent benwtrent requested a review from ChrisHegarty April 22, 2025 20:46
@elasticsearchmachine elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Apr 22, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)

Copy link
Contributor

@ChrisHegarty ChrisHegarty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks awesome! nice work. LGTM

Copy link
Contributor

@john-wagster john-wagster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hard to be 100% confident in some of this code, but I looked through everything and did not see anything glaring or that immediately looked wrong in any calculation and I feel good about the test coverage. lgtm!

@benwtrent benwtrent merged commit 74faf47 into elastic:main Apr 29, 2025
17 checks passed
@benwtrent benwtrent deleted the osq-bulk-scorer branch April 29, 2025 11:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>non-issue :Search Relevance/Vectors Vector search Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch v9.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants