Skip to content

Use direct IO when accessing raw vectors for BBQ (when rescoring) #125921

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 24 commits into from
Apr 24, 2025
Merged

Use direct IO when accessing raw vectors for BBQ (when rescoring) #125921

Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
a9be5ea
Copy Lucene99FlatVectorsReader allowing direct IO to be specified dir…
thecoop Mar 31, 2025
359fe69
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Mar 31, 2025
991dd6d
Use DirectIODirectory implementation
thecoop Mar 31, 2025
a2ed4c8
Add entitlement
thecoop Mar 31, 2025
08d2a76
Sometimes DirectIO is not available
thecoop Mar 31, 2025
9294c04
Allow for subpaths
thecoop Mar 31, 2025
e2f3693
Specify buffer size
thecoop Apr 4, 2025
446caf8
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 8, 2025
b0325ce
Only use direct IO in searches
thecoop Apr 14, 2025
dd3300f
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 14, 2025
00682ca
Update copyright year and comments
thecoop Apr 14, 2025
b51548b
Update comment
thecoop Apr 15, 2025
30092c8
Merge remote-tracking branch 'upstream/main' into modified-flat-vecto…
thecoop Apr 15, 2025
9c86a05
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 16, 2025
22f740d
Use a system property to turn off direct IO if needed
thecoop Apr 16, 2025
e258015
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 16, 2025
2b8d4fd
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 17, 2025
c7149ff
Tweak the names
thecoop Apr 17, 2025
94dbac0
Add comment
thecoop Apr 17, 2025
521245e
Merge remote-tracking branch 'upstream/main' into modified-flat-vecto…
thecoop Apr 17, 2025
b8b714a
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 23, 2025
93a9bdb
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 23, 2025
27c96b3
Merge branch 'main' into modified-flat-vector-direct-io
thecoop Apr 24, 2025
3f90ea5
Add conditions for new reader
thecoop Apr 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into modified-flat-vector-direct-io
  • Loading branch information
@thecoop
thecoop committed Apr 16, 2025
commit 9c86a0552d68f0d013f8db002a3873da9e0e103f

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.