Skip to content

Semantic Text Chunking Indexing Pressure #125517

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 54 commits into from
Apr 14, 2025
Merged

Semantic Text Chunking Indexing Pressure #125517

Changes from 1 commit
Commits
Show all changes
54 commits
Select commit Hold shift + click to select a range
bc62301
Added circuit breaker
Mikep86 Mar 19, 2025
0a58daa
Pass circuit breaker to action filter
Mikep86 Mar 20, 2025
a77516f
Estimate memory usage before performing inference
Mikep86 Mar 20, 2025
fee2c90
Merge branch 'main' into semantic-text_oom-circuit-breaker
Mikep86 Mar 20, 2025
83395f4
Reset circuit breaker on completion of request handling
Mikep86 Mar 20, 2025
f84ff66
Calculate actual memory usage
Mikep86 Mar 20, 2025
8698ecd
Spotless
Mikep86 Mar 20, 2025
c7b1af1
Added TODOs
Mikep86 Mar 20, 2025
6458bb3
Added more comments
Mikep86 Mar 20, 2025
6b7db55
Merge branch 'main' into semantic-text_oom-circuit-breaker
Mikep86 Mar 21, 2025
f4a4689
Track memory usage of requests that don't perform inference
Mikep86 Mar 21, 2025
c74ca3c
Fix test failures
Mikep86 Mar 21, 2025
f5e8a94
Add circuit breaker unit test
Mikep86 Mar 21, 2025
1d5e5bd
Circuit breaker test development
Mikep86 Mar 21, 2025
d93050f
Fix memory usage tracking in estimateMemoryUsage
Mikep86 Mar 24, 2025
2480955
Make circuit breaker limit setting dynamically updatable
Mikep86 Mar 24, 2025
5d76384
Updated estimateMemoryUsage to throw InferenceException
Mikep86 Mar 24, 2025
4bcff47
Updated InferenceException to retain the original message when it is …
Mikep86 Mar 24, 2025
080ae60
Added circuit breaker trips on estimated inference bytes unit test
Mikep86 Mar 24, 2025
30e0a08
[CI] Auto commit changes from spotless
elasticsearchmachine Mar 24, 2025
8939687
Increment byte counters after updating breaker
Mikep86 Mar 28, 2025
6071cb0
Check that circuit breaker usage is 0
Mikep86 Mar 28, 2025
0507d94
Add indexing pressure to plugin services
Mikep86 Mar 28, 2025
a643877
Merge branch 'main' into semantic-text_oom-circuit-breaker
Mikep86 Mar 28, 2025
a6200d5
Merge branch 'main' into semantic-text_oom-circuit-breaker
Mikep86 Apr 1, 2025
c211ff6
Pass indexing pressure to action filter
Mikep86 Apr 1, 2025
a106f87
Pass coordinating object to AsyncBulkShardInferenceAction
Mikep86 Apr 1, 2025
4a2976c
Use coordinating indexing pressure in ShardBulkInferenceActionFilter
Mikep86 Apr 1, 2025
56a5f97
Update circuit breaker test
Mikep86 Apr 1, 2025
111bb1f
Update circuit breaker trips on estimated inference bytes test
Mikep86 Apr 1, 2025
02d70a0
Remove inference bytes circuit breaker
Mikep86 Apr 1, 2025
bf9d118
Adjust coordinating indexing pressure lifetime
Mikep86 Apr 2, 2025
456fc59
Merge branch 'main' into semantic-text_oom-circuit-breaker
elasticmachine Apr 2, 2025
fee592b
Account for indexing pressure from source in batches
Mikep86 Apr 3, 2025
437ca6b
Account for indexing pressure from empty chunk inference updates
Mikep86 Apr 4, 2025
96f4037
Add indexing pressure from source modifications
Mikep86 Apr 4, 2025
fcf7387
Fix testIndexingPressure
Mikep86 Apr 4, 2025
e5f64ff
Fix testIndexingPressureTripsOnEstimatedInferenceBytes
Mikep86 Apr 4, 2025
b183b20
Merge branch 'main' into semantic-text_oom-circuit-breaker
Mikep86 Apr 4, 2025
3349168
Cleanup
Mikep86 Apr 4, 2025
8a28093
Fix compilation errors
Mikep86 Apr 4, 2025
bf420c8
Added unit test
Mikep86 Apr 4, 2025
2e479a9
Revert changes to InferenceException
Mikep86 Apr 4, 2025
2330e3e
Resolve TODO
Mikep86 Apr 4, 2025
0bb32cc
Merge branch 'main' into semantic-text_oom-circuit-breaker
elasticmachine Apr 4, 2025
0065a87
Merge branch 'main' into semantic-text_oom-circuit-breaker
elasticmachine Apr 7, 2025
0ff48cf
Resolve TODOs
Mikep86 Apr 8, 2025
ecb8e02
Pass indexing pressure in constructor
Mikep86 Apr 8, 2025
6a3a4fd
Merge branch 'main' into semantic-text_oom-circuit-breaker
elasticmachine Apr 8, 2025
f4aef73
Added partial failure test
Mikep86 Apr 8, 2025
118c27f
Merge branch 'main' into semantic-text_oom-circuit-breaker
elasticmachine Apr 8, 2025
8cc4402
Update docs/changelog/125517.yaml
Mikep86 Apr 11, 2025
0a138f2
Fix changelog
Mikep86 Apr 11, 2025
e8742d2
Merge branch 'main' into semantic-text_oom-circuit-breaker
Mikep86 Apr 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update docs/changelog/125517.yaml
  • Loading branch information
@Mikep86
Mikep86 committed Apr 11, 2025
commit 8cc4402f0bef9b09a22dccc994dddc4558c9a2e8
5 changes: 5 additions & 0 deletions docs/changelog/125517.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
pr: 125517
summary: Add Semantic Text Chunking OOM Circuit Breaker
area: "Machine Learning, Relevance"
type: enhancement
issues: []
Loading