Skip to content

[8.19] Semantic Text Chunking Indexing Pressure (#125517) #127463

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Apr 28, 2025
Merged

[8.19] Semantic Text Chunking Indexing Pressure (#125517) #127463

merged 2 commits into from
Apr 28, 2025
+617 −27

Conversation

Mikep86
Copy link
Contributor

@Mikep86 Mikep86 commented Apr 28, 2025

Backport

This will backport the following commits from main to 8.19:

Questions ?

Please refer to the Backport tool documentation

@Mikep86
Semantic Text Chunking Indexing Pressure (elastic#125517)
0627936 
We have observed many OOMs due to the memory required to inject chunked inference results for semantic_text fields. This PR uses coordinating indexing pressure to account for this memory usage. When indexing pressure memory usage exceeds the threshold set by indexing_pressure.memory.limit, chunked inference result injection will be suspended to prevent OOMs.

(cherry picked from commit 85713f7)

# Conflicts:
#	server/src/main/java/org/elasticsearch/node/NodeConstruction.java
#	server/src/main/java/org/elasticsearch/node/PluginServiceInstances.java
#	x-pack/plugin/inference/src/main/java/org/elasticsearch/xpack/inference/InferencePlugin.java
#	x-pack/plugin/inference/src/test/java/org/elasticsearch/xpack/inference/action/filter/ShardBulkInferenceActionFilterTests.java
@Mikep86 Mikep86 mentioned this pull request Apr 28, 2025
Merged
@Mikep86 Mikep86 added >enhancement :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. :ml Machine learning auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) :SearchOrg/Relevance Label for the Search (solution/org) Relevance team labels Apr 28, 2025
@elasticsearchmachine elasticsearchmachine merged commit 30d5a9d into elastic:8.19 Apr 28, 2025
15 checks passed
@Mikep86 Mikep86 deleted the backport/8.19/pr-125517 branch April 28, 2025 13:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. >enhancement :ml Machine learning :SearchOrg/Relevance Label for the Search (solution/org) Relevance team v8.19.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Mikep86 @elasticsearchmachine