[CI] MlWithSecurityIT test {yaml=ml/get_trained_model_stats/Test get stats given trained models} failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic-platform-support #7553 / oraclelinux-9_platform-support-unix
• elasticsearch-pull-request #66295 / part-4

Reproduction Line:

./gradlew ":x-pack:plugin:ml:qa:ml-with-security:yamlRestTest" --tests "org.elasticsearch.smoketest.MlWithSecurityIT.test {yaml=ml/get_trained_model_stats/Test get stats given trained models}" -Dtests.seed=4F3C9726F48303FA -Dtests.locale=zh-Latn -Dtests.timezone=Asia/Hebron -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: Failure at [ml/get_trained_model_stats:147]: expected [2xx] status code but api [ml.get_trained_models_stats] returned [500 Internal Server Error] [{"error":{"root_cause":[],"type":"exception","reason":"Searching for stats for models [a-unused-regression-model,a-unused-regression-model1] failed","caused_by":{"type":"search_phase_execution_exception","reason":"","phase":"query","grouped":true,"failed_shards":[],"caused_by":{"type":"search_phase_execution_exception","reason":"Search rejected due to missing shards [[.ml-stats-000001][0]]. Consider using `allow_partial_search_results` setting to bypass this error.","phase":"query","grouped":true,"failed_shards":[],"stack_trace":"Failed to execute phase [query], Search rejected due to missing shards [[.ml-stats-000001][0]]. Consider using `allow_partial_search_results` setting to bypass this error.\n\tat [email protected]/org.elasticsearch.action.search.SearchPhase.doCheckNoMissingShards(Searc
[truncated]

Issue Reasons:

• [main] 2 failures in test test {yaml=ml/get_trained_model_stats/Test get stats given trained models} (0.3% fail rate in 788 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 2 failures in test test {yaml=ml/get_trained_model_stats/Test get stats given trained models} (0.3% fail rate in 788 executions)

Build Scans:

• elasticsearch-periodic-platform-support #7553 / oraclelinux-9_platform-support-unix
• elasticsearch-pull-request #66295 / part-4

[elasticsearchmachine]

Pinging @elastic/ml-core (Team:ML)