[CI] UpgradeClusterClientYamlTestSuiteIT test {p0=mixed_cluster/90_ml_data_frame_analytics_crud/Start and stop old regression job} failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #9217 / 7.11.2_bwc
• elasticsearch-periodic #9217 / 7.9.3_bwc
• elasticsearch-periodic #9217 / 7.14.2_bwc
• elasticsearch-periodic #9217 / 7.10.2_bwc
• elasticsearch-periodic #9217 / 7.16.3_bwc
• elasticsearch-periodic #9217 / 7.15.2_bwc
• elasticsearch-periodic #9217 / 7.12.1_bwc
• elasticsearch-periodic #9217 / 7.13.4_bwc
• elasticsearch-periodic #9210 / 7.16.3_bwc
• elasticsearch-periodic #9210 / 7.13.4_bwc

Reproduction Line:

./gradlew ':x-pack:qa:rolling-upgrade:v7.11.2#oneThirdUpgradedTest' -Dtests.class="org.elasticsearch.upgrades.UpgradeClusterClientYamlTestSuiteIT" -Dtests.method="test {p0=mixed_cluster/90_ml_data_frame_analytics_crud/Start and stop old outlier_detection job}" -Dtests.seed=19BAA62364DCD32B -Dtests.bwc=true -Dtests.locale=he -Dtests.timezone=Africa/Luanda -Druntime.java=22

Applicable branches:
7.17

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: Failure at [mixed_cluster/90_ml_data_frame_analytics_crud:36]: expected [2xx] status code but api [ml.start_data_frame_analytics] returned [500 Internal Server Error] [{"error":{"root_cause":[{"type":"exception","reason":"Cannot create thread: Permission denied\nUnable to create named pipe /dev/shm/bk/bk-agent-prod-gcp-1751947567292549351/elastic/elasticsearch-periodic/x-pack/qa/rolling-upgrade/build/testclusters/v7.11.2-2/tmp/data_frame_analyzer_old_cluster_outlier_detection_job_2_output_45516: Permission denied\nError joining thread: No such process\nFailed to initialise IO\n","stack_trace":"ElasticsearchException[Cannot create thread: Permission denied\nUnable to create named pipe /dev/shm/bk/bk-agent-prod-gcp-1751947567292549351/elastic/elasticsearch-periodic/x-pack/qa/rolling-upgrade/build/testclusters/v7.11.2-2/tmp/data_frame_analyzer_old_cluster_outlier_detection_job_2_output_45516: Permission denied\nError joining thread: No such process\nFailed to ini
[truncated]

Issue Reasons:

• [7.17] 2 consecutive failures in step 7.11.2_bwc
• [7.17] 2 consecutive failures in step 7.9.3_bwc
• [7.17] 2 consecutive failures in step 7.14.2_bwc
• [7.17] 2 consecutive failures in step 7.10.2_bwc
• [7.17] 2 consecutive failures in step 7.16.3_bwc
• [7.17] 2 consecutive failures in step 7.15.2_bwc
• [7.17] 2 consecutive failures in step 7.12.1_bwc
• [7.17] 2 consecutive failures in step 7.13.4_bwc
• [7.17] 16 failures in test test {p0=mixed_cluster/90_ml_data_frame_analytics_crud/Start and stop old regression job} (34.8% fail rate in 46 executions)
• [7.17] 2 failures in step 7.11.2_bwc (66.7% fail rate in 3 executions)
• [7.17] 2 failures in step 7.9.3_bwc (66.7% fail rate in 3 executions)
• [7.17] 2 failures in step 7.14.2_bwc (50.0% fail rate in 4 executions)
• [7.17] 2 failures in step 7.10.2_bwc (66.7% fail rate in 3 executions)
• [7.17] 2 failures in step 7.16.3_bwc (66.7% fail rate in 3 executions)
• [7.17] 2 failures in step 7.15.2_bwc (66.7% fail rate in 3 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-distributed-coordination (Team:Distributed Coordination)