[CI] TimeseriesMoveToStepIT testMoveToAllocateStep failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-intake #24083 / part5
• elasticsearch-pull-request #75749 / part-5

Reproduction Line:

./gradlew ":x-pack:plugin:ilm:qa:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.ilm.TimeseriesMoveToStepIT.testMoveToRolloverStep" -Dtests.seed=553DC4E7306FFAE5 -Dtests.locale=sa -Dtests.timezone=Australia/ACT -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: timed out waiting for green state for index [index-wqjazzfpxg-000001] cluster state [{
  "cluster_name" : "javaRestTest",
  "cluster_uuid" : "CkWHcuzTR8mjB_pWMeruGw",
  "version" : 1574,
  "state_uuid" : "MKm63e9tTeKW3G9bx27T5Q",
  "master_node" : "cpMxQ_SpSaSgUnGcJZwcbA",
  "blocks" : { },
  "nodes" : {
    "cpMxQ_SpSaSgUnGcJZwcbA" : {
      "name" : "javaRestTest-1",
      "ephemeral_id" : "DKUyjL6aTLGh-jajwLQnPw",
      "transport_address" : "127.0.0.1:33787",
      "external_id" : "javaRestTest-1",
      "attributes" : {
        "ml.config_version" : "12.0.0",
        "testattr" : "test",
        "xpack.installed" : "true",
        "transform.config_version" : "10.0.0"
      },
      "roles" : [
        "data",
        "data_cold",
        "data_content",
        "data_frozen",
        "data_hot",
        "data_warm",
        "ingest",
        "master",
        "ml",
        "remote_cluster_client",
        "transform"
      ],
      "version" : "9.1.0",
 
[truncated]

Issue Reasons:

• [main] 2 failures in test testMoveToAllocateStep (1.4% fail rate in 146 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 2 failures in test testMoveToAllocateStep (1.4% fail rate in 146 executions)

Build Scans:

• elasticsearch-intake #24083 / part5
• elasticsearch-pull-request #75749 / part-5

[elasticsearchmachine]

Pinging @elastic/es-data-management (Team:Data Management)

[nielsbauman]

See #129489 (comment)