Skip to content

[CI] ModelLoaderUtilsTests testSplitIntoRanges failing #121799

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
elasticsearchmachine opened this issue Feb 5, 2025 · 4 comments · Fixed by #126009
Closed

[CI] ModelLoaderUtilsTests testSplitIntoRanges failing #121799

elasticsearchmachine opened this issue Feb 5, 2025 · 4 comments · Fixed by #126009
Labels
medium-risk An open issue or test failure that is a medium risk to future releases :ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Feb 5, 2025

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:ml-package-loader:test" --tests "org.elasticsearch.xpack.ml.packageloader.action.ModelLoaderUtilsTests.testSplitIntoRanges" -Dtests.seed=62BD0D92CDCAE68D -Dtests.locale=ta-IN -Dtests.timezone=US/East-Indiana -Druntime.java=23

Applicable branches:
8.x

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Expected: a collection with size <8>
     but: collection size was <7>

Issue Reasons:

  • [8.x] 2 failures in test testSplitIntoRanges (0.2% fail rate in 863 executions)
  • [8.x] 2 failures in pipeline elasticsearch-periodic-platform-support (10.5% fail rate in 19 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :ml Machine learning >test-failure Triaged test failures from CI labels Feb 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch 8.18

Mute Reasons:

  • [8.18] 2 failures in test testSplitIntoRanges (0.6% fail rate in 352 executions)

Build Scans:

@elasticsearchmachine elasticsearchmachine added Team:ML Meta label for the ML team needs:risk Requires assignment of a risk label (low, medium, blocker) labels Feb 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/ml-core (Team:ML)

@davidkyle
Copy link
Member

This reproduces with the reproduce line above. Looks like random testing found a corner case

    Expected: a collection with size <9>
         but: collection size was <8>                                                                                                                                            at __randomizedtesting.SeedInfo.seed([FB913A7FEA45DDB7:8A6793CF7CA2B513]:0)
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
        at org.elasticsearch.test.ESTestCase.assertThat(ESTestCase.java:2629)
        at org.elasticsearch.xpack.ml.packageloader.action.ModelLoaderUtilsTests.testSplitIntoRanges(ModelLoaderUtilsTests.java:121)

@davidkyle davidkyle added medium-risk An open issue or test failure that is a medium risk to future releases and removed needs:risk Requires assignment of a risk label (low, medium, blocker) labels Feb 10, 2025
@Jason-Whitmore
Copy link
Contributor

May I work on this issue? I believe I know the solution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
medium-risk An open issue or test failure that is a medium risk to future releases :ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants