Skip to content

[CI] EsqlSpecIT test {enrich.EnrichAgesStatsYear SYNC} failing #127044

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
elasticsearchmachine opened this issue Apr 17, 2025 · 3 comments
Open
Assignees
Labels
:Analytics/ES|QL AKA ESQL medium-risk An open issue or test failure that is a medium risk to future releases Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT" -Dtests.method="test {enrich.EnrichAgesStatsYear ASYNC}" -Dtests.seed=B12161BADEB59AB8 -Dtests.locale=sd -Dtests.timezone=Europe/Prague -Druntime.java=24

Applicable branches:
8.x

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Data mismatch:
row 0 column 2:a list containing
row 0 column 2:0: expected "1" but was "2"
row 1 column 2:a list containing
row 1 column 2:0: expected "4" but was "8"
row 2 column 2:a list containing
row 2 column 2:0: expected "7" but was "14"
row 3 column 2:a list containing
row 3 column 2:0: expected "6" but was "12"
row 4 column 2:a list containing
row 4 column 2:0: expected "8" but was "16"
row 5 column 2:a list containing
row 5 column 2:0: expected "8" but was "16"
Actual:
birth_year:long | age_group:keyword | count:long
1965            | Middle-aged       | 2         
1964            | Middle-aged       | 8         
1963            | Middle-aged       | 14        
1962            | Senior            | 12        
1961            | Senior            | 16        
1960            | Senior            | 16        

Expected:
birth_year:long | age_group:keyword | count:long
1965            | Middle-aged       | 1         
1964            | Middle-aged       | 
[truncated]

Issue Reasons:

  • [8.x] 5 failures in test test {enrich.EnrichAgesStatsYear SYNC} (2.7% fail rate in 188 executions)
  • [8.x] 4 failures in pipeline elasticsearch-periodic-platform-support (80.0% fail rate in 5 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :Analytics/ES|QL AKA ESQL >test-failure Triaged test failures from CI Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) needs:risk Requires assignment of a risk label (low, medium, blocker) labels Apr 17, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-analytical-engine (Team:Analytics)

@fang-xing-esql fang-xing-esql added medium-risk An open issue or test failure that is a medium risk to future releases and removed needs:risk Requires assignment of a risk label (low, medium, blocker) labels Apr 21, 2025
@fang-xing-esql
Copy link
Member

fang-xing-esql commented Apr 21, 2025

#127041, #127042, #127043 are duplicates of this, and they look like wrong results, all the counts are doubled, I couldn't reproduce this locally, setting risk to medium for now.

@alex-spies
Copy link
Contributor

Couldn't reproduce, either. Also, only the first build scan shows this test failure, the other ones failed due to timeouts during test setup.

The fact that we count every row twice is suspicious. Maybe it's some kind of (very rare) timing issue where, possibly, a shard was being relocated from one node to the other and therefore FROM employees | ... read the employees index twice?

@dnhatn dnhatn self-assigned this Apr 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL medium-risk An open issue or test failure that is a medium risk to future releases Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI
Projects
None yet
Development

No branches or pull requests

4 participants