[CI] GeoIpMultiProjectIT class failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic #8951 / release-tests
• elasticsearch-pull-request #77358 / checkpart1_release-tests
• elasticsearch-pull-request #77343 / checkpart1_release-tests
• elasticsearch-pull-request #77328 / checkpart1_release-tests
• elasticsearch-periodic #8944 / release-tests
• elasticsearch-periodic #8931 / release-tests

Reproduction Line:

undefined

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

undefined

Issue Reasons:

• [main] 3 consecutive failures in step release-tests
• [main] 3 consecutive failures in step checkpart1_release-tests
• [main] 6 failures in class geoip.GeoIpMultiProjectIT (3.4% fail rate in 175 executions)
• [main] 3 failures in step release-tests (100.0% fail rate in 3 executions)
• [main] 3 failures in step checkpart1_release-tests (100.0% fail rate in 3 executions)
• [main] 3 failures in pipeline elasticsearch-periodic (75.0% fail rate in 4 executions)
• [main] 3 failures in pipeline elasticsearch-pull-request (4.5% fail rate in 67 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

Pinging @elastic/es-data-management (Team:Data Management)

[nielsbauman]

Assigning low risk because this concerns multi-project tests, which are not relevant to production yet.

The first build failed with

[2025-06-17T12:35:38,139][ERROR][o.e.i.g.GeoIpDownloader  ] [test-cluster-0] error downloading geoip database [GeoLite2-City.mmdb] for project [-DpVs___T_-6Lemy_____w] org.elasticsearch.ResourceNotFoundException: the project [default] task with id -DpVs___T_-6Lemy_____w/geoip-downloader and allocation id 3 doesn't exist	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.persistent.PersistentTasksClusterService$4.execute(PersistentTasksClusterService.java:358)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService$UnbatchedExecutor.execute(MasterService.java:580)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService.innerExecuteTasks(MasterService.java:1076)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:1039)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService.executeAndPublishBatch(MasterService.java:246)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.lambda$run$2(MasterService.java:1692)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.action.ActionListener.run(ActionListener.java:465)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService$BatchingTaskQueue$Processor.run(MasterService.java:1689)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService$5.lambda$doRun$0(MasterService.java:1284)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.action.ActionListener.run(ActionListener.java:465)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.MasterService$5.doRun(MasterService.java:1263)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:1044)	
	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:27)	
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1095)	
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:619)	
	at java.base/java.lang.Thread.run(Thread.java:1447)	
[2025-06-17T12:35:38,289][WARN ][o.e.p.PersistentTasksClusterService] [test-cluster-0] trying to update state on non-existing project [default] task -DpVs___T_-6Lemy_____w/geoip-downloader

That's something @samxbr will have to investigate further.

The second build failed with

fatal exception while booting Elasticsearch java.lang.IllegalStateException: external test module [test-multi-project] found in non-snapshot build

Meaning we should just disable this test/suite for release builds.

[samxbr]

The elasticsearch-pull-request #76087 / part-1 is an old build from a pull request, it can be ignored.

@elastic/es-delivery I wonder is it intended to have PR build failure included in these CI failure issues?