EQL: consider applying tier filters also to field_caps #126467
Labels
:Analytics/EQL
EQL querying
>non-issue
Team:Analytics
Meta label for analytical engine team (ESQL/Aggs/Geo)
In some scenarios, the user could expect that if a query only involves data from a specific tier, it doesn't consider other tiers at all, not even for planning purposes.
This is not true today, eg. if a
foo
field is declared askeyword
in the hot tier indices and astext
in the frozen tier indices , even if the query hasaccessing that field in the query will still lead to conflicts, eg.
This is due to the fact that
field_caps
does not take filters into consideration, and the planning is executed base on the mappings of all the indices.This is by design, but sometimes it's confusing, so we could consider reviewing it or providing an option for a different default.
For completeness, changing this behavior could lead to errors on existing queries:
idx1
...idxN
idx1
has a field calledfoo
, other indices don'tidx1
is on the hot tieridx1
is moved to the frozen tier, with current defaults the query keeps working fine; if we change the defaults, completely ignoring the frozen tier, the query will start failing.The text was updated successfully, but these errors were encountered: