Skip to content

Ability to opt out a field from fallback synthetic source #126795

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
lkts opened this issue Apr 14, 2025 · 1 comment
Open

Ability to opt out a field from fallback synthetic source #126795

lkts opened this issue Apr 14, 2025 · 1 comment
Labels
:StorageEngine/Mapping The storage related side of mappings Team:StorageEngine

Comments

@lkts
Copy link
Contributor

lkts commented Apr 14, 2025

With synthetic _source enabled, values of fields that are not indexed (e.g. using dynamic: false) are stored in a special stored field. This is needed to replicate the behaviour of stored _source and enable reindexing that changes the mapping to now index such a field.

With stored _source it is possible to use excludes field on _source mapper to exclude the field from being stored in _source stored field. With this configuration a field will be not represented on disk in any way. This scenario is currently not possible using synthetic _source because excludes field is not compatible with synthetic _source. So in such case field values will be stored via fallback synthetic source making such setup less efficient in terms of storage space.

This issue is about exposing configuration options to achieve the same result of zero bytes being stored for a field.

@lkts lkts added the :StorageEngine/Mapping The storage related side of mappings label Apr 14, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:StorageEngine/Mapping The storage related side of mappings Team:StorageEngine
Projects
None yet
Development

No branches or pull requests

2 participants