Add empty fields cleanup ingest processor #44956
Labels
:Data Management/Ingest Node
Execution or management of Ingest Pipelines including GeoIP
>enhancement
Team:Data Management
Meta label for data/management team
Describe the feature:
Using the
Dot Expander
processor followed by field renames can easily produce empty temporary leftover fields which are difficult to spot.For example, the Elasticsearch audit pipeline in Filebeat 7.2.0 produces the following document, where
event
,origin
, anduser
are leftovers from renamed fields:For example, this is the
event
part of the pipeline:Instead of manually cleaning up, I'd suggest the implementation of a new ingest processor to clean up all empty fields at once.
The processor should support an optional
path
argument to limit its scope where needed.The text was updated successfully, but these errors were encountered: