Skip to content

ESQL: Per shard metrics for the LuceneOperators and ValuesSourceReaderOperator #130462

Open
@nik9000

Description

@nik9000

Description

Right now the LuceneSourceOperator's profile contains:

              "processed_shards" : [
                "test2:0",
                "test:0"
              ],
              "process_nanos" : 40776172,
              "pages_emitted" : 414,
              "rows_emitted" : 2000000,

It'd be pretty useful to change processed_shards into:

              "processed_shards" : {
                "test2:0": { "process_nanos": 20776172, "pages_emitted": 200, "rows_emitted": 1000000},
                "test:0": { "process_nanos": 20776172, "pages_emitted": 200, "rows_emitted": 1000000},
              },

We should keep the overall process_nanos in the output - but it'd be super nice to break this down per shard.

It'd be lovely to do this to all subclasses of LuceneOperator and the ValuesSourceReaderOperator.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions