Filters: Show why an filter has filtered out some entities

In incoming job we use filters to filter out not-relevant entities.

In the logging of the incoming there is now a message “filtered out 300 of 1.000 entity”.

For some incomign jobs multiple filters are used to only fetch the relevant entities.

It would give us more insight in the logs to have a reference which filter has filtered out that much entities.

Example:
The incoming configuration fetch all stock from the source system.
Filter 1: Stock is “enabled”
Filter 2: Stock is “sellable”
Filter 3: Stock is changed compared with the stock in the storage from last run
Filter 4: The product is present in the e-commerce platform

We now have nu clue which filter does filter what amount of stock entities.

For now it would be helpfull to have a tag or description from the specific filter.

I think I mentioned it before last year, but couldn’t find it anywhere. Wanted to bring it to your attention.

1 Like

Hi @lars.rezelman

We’re very sorry for the long wait in responding to your question—it was unfortunately overlooked. Here’s the information you needed: Our team has been working on an epic that would improve the logging. Hopefully, it would enhance efficiency and improve your troubleshooting process. If the development goes well, it will be ready by the end of December. Please wait on any updates of our Release Notes page.

To avoid such delays in the future, we’ve improved how we handle forum questions. If you have any further concerns, we’re here to help!

Thank you for your understanding.