Hi Alumio,
I was just working on an incoming which retrieves a large set of products (+/- 9.000) and validates them by JSON Schema. The products are relatively large and there’s no option to paginate, so I used the response-streaming method (incremental, []
). That works.
However, there seems to be a memory leak somewhere in the ‘validate by json schema’ system.
When I just ‘save entity to storage’, I get a memory used of 76mb for the entire 9.000 products.
When I use either (tested both) a filter on the Data, Transform with the Validate by JSON Schema or a Conditional Transformer with the Validate by JSON Schema, I get an out-of-memory after about 2.500 products.