Issue: Stream is not seekable

iPaaS Core Incoming Configuration
1

Hi all,

Inside of my incoming configuration I’m trying to:

  1. Download and unpack a compressed file (ZIP)
  2. Access a JSON file from that ZIP
  3. Read and store the products inside of that JSON file

image
image1167×621 35.4 KB

Step 1 and 2 are working fine, but somehow I’m not able to read the data from the JSON. The logging states that ‘Stream is not seekable’:

image
image800×782 52.8 KB

I have already tried changing the ‘Path to incrementally read over’ but this parameter does not seem to be causing the issue?
Can anyone help me pinpoint what the problem is? Is the JSON file protected in some way?

Thanks in advance!

3

Hi Ties,

Thank you for reporting the issue.

We are currently taking a look into it. We will get back to you once we have an update.

4

Hi @Ties,

Thank you for providing more information via private messages.

The error is thrown when reading a JSON file incrementally inside an archive. Reading the whole file should work, but in this case, your file is a really big one (more than 800 MB). With the default memory limit (384 MB), it will throw an out-of-memory error. We tried increasing the memory to 1.5 GB but it still threw an out-of-memory error.

We will pass this issue to the corresponding team for further discussion. Please kindly wait for any updates.