Incrementally parsing large XML file

iPaaS Core Incoming Configuration
1

We’re running into a problem when parsing a large XML file (105MB)

The structure of the document is somewhat as follows:

<?xml version="1.0" encoding="utf-8"?>
<Document>
    <node>
        <id>1</id>
        <foo>bar</foo>
        <bar>foo</bar>
        <baz>test</baz>
        <date>12-12-2003</date>
    </node>
    <node>
        <id>2</id>
        <foo>bar</foo>
        <bar>foo</bar>
        <baz>test</baz>
        <date>12-12-2003</date>
    </node>
    <!-- etc etc -->
</Document>

The number of <node>-elements exceeds 260.000, thus we have to parse that incrementally. But when testing this as follows:

image
image1053×483 30.4 KB

It still fails. When deselecting the Include all items we’re only seeing the first <node> being returned… ?

Now what?

2

Hi @robin.speekenbrink,

Your configuration seems to be correct.
If it fails due to Memory Limit, we recommend executing the incoming by a scheduler.