[redland-dev] Raptor Turle parser memory usage

Medha Atre medha.atre at gmail.com
Sun Jul 8 21:15:15 EDT 2012


Hello,

I am trying to use the Raptor RDF parser library to parse a very large
RDF/XML file of LUBM dataset (synthetically generated) and convert it into
Turle representation. The gzipped format of RDF/XML file itself is 5.1 GB
(I am reading its input through a fifo and "rapper" reads from this fifo).

When I run "rapper" command to convert RDF/XML into Turtle on this file,
the memory utilization shoots up very high (it consumes almost all of my
RAM leaving me unable to do anything else on the computer).

I was wondering if there is any option to restrict the memory used by
"rapper" tool? I checked "configure" and "rapper --help", but didn't find
any such option.

Can someone please let me know what the best and easiest workaround for
this?

Thanks.

Medha
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.librdf.org/pipermail/redland-dev/attachments/20120708/6449cd93/attachment.html>


More information about the redland-dev mailing list