users
[Top] [All Lists]

Re: [cinjug-users] Max file size for DOM parser

To: users@xxxxxxxxxx
Subject: Re: [cinjug-users] Max file size for DOM parser
From: "James Carman" <james@xxxxxxxxxxxxxxxxxxxx>
Date: Wed, 14 Feb 2007 13:00:32 -0500
Delivered-to: mailing list users@cinjug.org
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:sender:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=HTFMk+F4EG3NdxgjbKTyVYN1/sAC3SOIWlpE/MuHVVGLvsZYfpzdN5kSYHgmvOUt4kaOKVb+e4878BB1TOAjxjkknd/uky9lD8v2Bii3jMsaeafPySIaYlYqlLM5puXwhjTK94ulT+uUjBIP4svZPo/nZRBsj/waksAmwjt3sAs=
In-reply-to: <0BE974242D712B4B86B49792A69D789C01A0536F@CINMLVEM15.e2k.ad.ge.com>
Mailing-list: contact users-help@cinjug.org; run by ezmlm
References: <4e2988cc0702140828m511f73d7ua38ce16754d5d962@mail.gmail.com> <0BE974242D712B4B86B49792A69D789C01A0536F@CINMLVEM15.e2k.ad.ge.com>
Sender: jwcarman@xxxxxxxxx
Another question is do you have to use a DOM parser or can you go with SAX?

On 2/14/07, Hudson, Loren (GE Infra, Aviation, Non-GE, US)
<loren.hudson@xxxxxx> wrote:


Kumar,

Well, I don't know about the max size of the xml file, but I know I've run
the JVM out of memory on a linux box before.  There were something like
20,000 top-level objects, each with 5-10 objects under it.  It ran out
before it got to 5000, if I remember right.  I've no clue what that would
translate into in terms of actual file size, or how much memory was on that
system.

I think it's pretty simple to test, but I'm going to guess that you don't
have access to the server on which this application will run.  If you did,
you could use a package (like jdom - www.jdom.org) with a certain number of
top-level objects.  (Am I using the right xml terminology when I say
top-level objects?)  Export that to an xml file, then parse it back into a
DOM.  Keep increasing the size until you run  the JVM out of memory.  Java
command-line programs are simple enough to create that you can have your
results in an hour or so.

An important question back to you is this:  Will this application only do
one file at a time, or will it need to do concurrent parsing?

I hope that my ramblings have helped.  I'm interested in knowing what
testing and other users have to say about it.

Mike Hudson
MDW - MESA/Java
GE AE, Evendale, Ohio
loren.hudson@xxxxxxxxx
Desk: 513-243-3663
Cell:  513-546-4166


________________________________ From: Kumar [mailto:kumarkakani@xxxxxxxxx] Sent: Wednesday, February 14, 2007 11:28 AM To: users@xxxxxxxxxx Subject: [cinjug-users] Max file size for DOM parser


Hello everyone,

I am designing a Java application that would initially run on a Windows PC
with 2GB RAM that processes XML files using DOM parser. I was wondering what
would the maximum XML file size for such an application be? I would
appreciate your advise.

Thanks in advance.
Kumar


<Prev in Thread] Current Thread [Next in Thread>