users
[Top] [All Lists]

RE: [cinjug-users] Max file size for DOM parser

To: "Kumar" <kumarkakani@xxxxxxxxx>, <users@xxxxxxxxxx>
Subject: RE: [cinjug-users] Max file size for DOM parser
From: "Hudson, Loren \(GE Infra, Aviation, Non-GE, US\)" <loren.hudson@xxxxxx>
Date: Wed, 14 Feb 2007 12:57:12 -0500
Delivered-to: mailing list users@cinjug.org
In-reply-to: <4e2988cc0702140828m511f73d7ua38ce16754d5d962@mail.gmail.com>
Mailing-list: contact users-help@cinjug.org; run by ezmlm
References: <4e2988cc0702140828m511f73d7ua38ce16754d5d962@mail.gmail.com>
Thread-index: AcdQVTsEbr6BqQ+4QACMl+RDvI6STQAClr2Q
Thread-topic: [cinjug-users] Max file size for DOM parser
Kumar,
 
Well, I don't know about the max size of the xml file, but I know I've run the JVM out of memory on a linux box before.  There were something like 20,000 top-level objects, each with 5-10 objects under it.  It ran out before it got to 5000, if I remember right.  I've no clue what that would translate into in terms of actual file size, or how much memory was on that system. 
 
I think it's pretty simple to test, but I'm going to guess that you don't have access to the server on which this application will run.  If you did, you could use a package (like jdom - www.jdom.org) with a certain number of top-level objects.  (Am I using the right xml terminology when I say top-level objects?)  Export that to an xml file, then parse it back into a DOM.  Keep increasing the size until you run  the JVM out of memory.  Java command-line programs are simple enough to create that you can have your results in an hour or so. 
 
An important question back to you is this:  Will this application only do one file at a time, or will it need to do concurrent parsing?
 
I hope that my ramblings have helped.  I'm interested in knowing what testing and other users have to say about it.
 
Mike Hudson
MDW - MESA/Java
GE AE, Evendale, Ohio
loren.hudson@xxxxxxxxx
Desk: 513-243-3663
Cell:  513-546-4166
 


From: Kumar [mailto:kumarkakani@xxxxxxxxx]
Sent: Wednesday, February 14, 2007 11:28 AM
To: users@xxxxxxxxxx
Subject: [cinjug-users] Max file size for DOM parser

Hello everyone,

I am designing a Java application that would initially run on a Windows PC with 2GB RAM that processes XML files using DOM parser. I was wondering what would the maximum XML file size for such an application be? I would appreciate your advise.

Thanks in advance.
Kumar
<Prev in Thread] Current Thread [Next in Thread>