Re: Stability problems in eXist

Wolfgang Meier <sbhati <at> web.de> writes:
> 
> It would be interesting to know the set of operations you are calling on the 
> database? Are you using XUpdate? Or are you just storing/removing/replacing 
> resources? Are resources accessed concurrently by multiple users?
> 
> Wolfgang
> 
> 
Hello,

Thanks for your answer, here are what we are doing for operations:

Our tests showed that the errors occur when we write into the database. We use 
these methods from the eXist Webservice (SOAP) to write to the DB:
- xupdateResource
- xupdate
- store
- removeDocument
- createCollection
- removeCollection

We did several tests on the DB.
The first test was a writing test. It wrote 100 XML files in the DB.
The second test was a reading / writing test on the documents from a 
collection.
The last test inserts XML files in the DB from a folder on the hard disk.

We could insert up to 20'000 xml files (from 2 to 20 ko each, not complex XML 
files). But after this the database was corrupted (see errors below).

At this step, the only solution is to export documents with "export" function 
and re-import data in a new DB. But it doesn't work all the time. So sometime 
we loose data.

For your last question, yes, multiple users are accessing concurrently the 
eXist DB. But for the moment, we are only 2 developers plus one administrator 
so there is not a lot of concurrently requests...

Thanks for your answer and your job!

Cédric Meier

------------------------------------------------
Error when we try to delete a corrupted element:

org.exist.EXistException: null
java.lang.NullPointerException
            at org.exist.storage.NativeElementIndex.dropIndex
(NativeElementIndex.java:413)
            at org.exist.storage.NativeBroker.removeDocument
(NativeBroker.java:1874)
            at org.exist.storage.DBBroker.removeDocument(DBBroker.java:423)
            at org.exist.collections.Collection.removeDocument
(Collection.java:713)
            at org.exist.xmlrpc.RpcConnection.remove(RpcConnection.java:1302)
            at org.exist.xmlrpc.RpcServer.remove(RpcServer.java:935)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
            at java.lang.reflect.Method.invoke(Unknown Source)
            at org.exist.xmlrpc.AuthenticatedHandler.execute
(AuthenticatedHandler.java:116)
            at org.exist.xmlrpc.AuthenticatedHandler.execute
(AuthenticatedHandler.java:63)
            at org.apache.xmlrpc.XmlRpcWorker.invokeHandler(Unknown Source)
            at org.apache.xmlrpc.XmlRpcWorker.execute(Unknown Source)
            at org.apache.xmlrpc.XmlRpcServer.execute(Unknown Source)
            at org.apache.xmlrpc.XmlRpcServer.execute(Unknown Source)
            at org.exist.xmlrpc.RpcServlet.doPost(RpcServlet.java:39)
            at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
            at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
            at org.mortbay.jetty.servlet.ServletHolder.handle
(ServletHolder.java:366)
            at org.mortbay.jetty.servlet.WebApplicationHandler.dispatch
(WebApplicationHandler.java:293)
            at org.mortbay.jetty.servlet.ServletHandler.handle
(ServletHandler.java:581)
            at org.mortbay.http.HttpContext.handle(HttpContext.java:1687)
            at org.mortbay.jetty.servlet.WebApplicationContext.handle
(WebApplicationContext.java:544)
            at org.mortbay.http.HttpContext.handle(HttpContext.java:1637)
            at org.mortbay.http.HttpServer.service(HttpServer.java:875)
            at org.mortbay.http.HttpConnection.service(HttpConnection.java:806)
            at org.mortbay.http.HttpConnection.handleNext
(HttpConnection.java:956)
            at org.mortbay.http.HttpConnection.handle(HttpConnection.java:823)
            at org.mortbay.http.SocketListener.handleConnection
(SocketListener.java:202)
            at org.mortbay.util.ThreadedServer.handle(ThreadedServer.java:290)
            at org.mortbay.util.ThreadPool$JobRunner.run(ThreadPool.java:743)
            at java.lang.Thread.run(Unknown Source)




-------------------------------------------------------
This SF.Net email is sponsored by: YOU BE THE JUDGE. Be one of 170
Project Admins to receive an Apple iPod Mini FREE for your judgement on
who ports your project to Linux PPC the best. Sponsored by IBM. 
Deadline: Sept. 13. Go here: http://sf.net/ppc_contest.php