Dear Colleagues, I have a survey setup and published. I now want to import data into this survey which has been backed up from a central server. I essentially want to clone the survey and data onto my local computer. While importing the cluster data using the *.collect-data file I am able to create a data import summary (see below). However, when I try to import the data I receive the following error Is this error due to internet connectivity issues, mine is intermittent at best but given that I am running OF Collect through localhost I don't see how this could be a problem. Many thanks, Wesley asked 19 May '15, 12:54 jwesroberts |
Hi Wesley, Can you upload even the log files collect.log and catalina.out that you can find under your tomcat/logs folder? Probably there is an internal error while you are importing that file. Many thanks, Stefano answered 19 May '15, 14:06 Stefano (OF) ♦♦ |
Hi Stefano, collect.log is around 60000 lines while catalina.out is much less. Contents of catalina.out below. May 20, 2015 10:05:29 AM org.apache.catalina.core.AprLifecycleListener init INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /Users/Wesley/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. May 20, 2015 10:05:33 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["http-bio-8080"] May 20, 2015 10:05:33 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["ajp-bio-8009"] May 20, 2015 10:05:33 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 4860 ms May 20, 2015 10:05:33 AM org.apache.catalina.core.StandardService startInternal INFO: Starting service Catalina May 20, 2015 10:05:33 AM org.apache.catalina.core.StandardEngine startInternal INFO: Starting Servlet Engine: Apache Tomcat/7.0.37 May 20, 2015 10:05:33 AM org.apache.catalina.startup.HostConfig deployDescriptor INFO: Deploying configuration descriptor /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/conf/Catalina/localhost/collect.xml INFO 2015/05/20 10:06 AM:liquibase: Successfully acquired change log lock INFO 2015/05/20 10:06 AM:liquibase: Reading from DATABASECHANGELOG INFO 2015/05/20 10:06 AM:liquibase: Reading from DATABASECHANGELOG INFO 2015/05/20 10:06 AM:liquibase: Successfully released change log lock May 20, 2015 10:06:16 AM org.zkoss.zk.ui.http.WebManager <init>:115 INFO: Starting ZK 6.5.1.1 CE (build: 2012121311) May 20, 2015 10:06:16 AM org.zkoss.zk.ui.sys.ConfigParser parseConfigXml:160 INFO: Loading system default May 20, 2015 10:06:17 AM org.zkoss.zk.ui.sys.ConfigParser parse:267 INFO: Parsing jndi:/localhost/collect/WEB-INF/zk.xml May 20, 2015 10:06:17 AM org.zkoss.zk.ui.sys.ConfigParser parseSystemConfig:560 INFO: The event processing thread is disabled May 20, 2015 10:06:17 AM org.apache.catalina.session.StandardManager doLoad SEVERE: IOException while loading persisted sessions: java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1354) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.catalina.session.StandardSession.readObject(StandardSession.java:1595) at org.apache.catalina.session.StandardSession.readObjectData(StandardSession.java:1060) at org.apache.catalina.session.StandardManager.doLoad(StandardManager.java:284) at org.apache.catalina.session.StandardManager.load(StandardManager.java:204) at org.apache.catalina.session.StandardManager.startInternal(StandardManager.java:491) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5300) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:633) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:657) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.catalina.session.StandardSession.writeObject(StandardSession.java:1671) at org.apache.catalina.session.StandardSession.writeObjectData(StandardSession.java:1077) at org.apache.catalina.session.StandardManager.doUnload(StandardManager.java:432) at org.apache.catalina.session.StandardManager.unload(StandardManager.java:353) at org.apache.catalina.session.StandardManager.stopInternal(StandardManager.java:518) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5479) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) ... 4 more May 20, 2015 10:06:17 AM org.apache.catalina.session.StandardManager startInternal SEVERE: Exception loading sessions from persistent storage java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1354) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.catalina.session.StandardSession.readObject(StandardSession.java:1595) at org.apache.catalina.session.StandardSession.readObjectData(StandardSession.java:1060) at org.apache.catalina.session.StandardManager.doLoad(StandardManager.java:284) at org.apache.catalina.session.StandardManager.load(StandardManager.java:204) at org.apache.catalina.session.StandardManager.startInternal(StandardManager.java:491) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5300) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:633) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:657) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.catalina.session.StandardSession.writeObject(StandardSession.java:1671) at org.apache.catalina.session.StandardSession.writeObjectData(StandardSession.java:1077) at org.apache.catalina.session.StandardManager.doUnload(StandardManager.java:432) at org.apache.catalina.session.StandardManager.unload(StandardManager.java:353) at org.apache.catalina.session.StandardManager.stopInternal(StandardManager.java:518) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5479) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) ... 4 more May 20, 2015 10:06:18 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/webapps/host-manager May 20, 2015 10:06:19 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/webapps/manager May 20, 2015 10:06:19 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["http-bio-8080"] May 20, 2015 10:06:19 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-8009"] May 20, 2015 10:06:19 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 45709 ms May 20, 2015 10:55:04 AM org.geotools.referencing.operation.projection.TransverseMercator.Inverse transform WARNING: Possible use of "Transverse_Mercator (Inverse transform)" projection outside its valid area. Latitude 101°00.2'S is out of range (±90°). May 20, 2015 11:06:09 AM org.geotools.referencing.factory.DeferredAuthorityFactory disposeBackingStore INFO: Disposing class org.geotools.referencing.factory.epsg.ThreadedHsqlEpsgFactory backing store May 20, 2015 1:55:44 PM org.apache.catalina.util.SessionIdGenerator createSecureRandom INFO: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [5,134] milliseconds. May 20, 2015 2:14:03 PM org.apache.coyote.AbstractProtocol pause INFO: Pausing ProtocolHandler ["http-bio-8080"] May 20, 2015 2:14:04 PM org.apache.coyote.AbstractProtocol pause INFO: Pausing ProtocolHandler ["ajp-bio-8009"] May 20, 2015 2:14:04 PM org.apache.catalina.core.StandardService stopInternal INFO: Stopping service Catalina answered 20 May '15, 15:06 jwesroberts |
Just some additional information from collect.out. The main error I found is as follows 2015-05-20 13:58:18,299 [http-bio-8080-exec-8] ERROR (ServiceExceptionHandler.java [handleInvocationException]:30) - Error while communicating with collect server org.granite.messaging.service.security.SecurityServiceException: Access is denied Here is a link to the full log file https://drive.google.com/open?id=0B7gvRX3ZUIUEbXk2aTBENVNBTFU&authuser=0 Regards, Wesley answered 20 May '15, 15:31 jwesroberts |
Hi Wesley, Actually it's the first time we have such a problem in the data import tool. Do you have the error after some minutes that the process is running? What is the completion percentage when you have the error? By the way, try to use the latest version of Collect (3.5.4) because there was a big improvement in the performances of the data import tool. Please try it and let us know, many thanks. answered 21 May '15, 10:51 Stefano (OF) ♦♦ Okay, I will upgrade the version and rerun the import. The last attempted import got to 62% before I received the error. Before that it was bombing before 10%. Progress much. Will upgrade and let you know. W.
(21 May '15, 12:05)
jwesroberts
|