Dear Colleagues,

I have a survey setup and published. I now want to import data into this survey which has been backed up from a central server. I essentially want to clone the survey and data onto my local computer. While importing the cluster data using the *.collect-data file I am able to create a data import summary (see below).

alt text

However, when I try to import the data I receive the following error

alt text

Is this error due to internet connectivity issues, mine is intermittent at best but given that I am running OF Collect through localhost I don't see how this could be a problem.

Many thanks, Wesley

asked 19 May '15, 12:54

jwesroberts's gravatar image

jwesroberts
113310
accept rate: 0%


Hi Wesley, Can you upload even the log files collect.log and catalina.out that you can find under your tomcat/logs folder? Probably there is an internal error while you are importing that file. Many thanks, Stefano

permanent link

answered 19 May '15, 14:06

Stefano%20%28OF%29's gravatar image

Stefano (OF) ♦♦
4.8k119
accept rate: 19%

Hi Stefano,

collect.log is around 60000 lines while catalina.out is much less. Contents of catalina.out below.

May 20, 2015 10:05:29 AM org.apache.catalina.core.AprLifecycleListener init INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /Users/Wesley/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. May 20, 2015 10:05:33 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["http-bio-8080"] May 20, 2015 10:05:33 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["ajp-bio-8009"] May 20, 2015 10:05:33 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 4860 ms May 20, 2015 10:05:33 AM org.apache.catalina.core.StandardService startInternal INFO: Starting service Catalina May 20, 2015 10:05:33 AM org.apache.catalina.core.StandardEngine startInternal INFO: Starting Servlet Engine: Apache Tomcat/7.0.37 May 20, 2015 10:05:33 AM org.apache.catalina.startup.HostConfig deployDescriptor INFO: Deploying configuration descriptor /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/conf/Catalina/localhost/collect.xml INFO 2015/05/20 10:06 AM:liquibase: Successfully acquired change log lock INFO 2015/05/20 10:06 AM:liquibase: Reading from DATABASECHANGELOG INFO 2015/05/20 10:06 AM:liquibase: Reading from DATABASECHANGELOG INFO 2015/05/20 10:06 AM:liquibase: Successfully released change log lock May 20, 2015 10:06:16 AM org.zkoss.zk.ui.http.WebManager <init>:115 INFO: Starting ZK 6.5.1.1 CE (build: 2012121311) May 20, 2015 10:06:16 AM org.zkoss.zk.ui.sys.ConfigParser parseConfigXml:160 INFO: Loading system default May 20, 2015 10:06:17 AM org.zkoss.zk.ui.sys.ConfigParser parse:267 INFO: Parsing jndi:/localhost/collect/WEB-INF/zk.xml May 20, 2015 10:06:17 AM org.zkoss.zk.ui.sys.ConfigParser parseSystemConfig:560 INFO: The event processing thread is disabled May 20, 2015 10:06:17 AM org.apache.catalina.session.StandardManager doLoad SEVERE: IOException while loading persisted sessions: java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1354) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.catalina.session.StandardSession.readObject(StandardSession.java:1595) at org.apache.catalina.session.StandardSession.readObjectData(StandardSession.java:1060) at org.apache.catalina.session.StandardManager.doLoad(StandardManager.java:284) at org.apache.catalina.session.StandardManager.load(StandardManager.java:204) at org.apache.catalina.session.StandardManager.startInternal(StandardManager.java:491) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5300) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:633) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:657) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.catalina.session.StandardSession.writeObject(StandardSession.java:1671) at org.apache.catalina.session.StandardSession.writeObjectData(StandardSession.java:1077) at org.apache.catalina.session.StandardManager.doUnload(StandardManager.java:432) at org.apache.catalina.session.StandardManager.unload(StandardManager.java:353) at org.apache.catalina.session.StandardManager.stopInternal(StandardManager.java:518) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5479) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) ... 4 more

May 20, 2015 10:06:17 AM org.apache.catalina.session.StandardManager startInternal SEVERE: Exception loading sessions from persistent storage java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1354) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.catalina.session.StandardSession.readObject(StandardSession.java:1595) at org.apache.catalina.session.StandardSession.readObjectData(StandardSession.java:1060) at org.apache.catalina.session.StandardManager.doLoad(StandardManager.java:284) at org.apache.catalina.session.StandardManager.load(StandardManager.java:204) at org.apache.catalina.session.StandardManager.startInternal(StandardManager.java:491) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5300) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:633) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:657) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.catalina.session.StandardSession.writeObject(StandardSession.java:1671) at org.apache.catalina.session.StandardSession.writeObjectData(StandardSession.java:1077) at org.apache.catalina.session.StandardManager.doUnload(StandardManager.java:432) at org.apache.catalina.session.StandardManager.unload(StandardManager.java:353) at org.apache.catalina.session.StandardManager.stopInternal(StandardManager.java:518) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5479) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) ... 4 more

May 20, 2015 10:06:18 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/webapps/host-manager May 20, 2015 10:06:19 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/webapps/manager May 20, 2015 10:06:19 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["http-bio-8080"] May 20, 2015 10:06:19 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-8009"] May 20, 2015 10:06:19 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 45709 ms May 20, 2015 10:55:04 AM org.geotools.referencing.operation.projection.TransverseMercator.Inverse transform WARNING: Possible use of "Transverse_Mercator (Inverse transform)" projection outside its valid area. Latitude 101°00.2'S is out of range (±90°). May 20, 2015 11:06:09 AM org.geotools.referencing.factory.DeferredAuthorityFactory disposeBackingStore INFO: Disposing class org.geotools.referencing.factory.epsg.ThreadedHsqlEpsgFactory backing store May 20, 2015 1:55:44 PM org.apache.catalina.util.SessionIdGenerator createSecureRandom INFO: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [5,134] milliseconds. May 20, 2015 2:14:03 PM org.apache.coyote.AbstractProtocol pause INFO: Pausing ProtocolHandler ["http-bio-8080"] May 20, 2015 2:14:04 PM org.apache.coyote.AbstractProtocol pause INFO: Pausing ProtocolHandler ["ajp-bio-8009"] May 20, 2015 2:14:04 PM org.apache.catalina.core.StandardService stopInternal INFO: Stopping service Catalina

permanent link

answered 20 May '15, 15:06

jwesroberts's gravatar image

jwesroberts
113310
accept rate: 0%

Just some additional information from collect.out. The main error I found is as follows

2015-05-20 13:58:18,299 [http-bio-8080-exec-8] ERROR (ServiceExceptionHandler.java [handleInvocationException]:30) - Error while communicating with collect server org.granite.messaging.service.security.SecurityServiceException: Access is denied

Here is a link to the full log file

https://drive.google.com/open?id=0B7gvRX3ZUIUEbXk2aTBENVNBTFU&authuser=0

Regards, Wesley

permanent link

answered 20 May '15, 15:31

jwesroberts's gravatar image

jwesroberts
113310
accept rate: 0%

Hi Wesley,

Actually it's the first time we have such a problem in the data import tool. Do you have the error after some minutes that the process is running? What is the completion percentage when you have the error?

By the way, try to use the latest version of Collect (3.5.4) because there was a big improvement in the performances of the data import tool.

Please try it and let us know, many thanks.

permanent link

answered 21 May '15, 10:51

Stefano%20%28OF%29's gravatar image

Stefano (OF) ♦♦
4.8k119
accept rate: 19%

Okay, I will upgrade the version and rerun the import.

The last attempted import got to 62% before I received the error. Before that it was bombing before 10%. Progress much.

Will upgrade and let you know. W.

(21 May '15, 12:05) jwesroberts jwesroberts's gravatar image
Your answer
toggle preview

Follow this question

By Email:

Once you sign in you will be able to subscribe for any updates here

By RSS:

Answers

Answers and Comments

Markdown Basics

  • *italic* or _italic_
  • **bold** or __bold__
  • link:[text](http://url.com/ "title")
  • image?![alt text](/path/img.jpg "title")
  • numbered list: 1. Foo 2. Bar
  • to add a line break simply add two spaces to where you would like the new line to be.
  • basic HTML tags are also supported

Question tags:

×494

question asked: 19 May '15, 12:54

question was seen: 7,933 times

last updated: 21 May '15, 12:05