Import collect-data error - Mac OSX Lion OF v3.5.1

  • Asked
  • Active
  • Viewed 9760 times
0

Dear Colleagues,

I have a survey setup and published. I now want to import data into this survey which has been backed up from a central server. I essentially want to clone the survey and data onto my local computer. While importing the cluster data using the *.collect-data file I am able to create a data import summary (see below).

alt text

However, when I try to import the data I receive the following error

alt text

Is this error due to internet connectivity issues, mine is intermittent at best but given that I am running OF Collect through localhost I don't see how this could be a problem.

Many thanks, Wesley

0

Accepted answer

Hi Wesley, Can you upload even the log files collect.log and catalina.out that you can find under your tomcat/logs folder? Probably there is an internal error while you are importing that file. Many thanks, Stefano

0

Accepted answer

Hi Stefano,

collect.log is around 60000 lines while catalina.out is much less. Contents of catalina.out below.

May 20, 2015 10:05:29 AM org.apache.catalina.core.AprLifecycleListener init INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /Users/Wesley/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:. May 20, 2015 10:05:33 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["http-bio-8080"] May 20, 2015 10:05:33 AM org.apache.coyote.AbstractProtocol init INFO: Initializing ProtocolHandler ["ajp-bio-8009"] May 20, 2015 10:05:33 AM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 4860 ms May 20, 2015 10:05:33 AM org.apache.catalina.core.StandardService startInternal INFO: Starting service Catalina May 20, 2015 10:05:33 AM org.apache.catalina.core.StandardEngine startInternal INFO: Starting Servlet Engine: Apache Tomcat/7.0.37 May 20, 2015 10:05:33 AM org.apache.catalina.startup.HostConfig deployDescriptor INFO: Deploying configuration descriptor /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/conf/Catalina/localhost/collect.xml INFO 2015/05/20 10:06 AM:liquibase: Successfully acquired change log lock INFO 2015/05/20 10:06 AM:liquibase: Reading from DATABASECHANGELOG INFO 2015/05/20 10:06 AM:liquibase: Reading from DATABASECHANGELOG INFO 2015/05/20 10:06 AM:liquibase: Successfully released change log lock May 20, 2015 10:06:16 AM org.zkoss.zk.ui.http.WebManager <init>:115 INFO: Starting ZK 6.5.1.1 CE (build: 2012121311) May 20, 2015 10:06:16 AM org.zkoss.zk.ui.sys.ConfigParser parseConfigXml:160 INFO: Loading system default May 20, 2015 10:06:17 AM org.zkoss.zk.ui.sys.ConfigParser parse:267 INFO: Parsing jndi:/localhost/collect/WEB-INF/zk.xml May 20, 2015 10:06:17 AM org.zkoss.zk.ui.sys.ConfigParser parseSystemConfig:560 INFO: The event processing thread is disabled May 20, 2015 10:06:17 AM org.apache.catalina.session.StandardManager doLoad SEVERE: IOException while loading persisted sessions: java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1354) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.catalina.session.StandardSession.readObject(StandardSession.java:1595) at org.apache.catalina.session.StandardSession.readObjectData(StandardSession.java:1060) at org.apache.catalina.session.StandardManager.doLoad(StandardManager.java:284) at org.apache.catalina.session.StandardManager.load(StandardManager.java:204) at org.apache.catalina.session.StandardManager.startInternal(StandardManager.java:491) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5300) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:633) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:657) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.catalina.session.StandardSession.writeObject(StandardSession.java:1671) at org.apache.catalina.session.StandardSession.writeObjectData(StandardSession.java:1077) at org.apache.catalina.session.StandardManager.doUnload(StandardManager.java:432) at org.apache.catalina.session.StandardManager.unload(StandardManager.java:353) at org.apache.catalina.session.StandardManager.stopInternal(StandardManager.java:518) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5479) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) ... 4 more

May 20, 2015 10:06:17 AM org.apache.catalina.session.StandardManager startInternal SEVERE: Exception loading sessions from persistent storage java.io.WriteAbortedException: writing aborted; java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1354) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.catalina.session.StandardSession.readObject(StandardSession.java:1595) at org.apache.catalina.session.StandardSession.readObjectData(StandardSession.java:1060) at org.apache.catalina.session.StandardManager.doLoad(StandardManager.java:284) at org.apache.catalina.session.StandardManager.load(StandardManager.java:204) at org.apache.catalina.session.StandardManager.startInternal(StandardManager.java:491) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5300) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:633) at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:657) at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1637) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.NotSerializableException: org.openforis.collect.web.controller.SessionController at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1183) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1547) at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1508) at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1431) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1177) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:347) at org.apache.catalina.session.StandardSession.writeObject(StandardSession.java:1671) at org.apache.catalina.session.StandardSession.writeObjectData(StandardSession.java:1077) at org.apache.catalina.session.StandardManager.doUnload(StandardManager.java:432) at org.apache.catalina.session.StandardManager.unload(StandardManager.java:353) at org.apache.catalina.session.StandardManager.stopInternal(StandardManager.java:518) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.StandardContext.stopInternal(StandardContext.java:5479) at org.apache.catalina.util.LifecycleBase.stop(LifecycleBase.java:232) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1575) at org.apache.catalina.core.ContainerBase$StopChild.call(ContainerBase.java:1564) ... 4 more

May 20, 2015 10:06:18 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/webapps/host-manager May 20, 2015 10:06:19 AM org.apache.catalina.startup.HostConfig deployDirectory INFO: Deploying web application directory /Users/Wesley/Documents/work/FAO/OpenForis/Collect/collect-server/tomcat/webapps/manager May 20, 2015 10:06:19 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["http-bio-8080"] May 20, 2015 10:06:19 AM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-8009"] May 20, 2015 10:06:19 AM org.apache.catalina.startup.Catalina start INFO: Server startup in 45709 ms May 20, 2015 10:55:04 AM org.geotools.referencing.operation.projection.TransverseMercator.Inverse transform WARNING: Possible use of "Transverse_Mercator (Inverse transform)" projection outside its valid area. Latitude 101°00.2'S is out of range (±90°). May 20, 2015 11:06:09 AM org.geotools.referencing.factory.DeferredAuthorityFactory disposeBackingStore INFO: Disposing class org.geotools.referencing.factory.epsg.ThreadedHsqlEpsgFactory backing store May 20, 2015 1:55:44 PM org.apache.catalina.util.SessionIdGenerator createSecureRandom INFO: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [5,134] milliseconds. May 20, 2015 2:14:03 PM org.apache.coyote.AbstractProtocol pause INFO: Pausing ProtocolHandler ["http-bio-8080"] May 20, 2015 2:14:04 PM org.apache.coyote.AbstractProtocol pause INFO: Pausing ProtocolHandler ["ajp-bio-8009"] May 20, 2015 2:14:04 PM org.apache.catalina.core.StandardService stopInternal INFO: Stopping service Catalina

0

Accepted answer

Just some additional information from collect.out. The main error I found is as follows

2015-05-20 13:58:18,299 [http-bio-8080-exec-8] ERROR (ServiceExceptionHandler.java [handleInvocationException]:30) - Error while communicating with collect server org.granite.messaging.service.security.SecurityServiceException: Access is denied

Here is a link to the full log file

https://drive.google.com/open?id=0B7gvRX3ZUIUEbXk2aTBENVNBTFU&authuser=0

Regards, Wesley

0

Accepted answer

Hi Wesley,

Actually it's the first time we have such a problem in the data import tool. Do you have the error after some minutes that the process is running? What is the completion percentage when you have the error?

By the way, try to use the latest version of Collect (3.5.4) because there was a big improvement in the performances of the data import tool.

Please try it and let us know, many thanks.

Okay, I will upgrade the version and rerun the import.

The last attempted import got to 62% before I received the error. Before that it was bombing before 10%. Progress much.

Will upgrade and let you know. W.

jwesroberts jwesroberts

Your answer

Markdown text. Shortcuts: Ctrl+B bold, Ctrl+I italic, Ctrl+K link, Ctrl+E code, Ctrl+Shift+V paste as plain text. Tab indents list items and code; press Escape, then Tab, to leave the text box.

Insert an image

Say what the image shows, for people who can't see it.

Keyboard shortcuts

Anywhere

?
Show this list
/
Search
g h
Go to the home page
g q
Go to the questions
g t
Go to the tags
g u
Go to the users
a
Ask a question

Lists of questions

j k
Next or previous question
Enter
Open the question

Question pages

j k
Next or previous post

Shortcuts never apply while you type in a text field. Members can turn them off in their preferences.