python - Exception when training data in Predictionio -
i trying deploy recommendation engine mentioned in quick start guide. completed steps build engine. want train recommendation engine. did mentioned in quick start guide. (execute pio train
). got lengthy error log , couldn't paste here. putting first few rows of error.
[info] [console$] using existing engine manifest json @ /home/predictionio/predictionio-0.9.6/bin/myrecommendation/manifest.json [info] [runner$] submission command: /home/predictionio/predictionio-0.9.6/vendors/spark-1.5.1-bin-hadoop2.6/bin/spark-submit --class io.prediction.workflow.createworkflow --jar/predictionio/predictionio-0.9.6/bin/myrecommendation/target/scala-2.10/template-scala-parallel-recommendation_2.10-0.1-snapshot.jar,file:/home/predictionio/predictionio-0.9.6/bndation/target/scala-2.10/template-scala-parallel-recommendation-assembly-0.1-snapshot-deps.jar --files file:/home/predictionio/predictionio-0.9.6/conf/log4j.properties --driver/home/predictionio/predictionio-0.9.6/conf:/home/predictionio/predictionio-0.9.6/lib/postgresql-9.4-1204.jdbc41.jar:/home/predictionio/predictionio-0.9.6/lib/mysql-connector-jav file:/home/predictionio/predictionio-0.9.6/lib/pio-assembly-0.9.6.jar --engine-id qokyfr4rwibijnjabxevsqkkfracyryz --engine-version ed29b3e2074149d483aa85b6b1ea35a52dbbdb9a --et file:/home/predictionio/predictionio-0.9.6/bin/myrecommendation/engine.json --verbosity 0 --json-extractor both --env pio_env_loaded=1,pio_storage_repositories_metadata_name=pfs_basedir=/root/.pio_store,pio_home=/home/predictionio/predictionio-0.9.6,pio_fs_enginesdir=/root/.pio_store/engines,pio_storage_sources_pgsql_url=jdbc:postgresql://localhost/pge_repositories_metadata_source=pgsql,pio_storage_repositories_modeldata_source=pgsql,pio_storage_repositories_eventdata_name=pio_event,pio_storage_sources_pgsql_password=pio,piurces_pgsql_type=jdbc,pio_fs_tmpdir=/root/.pio_store/tmp,pio_storage_sources_pgsql_username=pio,pio_storage_repositories_modeldata_name=pio_model,pio_storage_repositories_eventdgsql,pio_conf_dir=/home/predictionio/predictionio-0.9.6/conf [info] [engine] extracting datasource params... [info] [workflowutils$] no 'name' found. default empty string used. [info] [engine] datasource params: (,datasourceparams(myapp3,none)) [info] [engine] extracting preparator params... [info] [engine] preparator params: (,empty) [info] [engine] extracting serving params... [info] [engine] serving params: (,empty) [warn] [utils] hostname, test-digin resolves loopback address: 127.0.1.1; using 192.168.2.191 instead (on interface p5p1) [warn] [utils] set spark_local_ip if need bind address [info] [remoting] starting remoting [info] [remoting] remoting started; listening on addresses :[akka.tcp://sparkdriver@192.168.2.191:56574] [warn] [metricssystem] using default name dagscheduler source because spark.app.id not set. [info] [engine$] engineworkflow.train [info] [engine$] datasource: duo.datasource@6088451e [info] [engine$] preparator: duo.preparator@1642eeae [info] [engine$] algorithmlist: list(duo.alsalgorithm@a09303) [info] [engine$] data sanity check on. [info] [engine$] duo.trainingdata not support data sanity check. skipping check. [info] [engine$] duo.prepareddata not support data sanity check. skipping check. [warn] [blas] failed load implementation from: com.github.fommil.netlib.nativesystemblas [warn] [blas] failed load implementation from: com.github.fommil.netlib.nativerefblas [warn] [lapack] failed load implementation from: com.github.fommil.netlib.nativesystemlapack [warn] [lapack] failed load implementation from: com.github.fommil.netlib.nativereflapack exception in thread "main" org.apache.spark.sparkexception: job aborted due stage failure: task serialization failed: java.lang.stackoverflowerror java.io.objectstreamclass.invokewriteobject(objectstreamclass.java:1028) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1496) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1509) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1509) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.writeobject(objectoutputstream.java:348) scala.collection.immutable.$colon$colon.writeobject(list.scala:379) sun.reflect.generatedmethodaccessor3.invoke(unknown source) sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) java.lang.reflect.method.invoke(method.java:498) java.io.objectstreamclass.invokewriteobject(objectstreamclass.java:1028) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1496) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1509) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1509) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1509) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548) java.io.objectoutputstream.writeserialdata(objectoutputstream.java:1509) java.io.objectoutputstream.writeordinaryobject(objectoutputstream.java:1432) java.io.objectoutputstream.writeobject0(objectoutputstream.java:1178) java.io.objectoutputstream.defaultwritefields(objectoutputstream.java:1548)
what can overcome isssue?
your error says java.lang.stackoverflowerror
can reduce numiterations parameter
in engine.json
file. refer this.
Comments
Post a Comment