Problems to use the EclairJS Server

[rosale]

Hi All,

I tried to use EclairJS Server following the instructions available here: https://github.com/EclairJS/eclairjs/tree/master/server

I’ve got this error after executing: git clone git@github.com:EclairJS/eclairjs.git

Cloning into 'eclairjs'...
Permission denied (publickey).
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.

Then, I've just cloned the main repository: https://github.com/EclairJS/eclairjs

However, after executing: mvn package I got the following error:

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1.117 s
[INFO] Finished at: 2016-11-14T13:27:23+01:00
[INFO] Final Memory: 20M/309M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project eclairjs-nashorn: Could not resolve dependencies for project org.eclairjs:eclairjs-nashorn:jar:0.9: The following artifacts could not be resolved: org.apache.toree.kernel:toree-kernel-api_2.11:jar:0.2.0.dev1-incubating-SNAPSHOT, org.apache.toree.kernel:toree-kernel_2.11:jar:0.2.0.dev1-incubating-SNAPSHOT: Failure to find org.apache.toree.kernel:toree-kernel-api_2.11:jar:0.2.0.dev1-incubating-SNAPSHOT in https://repository.apache.org/content/groups/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache-snapshots has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

And I noticed, indeed there is no 2.11 files in the repository (https://repository.apache.org/content/groups/snapshots/org/apache/toree/)

Could you please help me with this problem?

Thanks a lot in advance.

[Brian-P-Burns]

We need to update that README. The problem here is that you need to build Toree. Toree has not done a release for Spark 2.0.x as of yet so you will need to build Toree locally and make sure the jars get in your local maven repository. However Toree just recently made an API change on their master branch that effects us. I haven't checked that change into our master branch as of yet.

I'll see if I can clean up this mess today...

[doronrosenberg]

@rosale the README has been updated to reflect the Toree change (we added a commit you need to use to keep things working).

[rosale]

@bpburns thanks a lot! While deploying the Eclair Server again (https://github.com/EclairJS/eclairjs/tree/master/server) on a machine (Intel(R) Xeon(R) CPU E5-2680 0 @ 2.70GHz, 132GB RAM) with the following settings:

Ubuntu 14.04.4 LTS
Java(TM) SE Runtime Environment (build 1.8.0_111-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode)
Spark (V2.0.0 built for Hadoop 2.6.0 and later)
Apache Maven 3.3.9
sbt 0.13.13
git 2.10.2

I got several errors in the TESTS section after executing the command mvn package and therefore the procedure failed:

---

T E S T S

Running org.eclairjs.nashorn.CoreTest
doing foreach 2
doing foreach 1
doing foreach 3
doing foreachPartition 1
doing foreachPartition 3
doing foreachPartition 2
Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.925 sec - in org.eclairjs.nashorn.CoreTest
Running org.eclairjs.nashorn.WrappedObjectTest
{"0":1,"1":"A","length":2}
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in org.eclairjs.nashorn.WrappedObjectTest
Running org.eclairjs.nashorn.SqlTest
== Parsed Logical Plan ==
'Except
:- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256]
+- Filter (age#251 > 20)
+- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256]

== Analyzed Logical Plan ==
name: string, age: int, expense: int, DOB: timestamp, income: double, married: boolean, networth: double
Except
:- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256]
+- Filter (age#277 > 20)
+- LogicalRDD [name#276, age#277, expense#278, DOB#279, income#280, married#281, networth#282]

== Optimized Logical Plan ==
Aggregate [name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256], [name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256]
+- Join LeftAnti, (((((((name#250 <=> name#276) && (age#251 <=> age#277)) && (expense#252 <=> expense#278)) && (DOB#253 <=> DOB#279)) && (income#254 <=> income#280)) && (married#255 <=> married#281)) && (networth#256 <=> networth#282))
:- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256]
+- Filter (isnotnull(age#277) && (age#277 > 20))
+- LogicalRDD [name#276, age#277, expense#278, DOB#279, income#280, married#281, networth#282]

== Physical Plan ==
*HashAggregate(keys=[name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256], functions=[], output=[name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256])
+- Exchange hashpartitioning(name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256, 200)
+- *HashAggregate(keys=[name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256], functions=[], output=[name#250, age#251, expense#252, DOB#253, income#254, married#255, networth#256])
+- SortMergeJoin [coalesce(name#250, ), coalesce(age#251, 0), coalesce(expense#252, 0), coalesce(DOB#253, 0), coalesce(income#254, 0.0), coalesce(married#255, false), coalesce(networth#256, 0.0)], [coalesce(name#276, ), coalesce(age#277, 0), coalesce(expense#278, 0), coalesce(DOB#279, 0), coalesce(income#280, 0.0), coalesce(married#281, false), coalesce(networth#282, 0.0)], LeftAnti, (((((((name#250 <=> name#276) && (age#251 <=> age#277)) && (expense#252 <=> expense#278)) && (DOB#253 <=> DOB#279)) && (income#254 <=> income#280)) && (married#255 <=> married#281)) && (networth#256 <=> networth#282))
:- *Sort [coalesce(name#250, ) ASC, coalesce(age#251, 0) ASC, coalesce(expense#252, 0) ASC, coalesce(DOB#253, 0) ASC, coalesce(income#254, 0.0) ASC, coalesce(married#255, false) ASC, coalesce(networth#256, 0.0) ASC], false, 0
: +- Exchange hashpartitioning(coalesce(name#250, ), coalesce(age#251, 0), coalesce(expense#252, 0), coalesce(DOB#253, 0), coalesce(income#254, 0.0), coalesce(married#255, false), coalesce(networth#256, 0.0), 200)
: +- Scan ExistingRDD[name#250,age#251,expense#252,DOB#253,income#254,married#255,networth#256]
+- *Sort [coalesce(name#276, ) ASC, coalesce(age#277, 0) ASC, coalesce(expense#278, 0) ASC, coalesce(DOB#279, 0) ASC, coalesce(income#280, 0.0) ASC, coalesce(married#281, false) ASC, coalesce(networth#282, 0.0) ASC], false, 0
+- Exchange hashpartitioning(coalesce(name#276, ), coalesce(age#277, 0), coalesce(expense#278, 0), coalesce(DOB#279, 0), coalesce(income#280, 0.0), coalesce(married#281, false), coalesce(networth#282, 0.0), 200)
+- *Filter (isnotnull(age#277) && (age#277 > 20))
+- Scan ExistingRDD[name#276,age#277,expense#278,DOB#279,income#280,married#281,networth#282]
root
|-- name: string (nullable = true)
|-- age: integer (nullable = true)
|-- expense: integer (nullable = true)
|-- DOB: timestamp (nullable = true)
|-- income: double (nullable = true)
|-- married: boolean (nullable = true)
|-- networth: double (nullable = true)

+---+----------+
|key| value|
+---+----------+
| 1|[10 05 06]|
| 2|[0C 0E 09]|
+---+----------+

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
+---+-----+
|key|value|
+---+-----+
| 1| 1|
| 1| 2|
| 2| 1|
| 2| 1|
| 2| 3|
| 3| 2|
| 3| 3|
+---+-----+

+---------+---+---+---+
|key_value| 1| 2| 3|
+---------+---+---+---+
| 2| 2| 0| 1|
| 1| 1| 1| 0|
| 3| 0| 1| 1|
+---------+---+---+---+

+------------+--------+
|sum(expense)|max(age)|
+------------+--------+
| 6| 30|
+------------+--------+

Tests run: 110, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.621 sec <<< FAILURE! - in org.eclairjs.nashorn.SqlTest
rowCreateFromArray(org.eclairjs.nashorn.SqlTest) Time elapsed: 0.175 sec <<< FAILURE!
org.junit.ComparisonFailure: should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01 17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>
at org.eclairjs.nashorn.SqlTest.rowCreateFromArray(SqlTest.java:1974)

Running org.eclairjs.nashorn.SqlUDFTest
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.918 sec - in org.eclairjs.nashorn.SqlUDFTest
Running org.eclairjs.nashorn.ZClusterTest
MASTER STARTED
WORKER STARTED
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
IN MAIN
IN MAIN
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.486 sec - in org.eclairjs.nashorn.ZClusterTest
Running org.eclairjs.nashorn.DStreamTest
16/11/17 10:04:10 ERROR ReceiverTracker: Deregistered receiver for stream 0: Stopped by driver
Exception in thread "receiver-supervisor-future-0" java.lang.Error: java.lang.InterruptedException: sleep interrupted
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
... 2 more
16/11/17 10:04:14 ERROR ReceiverTracker: Deregistered receiver for stream 0: Stopped by driver
Exception in thread "receiver-supervisor-future-0" java.lang.Error: java.lang.InterruptedException: sleep interrupted
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
... 2 more
16/11/17 10:04:17 ERROR ReceiverTracker: Deregistered receiver for stream 0: Stopped by driver
Exception in thread "receiver-supervisor-future-0" java.lang.Error: java.lang.InterruptedException: sleep interrupted
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
... 2 more
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.4 sec - in org.eclairjs.nashorn.DStreamTest
Running org.eclairjs.nashorn.MlTest
+---+--------+-------------+
| id|category|categoryIndex|
+---+--------+-------------+
| 0| a| 0.0|
| 1| b| 2.0|
| 2| c| 1.0|
| 3| a| 0.0|
| 4| a| 0.0|
| 5| c| 1.0|
+---+--------+-------------+

Chose undefined categorical features: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 190 191 192 193 194 195 196 197 198 199 200 201 202 203 219 220 221 222 223 224 225 226 227 228 229 230 231 247 248 249 250 251 252 253 254 255 256 257 258 276 277 278 279 280 281 282 283 284 285 304 305 306 307 308 309 310 311 312 313 332 333 334 335 336 337 338 339 340 361 362 363 364 365 366 367 368 389 390 391 392 393 394 395 396 417 418 419 420 421 422 423 424 445 446 447 448 449 450 451 452 473 474 475 476 477 478 479 480 500 501 502 503 504 505 506 507 508 528 529 530 531 532 533 534 535 536 555 556 557 558 559 560 561 562 563 564 583 584 585 586 587 588 589 590 591 592 593 610 611 612 613 614 615 616 617 618 619 620 621 637 638 639 640 641 642 643 644 645 646 647 648 649 650 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 688 689 690 691 toJSON
+-----+--------------------+--------------------+
|label| features| indexed|
+-----+--------------------+--------------------+
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
| 1.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[151,152,153...|(692,[151,152,153...|
| 0.0|(692,[129,130,131...|(692,[129,130,131...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[99,100,101,...|(692,[99,100,101,...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[153,154,155...|(692,[153,154,155...|
| 0.0|(692,[151,152,153...|(692,[151,152,153...|
| 1.0|(692,[129,130,131...|(692,[129,130,131...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 1.0|(692,[150,151,152...|(692,[150,151,152...|
| 0.0|(692,[124,125,126...|(692,[124,125,126...|
| 0.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[97,98,99,12...|(692,[97,98,99,12...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
+-----+--------------------+--------------------+
only showing top 20 rows

Tests run: 50, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 38.031 sec <<< FAILURE! - in org.eclairjs.nashorn.MlTest
LDAExample(org.eclairjs.nashorn.MlTest) Time elapsed: 0.005 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from examples/ml/LDA_example.js in /ml/mltest.js at line number 210
at org.eclairjs.nashorn.MlTest.LDAExample(MlTest.java:610)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from examples/ml/LDA_example.js
at org.eclairjs.nashorn.MlTest.LDAExample(MlTest.java:610)

Running org.eclairjs.nashorn.SparkContextTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.849 sec - in org.eclairjs.nashorn.SparkContextTest
Running org.eclairjs.nashorn.MlLibTest
16/11/17 10:05:05 ERROR LBFGS: Failure! Resetting history: breeze.optimize.FirstOrderException: Line search failed
{"testErr":0,"summary":"TreeEnsembleModel classifier with 3 trees\n"}
Precision at 1 = 0.26666666666666666
NDCG at 1 = 0.26666666666666666
Precision at 3 = 0.42222222222222217
NDCG at 3 = 0.3945978004583226
Precision at 5 = 0.4400000000000001
NDCG at 5 = 0.4135896971754782
Mean average precision = 0.2384766622266622
Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.694 sec - in org.eclairjs.nashorn.MlLibTest
Running org.eclairjs.nashorn.CoreExamplesTest
Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 0.031 sec <<< FAILURE! - in org.eclairjs.nashorn.CoreExamplesTest
WordCount(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.011 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from eclairjs/sql/sparkSession in file:/home/rosale/incubator-toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line number 122
at org.eclairjs.nashorn.CoreExamplesTest.WordCount(CoreExamplesTest.java:48)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.WordCount(CoreExamplesTest.java:48)

SparkLR(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from eclairjs/sql/sparkSession in file:/home/rosale/incubator-toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line number 122
at org.eclairjs.nashorn.CoreExamplesTest.SparkLR(CoreExamplesTest.java:88)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.SparkLR(CoreExamplesTest.java:88)

SparkPI(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from eclairjs/sql/sparkSession in file:/home/rosale/incubator-toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line number 122
at org.eclairjs.nashorn.CoreExamplesTest.SparkPI(CoreExamplesTest.java:76)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.SparkPI(CoreExamplesTest.java:76)

SparkTC(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from eclairjs/sql/sparkSession in file:/home/rosale/incubator-toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line number 122
at org.eclairjs.nashorn.CoreExamplesTest.SparkTC(CoreExamplesTest.java:64)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.SparkTC(CoreExamplesTest.java:64)

PageRank(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from eclairjs/sql/sparkSession in file:/home/rosale/incubator-toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line number 122
at org.eclairjs.nashorn.CoreExamplesTest.PageRank(CoreExamplesTest.java:100)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.PageRank(CoreExamplesTest.java:100)

LogQuery(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from eclairjs/sql/sparkSession in file:/home/rosale/incubator-toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line number 122
at org.eclairjs.nashorn.CoreExamplesTest.LogQuery(CoreExamplesTest.java:115)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.LogQuery(CoreExamplesTest.java:115)

Running org.eclairjs.nashorn.PairRDDTest
Tests run: 8, Failures: 5, Errors: 0, Skipped: 0, Time elapsed: 0.414 sec <<< FAILURE! - in org.eclairjs.nashorn.PairRDDTest
countByKey(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.066 sec <<< FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal expected:<{"[pandas":1,"coffee":3]}> but was:<{"[coffee":3,"pandas":1]}>
at org.eclairjs.nashorn.PairRDDTest.countByKey(PairRDDTest.java:64)

cogroup2(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.053 sec <<< FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[42],"length":3},"length":2},{"0":"Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21]],"length":3},"lengt...> but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21],"length":3},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1":[3],"2":[42]],"length":3},"lengt...>
at org.eclairjs.nashorn.PairRDDTest.cogroup2(PairRDDTest.java:112)

cogroup3(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.064 sec <<< FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[42],"3":["WA"],"length":4},"length":2},{"0":"Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21],"3":["FL]"],"length":4},"leng...> but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21],"3":["FL"],"length":4},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1":[3],"2":[42],"3":["WA]"],"length":4},"leng...>
at org.eclairjs.nashorn.PairRDDTest.cogroup3(PairRDDTest.java:124)

aggregateByKey(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.076 sec <<< FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal expected:<...1},"length":2},{"0":[{"0":5,"1":3,"length":2},"1":{"2":1},"length":2},{"0":5,"1":{"1]":1},"length":2}]> but was:<...1},"length":2},{"0":[5,"1":{"1":1},"length":2},{"0":{"0":5,"1":3,"length":2},"1":{"2]":1},"length":2}]>
at org.eclairjs.nashorn.PairRDDTest.aggregateByKey(PairRDDTest.java:76)

cogroup(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.039 sec <<< FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"length":2},"length":2},{"0":"Oranges","1":{"0":["Fruit","Citrus"],"1":[2]],"length":2},"lengt...> but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"length":2},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1":[3]],"length":2},"lengt...>
at org.eclairjs.nashorn.PairRDDTest.cogroup(PairRDDTest.java:100)

Running org.eclairjs.nashorn.SqlStreamingTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.975 sec - in org.eclairjs.nashorn.SqlStreamingTest

Results :

Failed tests:
PairRDDTest.aggregateByKey:76 failure - strings are not equal expected:<...1},"length":2},{"0":[{"0":5,"1":3,"length":2},"1":{"2":1},"length":2},{"0":5,"1":{"1]":1},"length":2}]> but was:<...1},"length":2},{"0":[5,"1":{"1":1},"length":2},{"0":{"0":5,"1":3,"length":2},"1":{"2]":1},"length":2}]>
PairRDDTest.cogroup:100 failure - strings are not equal expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"length":2},"length":2},{"0":"Oranges","1":{"0":["Fruit","Citrus"],"1":[2]],"length":2},"lengt...> but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"length":2},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1":[3]],"length":2},"lengt...>
PairRDDTest.cogroup2:112 failure - strings are not equal expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[42],"length":3},"length":2},{"0":"Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21]],"length":3},"lengt...> but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21],"length":3},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1":[3],"2":[42]],"length":3},"lengt...>
PairRDDTest.cogroup3:124 failure - strings are not equal expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[42],"3":["WA"],"length":4},"length":2},{"0":"Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21],"3":["FL]"],"length":4},"leng...> but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"2":[21],"3":["FL"],"length":4},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1":[3],"2":[42],"3":["WA]"],"length":4},"leng...>
PairRDDTest.countByKey:64 failure - strings are not equal expected:<{"[pandas":1,"coffee":3]}> but was:<{"[coffee":3,"pandas":1]}>
SqlTest.rowCreateFromArray:1974 should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01 17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>
Tests in error:
CoreExamplesTest.LogQuery:115 ? Script TypeError: Cannot load script from ecla...
CoreExamplesTest.PageRank:100 ? Script TypeError: Cannot load script from ecla...
CoreExamplesTest.SparkLR:88 ? Script TypeError: Cannot load script from eclair...
CoreExamplesTest.SparkPI:76 ? Script TypeError: Cannot load script from eclair...
CoreExamplesTest.SparkTC:64 ? Script TypeError: Cannot load script from eclair...
CoreExamplesTest.WordCount:48 ? Script TypeError: Cannot load script from ecla...
MlTest.LDAExample:610 ? Script TypeError: Cannot load script from examples/ml/...

Tests run: 292, Failures: 6, Errors: 7, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:53 min
[INFO] Finished at: 2016-11-17T10:05:15+01:00
[INFO] Final Memory: 88M/2798M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project eclairjs-nashorn: There are test failures.
[ERROR]
[ERROR] Please refer to /home/rosale/incubator-toree/eclairjs/server/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

I really have no clue about what the problem can be, so I would really appreciate any help you could provide me. Thanks a lot in advance.

[Brian-P-Burns]

@rosale I checked out master and ran the tests. They pass for me on my
mac. I've got an ubuntu vm. I will try there. Did you use openjdk or
Oracle's jvm? Both should work.

Brian

On Thu, Nov 17, 2016 at 4:19 AM, rosale notifications@github.com wrote:

@bpburns https://github.com/bpburns thanks a lot! While deploying the
Eclair Server again (https://github.com/EclairJS/
eclairjs/tree/master/server) on a machine with the following settings:

Ubuntu 14.04.4 LTS
Java(TM) SE Runtime Environment (build 1.8.0_111-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode)
Spark (V2.0.0 built for Hadoop 2.6.0 and later)
Apache Maven 3.3.9
sbt 0.13.13
git 2.10.2

I got several errors in the TESTS section after executing the command mvn
package and therefore the procedure failed:

---

T E S T S

Running org.eclairjs.nashorn.CoreTest
doing foreach 2
doing foreach 1
doing foreach 3
doing foreachPartition 1
doing foreachPartition 3
doing foreachPartition 2
Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.925 sec

• in org.eclairjs.nashorn.CoreTest
  Running org.eclairjs.nashorn.WrappedObjectTest
  {"0":1,"1":"A","length":2}
  Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec
• in org.eclairjs.nashorn.WrappedObjectTest
  Running org.eclairjs.nashorn.SqlTest
  == Parsed Logical Plan ==
  'Except
  :- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254,
  married#255, networth#256]
  +- Filter (age#251 > 20)
  +- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254,
  married#255, networth#256]

== Analyzed Logical Plan ==
name: string, age: int, expense: int, DOB: timestamp, income: double,
married: boolean, networth: double
Except
:- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254,
married#255, networth#256]
+- Filter (age#277 > 20)
+- LogicalRDD [name#276, age#277, expense#278, DOB#279, income#280,
married#281, networth#282]

== Optimized Logical Plan ==
Aggregate [name#250, age#251, expense#252, DOB#253, income#254,
married#255, networth#256], [name#250, age#251, expense#252, DOB#253,
income#254, married#255, networth#256]
+- Join LeftAnti, (((((((name#250 <=> name#276) && (age#251 <=> age#277))
&& (expense#252 <=> expense#278)) && (DOB#253 <=> DOB#279)) && (income#254
<=> income#280)) && (married#255 <=> married#281)) && (networth#256 <=>
networth#282))
:- LogicalRDD [name#250, age#251, expense#252, DOB#253, income#254,
married#255, networth#256]
+- Filter (isnotnull(age#277) && (age#277 > 20))
+- LogicalRDD [name#276, age#277, expense#278, DOB#279, income#280,
married#281, networth#282]

== Physical Plan ==
*HashAggregate(keys=[name#250, age#251, expense#252, DOB#253, income#254,
married#255, networth#256], functions=[], output=[name#250, age#251,
expense#252, DOB#253, income#254, married#255, networth#256])
+- Exchange hashpartitioning(name#250, age#251, expense#252, DOB#253,
income#254, married#255, networth#256, 200)
+- *HashAggregate(keys=[name#250, age#251, expense#252, DOB#253,
income#254, married#255, networth#256], functions=[], output=[name#250,
age#251, expense#252, DOB#253, income#254, married#255, networth#256])
+- SortMergeJoin [coalesce(name#250, ), coalesce(age#251, 0),
coalesce(expense#252, 0), coalesce(DOB#253, 0), coalesce(income#254, 0.0),
coalesce(married#255, false), coalesce(networth#256, 0.0)],
[coalesce(name#276, ), coalesce(age#277, 0), coalesce(expense#278, 0),
coalesce(DOB#279, 0), coalesce(income#280, 0.0), coalesce(married#281,
false), coalesce(networth#282, 0.0)], LeftAnti, (((((((name#250 <=>
name#276) && (age#251 <=> age#277)) && (expense#252 <=> expense#278)) &&
(DOB#253 <=> DOB#279)) && (income#254 <=> income#280)) && (married#255 <=>
married#281)) && (networth#256 <=> networth#282))
:- *Sort [coalesce(name#250, ) ASC, coalesce(age#251, 0) ASC,
coalesce(expense#252, 0) ASC, coalesce(DOB#253, 0) ASC,
coalesce(income#254, 0.0) ASC, coalesce(married#255, false) ASC,
coalesce(networth#256, 0.0) ASC], false, 0
: +- Exchange hashpartitioning(coalesce(name#250, ), coalesce(age#251,
0), coalesce(expense#252, 0), coalesce(DOB#253, 0), coalesce(income#254,
0.0), coalesce(married#255, false), coalesce(networth#256, 0.0), 200)
: +- Scan ExistingRDD[name#250,age#251,expense#252,DOB#253,income#
254,married#255,networth#256]
+- *Sort [coalesce(name#276, ) ASC, coalesce(age#277, 0) ASC,
coalesce(expense#278, 0) ASC, coalesce(DOB#279, 0) ASC,
coalesce(income#280, 0.0) ASC, coalesce(married#281, false) ASC,
coalesce(networth#282, 0.0) ASC], false, 0
+- Exchange hashpartitioning(coalesce(name#276, ), coalesce(age#277, 0),
coalesce(expense#278, 0), coalesce(DOB#279, 0), coalesce(income#280, 0.0),
coalesce(married#281, false), coalesce(networth#282, 0.0), 200)
+- *Filter (isnotnull(age#277) && (age#277 > 20))
+- Scan ExistingRDD[name#276,age#277,expense#278,DOB#279,income#
280,married#281,networth#282]
root
|-- name: string (nullable = true)
|-- age: integer (nullable = true)
|-- expense: integer (nullable = true)
|-- DOB: timestamp (nullable = true)
|-- income: double (nullable = true)
|-- married: boolean (nullable = true)
|-- networth: double (nullable = true)

+---+----------+
|key| value|
+---+----------+
| 1|[10 05 06]|
| 2|[0C 0E 09]|
+---+----------+

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
details.
+---+-----+
|key|value|
+---+-----+
| 1| 1|
| 1| 2|
| 2| 1|
| 2| 1|
| 2| 3|
| 3| 2|
| 3| 3|
+---+-----+

+---------+---+---+---+
|key_value| 1| 2| 3|
+---------+---+---+---+
| 2| 2| 0| 1|
| 1| 1| 1| 0|
| 3| 0| 1| 1|
+---------+---+---+---+

+------------+--------+
|sum(expense)|max(age)|
+------------+--------+
| 6| 30|
+------------+--------+

Tests run: 110, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 37.621
sec <<< FAILURE! - in org.eclairjs.nashorn.SqlTest
rowCreateFromArray(org.eclairjs.nashorn.SqlTest) Time elapsed: 0.175 sec
<<< FAILURE!
org.junit.ComparisonFailure: should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01
17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>
at org.eclairjs.nashorn.SqlTest.rowCreateFromArray(SqlTest.java:1974)

Running org.eclairjs.nashorn.SqlUDFTest
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.918 sec

• in org.eclairjs.nashorn.SqlUDFTest
  Running org.eclairjs.nashorn.ZClusterTest
  MASTER STARTED
  WORKER STARTED
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  IN MAIN
  IN MAIN
  Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.486 sec
• in org.eclairjs.nashorn.ZClusterTest
  Running org.eclairjs.nashorn.DStreamTest
  16/11/17 10:04:10 ERROR ReceiverTracker: Deregistered receiver for stream
  0: Stopped by driver
  Exception in thread "receiver-supervisor-future-0" java.lang.Error:
  java.lang.InterruptedException: sleep interrupted
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1148)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
  ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
  Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.
  liftedTree1$1(Future.scala:24)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(
  Future.scala:24)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1142)
  ... 2 more
  16/11/17 10:04:14 ERROR ReceiverTracker: Deregistered receiver for stream
  0: Stopped by driver
  Exception in thread "receiver-supervisor-future-0" java.lang.Error:
  java.lang.InterruptedException: sleep interrupted
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1148)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
  ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
  Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.
  liftedTree1$1(Future.scala:24)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(
  Future.scala:24)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1142)
  ... 2 more
  16/11/17 10:04:17 ERROR ReceiverTracker: Deregistered receiver for stream
  0: Stopped by driver
  Exception in thread "receiver-supervisor-future-0" java.lang.Error:
  java.lang.InterruptedException: sleep interrupted
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1148)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
  ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
  Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.
  liftedTree1$1(Future.scala:24)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(
  Future.scala:24)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1142)
  ... 2 more
  Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.4 sec -
  in org.eclairjs.nashorn.DStreamTest
  Running org.eclairjs.nashorn.MlTest
  +---+--------+-------------+
  | id|category|categoryIndex|
  +---+--------+-------------+
  | 0| a| 0.0|
  | 1| b| 2.0|
  | 2| c| 1.0|
  | 3| a| 0.0|
  | 4| a| 0.0|
  | 5| c| 1.0|
  +---+--------+-------------+

Chose undefined categorical features: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14
15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39
40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64
65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89
90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110
111 112 113 114 115 116 117 118 119 120 121 122 133 134 135 136 137 138 139
140 141 142 143 144 145 146 147 148 149 161 162 163 164 165 166 167 168 169
170 171 172 173 174 175 176 190 191 192 193 194 195 196 197 198 199 200 201
202 203 219 220 221 222 223 224 225 226 227 228 229 230 231 247 248 249 250
251 252 253 254 255 256 257 258 276 277 278 279 280 281 282 283 284 285 304
305 306 307 308 309 310 311 312 313 332 333 334 335 336 337 338 339 340 361
362 363 364 365 366 367 368 389 390 391 392 393 394 395 396 417 418 419 420
421 422 423 424 445 446 447 448 449 450 451 452 473 474 475 476 477 478 479
480 500 501 502 503 504 505 506 507 508 528 529 530 531 532 533 534 535 536
555 556 557 558 559 560 561 562 563 564 583 584 585 586 587 588 589 590 591
592 593 610 611 612 613 614 615 616 617 618 619 620 621 637 638 639 640 641
642 643 644 645 646 647 648 649 650 664 665 666 667 668 669 670 671 672 673
674 675 676 677 678 679 680 681 688 689 690 691 toJSON
+-----+--------------------+--------------------+
|label| features| indexed|
+-----+--------------------+--------------------+
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
| 1.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[151,152,153...|(692,[151,152,153...|
| 0.0|(692,[129,130,131...|(692,[129,130,131...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[99,100,101,...|(692,[99,100,101,...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[153,154,155...|(692,[153,154,155...|
| 0.0|(692,[151,152,153...|(692,[151,152,153...|
| 1.0|(692,[129,130,131...|(692,[129,130,131...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 1.0|(692,[150,151,152...|(692,[150,151,152...|
| 0.0|(692,[124,125,126...|(692,[124,125,126...|
| 0.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[97,98,99,12...|(692,[97,98,99,12...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
+-----+--------------------+--------------------+
only showing top 20 rows

Tests run: 50, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 38.031
sec <<< FAILURE! - in org.eclairjs.nashorn.MlTest
LDAExample(org.eclairjs.nashorn.MlTest) Time elapsed: 0.005 sec <<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from
examples/ml/LDA_example.js in /ml/mltest.js at line number 210
at org.eclairjs.nashorn.MlTest.LDAExample(MlTest.java:610)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
load script from examples/ml/LDA_example.js
at org.eclairjs.nashorn.MlTest.LDAExample(MlTest.java:610)

Running org.eclairjs.nashorn.SparkContextTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.849 sec

• in org.eclairjs.nashorn.SparkContextTest
  Running org.eclairjs.nashorn.MlLibTest
  16/11/17 10:05:05 ERROR LBFGS: Failure! Resetting history: breeze.optimize.FirstOrderException:
  Line search failed
  {"testErr":0,"summary":"TreeEnsembleModel classifier with 3 trees\n"}
  Precision at 1 = 0.26666666666666666
  NDCG at 1 = 0.26666666666666666
  Precision at 3 = 0.42222222222222217
  NDCG at 3 = 0.3945978004583226
  Precision at 5 = 0.4400000000000001
  NDCG at 5 = 0.4135896971754782
  Mean average precision = 0.2384766622266622
  Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.694
  sec - in org.eclairjs.nashorn.MlLibTest
  Running org.eclairjs.nashorn.CoreExamplesTest
  Tests run: 6, Failures: 0, Errors: 6, Skipped: 0, Time elapsed: 0.031 sec
  <<< FAILURE! - in org.eclairjs.nashorn.CoreExamplesTest
  WordCount(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.011 sec
  <<< ERROR!
  javax.script.ScriptException: TypeError: Cannot load script from
  eclairjs/sql/sparkSession in file:/home/rosale/incubator-
  toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line
  number 122
  at org.eclairjs.nashorn.CoreExamplesTest.WordCount(
  CoreExamplesTest.java:48)
  Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
  load script from eclairjs/sql/sparkSession
  at org.eclairjs.nashorn.CoreExamplesTest.WordCount(
  CoreExamplesTest.java:48)

SparkLR(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec
<<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from
eclairjs/sql/sparkSession in file:/home/rosale/incubator-
toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line
number 122
at org.eclairjs.nashorn.CoreExamplesTest.SparkLR(CoreExamplesTest.java:88)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.SparkLR(CoreExamplesTest.java:88)

SparkPI(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec
<<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from
eclairjs/sql/sparkSession in file:/home/rosale/incubator-
toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line
number 122
at org.eclairjs.nashorn.CoreExamplesTest.SparkPI(CoreExamplesTest.java:76)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.SparkPI(CoreExamplesTest.java:76)

SparkTC(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec
<<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from
eclairjs/sql/sparkSession in file:/home/rosale/incubator-
toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line
number 122
at org.eclairjs.nashorn.CoreExamplesTest.SparkTC(CoreExamplesTest.java:64)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.SparkTC(CoreExamplesTest.java:64)

PageRank(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec
<<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from
eclairjs/sql/sparkSession in file:/home/rosale/incubator-
toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line
number 122
at org.eclairjs.nashorn.CoreExamplesTest.PageRank(
CoreExamplesTest.java:100)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.PageRank(
CoreExamplesTest.java:100)

LogQuery(org.eclairjs.nashorn.CoreExamplesTest) Time elapsed: 0.004 sec
<<< ERROR!
javax.script.ScriptException: TypeError: Cannot load script from
eclairjs/sql/sparkSession in file:/home/rosale/incubator-
toree/eclairjs/server/target/classes/eclairjs/jvm-npm/jvm-npm.js at line
number 122
at org.eclairjs.nashorn.CoreExamplesTest.LogQuery(
CoreExamplesTest.java:115)
Caused by: jdk.nashorn.internal.runtime.ECMAException: TypeError: Cannot
load script from eclairjs/sql/sparkSession
at org.eclairjs.nashorn.CoreExamplesTest.LogQuery(
CoreExamplesTest.java:115)

Running org.eclairjs.nashorn.PairRDDTest
Tests run: 8, Failures: 5, Errors: 0, Skipped: 0, Time elapsed: 0.414 sec
<<< FAILURE! - in org.eclairjs.nashorn.PairRDDTest
countByKey(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.066 sec <<<
FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal
expected:<{"[pandas":1,"coffee":3]}> but was:<{"[coffee":3,"pandas":1]}>
at org.eclairjs.nashorn.PairRDDTest.countByKey(PairRDDTest.java:64)

cogroup2(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.053 sec <<<
FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal
expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[
42],"length":3},"length":2},{"0":"Oranges","1":{"0":["Fruit"
,"Citrus"],"1":[2],"2":[21]],"length":3},"lengt...> but
was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"
2":[21],"length":3},"length":2},{"0":"Apples","1":{"0":["
Fruit"],"1":[3],"2":[42]],"length":3},"lengt...>
at org.eclairjs.nashorn.PairRDDTest.cogroup2(PairRDDTest.java:112)

cogroup3(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.064 sec <<<
FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal
expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[
42],"3":["WA"],"length":4},"length":2},{"0":"Oranges","1":
{"0":["Fruit","Citrus"],"1":[2],"2":[21],"3":["FL]"],"length":4},"leng...>
but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"
2":[21],"3":["FL"],"length":4},"length":2},{"0":"Apples","1"
:{"0":["Fruit"],"1":[3],"2":[42],"3":["WA]"],"length":4},"leng...>
at org.eclairjs.nashorn.PairRDDTest.cogroup3(PairRDDTest.java:124)

aggregateByKey(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.076 sec
<<< FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal
expected:<...1},"length":2},{"0":[{"0":5,"1":3,"length":2},"
1":{"2":1},"length":2},{"0":5,"1":{"1]":1},"length":2}]> but
was:<...1},"length":2},{"0":[5,"1":{"1":1},"length":2},{"0"
:{"0":5,"1":3,"length":2},"1":{"2]":1},"length":2}]>
at org.eclairjs.nashorn.PairRDDTest.aggregateByKey(PairRDDTest.java:76)

cogroup(org.eclairjs.nashorn.PairRDDTest) Time elapsed: 0.039 sec <<<
FAILURE!
org.junit.ComparisonFailure: failure - strings are not equal
expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"
length":2},"length":2},{"0":"Oranges","1":{"0":["Fruit","
Citrus"],"1":[2]],"length":2},"lengt...> but
was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"
length":2},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1"
:[3]],"length":2},"lengt...>
at org.eclairjs.nashorn.PairRDDTest.cogroup(PairRDDTest.java:100)

Running org.eclairjs.nashorn.SqlStreamingTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.975 sec

• in org.eclairjs.nashorn.SqlStreamingTest

Results :

Failed tests:
PairRDDTest.aggregateByKey:76 failure - strings are not equal
expected:<...1},"length":2},{"0":[{"0":5,"1":3,"length":2},"
1":{"2":1},"length":2},{"0":5,"1":{"1]":1},"length":2}]> but
was:<...1},"length":2},{"0":[5,"1":{"1":1},"length":2},{"0"
:{"0":5,"1":3,"length":2},"1":{"2]":1},"length":2}]>
PairRDDTest.cogroup:100 failure - strings are not equal
expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"
length":2},"length":2},{"0":"Oranges","1":{"0":["Fruit","
Citrus"],"1":[2]],"length":2},"lengt...> but
was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"
length":2},"length":2},{"0":"Apples","1":{"0":["Fruit"],"1"
:[3]],"length":2},"lengt...>
PairRDDTest.cogroup2:112 failure - strings are not equal
expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[
42],"length":3},"length":2},{"0":"Oranges","1":{"0":["Fruit"
,"Citrus"],"1":[2],"2":[21]],"length":3},"lengt...> but
was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"
2":[21],"length":3},"length":2},{"0":"Apples","1":{"0":["
Fruit"],"1":[3],"2":[42]],"length":3},"lengt...>
PairRDDTest.cogroup3:124 failure - strings are not equal
expected:<[{"0":"[Apples","1":{"0":["Fruit"],"1":[3],"2":[
42],"3":["WA"],"length":4},"length":2},{"0":"Oranges","1":
{"0":["Fruit","Citrus"],"1":[2],"2":[21],"3":["FL]"],"length":4},"leng...>
but was:<[{"0":"[Oranges","1":{"0":["Fruit","Citrus"],"1":[2],"
2":[21],"3":["FL"],"length":4},"length":2},{"0":"Apples","1"
:{"0":["Fruit"],"1":[3],"2":[42],"3":["WA]"],"length":4},"leng...>
PairRDDTest.countByKey:64 failure - strings are not equal
expected:<{"[pandas":1,"coffee":3]}> but was:<{"[coffee":3,"pandas":1]}>
SqlTest.rowCreateFromArray:1974 should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01
17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>
Tests in error:
CoreExamplesTest.LogQuery:115 ? Script TypeError: Cannot load script from
ecla...
CoreExamplesTest.PageRank:100 ? Script TypeError: Cannot load script from
ecla...
CoreExamplesTest.SparkLR:88 ? Script TypeError: Cannot load script from
eclair...
CoreExamplesTest.SparkPI:76 ? Script TypeError: Cannot load script from
eclair...
CoreExamplesTest.SparkTC:64 ? Script TypeError: Cannot load script from
eclair...
CoreExamplesTest.WordCount:48 ? Script TypeError: Cannot load script from
ecla...
MlTest.LDAExample:610 ? Script TypeError: Cannot load script from
examples/ml/...

Tests run: 292, Failures: 6, Errors: 7, Skipped: 0

[INFO] ------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------

[INFO] Total time: 02:53 min
[INFO] Finished at: 2016-11-17T10:05:15+01:00
[INFO] Final Memory: 88M/2798M

[INFO] ------------------------------------------------------------

[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-surefire-plugin:2.19.1:test (default-test) on project
eclairjs-nashorn: There are test failures.
[ERROR]
[ERROR] Please refer to /home/rosale/incubator-toree/
eclairjs/server/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
MojoFailureException

I really have no clue about what can be the problem, so I would really
appreciate any help you could provide me.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#9 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAiWKPbaKcuI4DQSgem0oWUVyN4kOW9lks5q_BwegaJpZM4KxRY_
.

[rosale]

@bpburns thank you very much for your prompt answer. I used the Oracle JVM.

I already tried to deploy the EclairJS Server on my Mac (MacBook Pro, Mid 2015), OS X El Capitan 10.11.6) by using the same JVM and the following settings:

Spark (V2.0.0 built for Hadoop 2.6.0 and later)
Apache Maven 3.3.9
sbt 0.13.13
git 2.10.2

Unfortunately, I've got similar errors after executing the command mvn package:

---

T E S T S

Running org.eclairjs.nashorn.CoreExamplesTest
Initial w:
0.4788752026744254,-0.35196535813838126,0.18919006260531712,0.24688981973357493,-0.4150740295882427,0.8416380267684647,-0.1082605636940599,0.2317320754087695,-0.6099894816250035,0.7594347720633767
On iteration 1
On iteration 2
On iteration 3
On iteration 4
On iteration 5
On iteration 6
On iteration 7
On iteration 8
On iteration 9
On iteration 10
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.043 sec - in org.eclairjs.nashorn.CoreExamplesTest
Running org.eclairjs.nashorn.CoreTest
doing foreach 2
doing foreach 1
doing foreach 3
doing foreachPartition 2
doing foreachPartition 3
doing foreachPartition 1
Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.913 sec - in org.eclairjs.nashorn.CoreTest
Running org.eclairjs.nashorn.DStreamTest
16/11/17 14:41:26 ERROR ReceiverTracker: Deregistered receiver for stream 0: Stopped by driver
Exception in thread "receiver-supervisor-future-0" java.lang.Error: java.lang.InterruptedException: sleep interrupted
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
... 2 more
16/11/17 14:41:29 ERROR ReceiverTracker: Deregistered receiver for stream 0: Stopped by driver
Exception in thread "receiver-supervisor-future-0" java.lang.Error: java.lang.InterruptedException: sleep interrupted
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
... 2 more
16/11/17 14:41:32 ERROR ReceiverTracker: Deregistered receiver for stream 0: Stopped by driver
Exception in thread "receiver-supervisor-future-0" java.lang.Error: java.lang.InterruptedException: sleep interrupted
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1148)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at org.apache.spark.streaming.receiver.ReceiverSupervisor$$anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
... 2 more
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.351 sec - in org.eclairjs.nashorn.DStreamTest
Running org.eclairjs.nashorn.MlLibTest
16/11/17 14:41:43 ERROR LBFGS: Failure! Resetting history: breeze.optimize.FirstOrderException: Line search failed
{"testErr":0,"summary":"TreeEnsembleModel classifier with 3 trees\n"}
Precision at 1 = 0.3
NDCG at 1 = 0.3
Precision at 3 = 0.43333333333333335
NDCG at 3 = 0.40409616986363245
Precision at 5 = 0.45333333333333337
NDCG at 5 = 0.42532336613625027
Mean average precision = 0.26890009065009063
Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.682 sec - in org.eclairjs.nashorn.MlLibTest
Running org.eclairjs.nashorn.MlTest
+---+--------+-------------+
| id|category|categoryIndex|
+---+--------+-------------+
| 0| a| 0.0|
| 1| b| 2.0|
| 2| c| 1.0|
| 3| a| 0.0|
| 4| a| 0.0|
| 5| c| 1.0|
+---+--------+-------------+

Chose undefined categorical features: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 190 191 192 193 194 195 196 197 198 199 200 201 202 203 219 220 221 222 223 224 225 226 227 228 229 230 231 247 248 249 250 251 252 253 254 255 256 257 258 276 277 278 279 280 281 282 283 284 285 304 305 306 307 308 309 310 311 312 313 332 333 334 335 336 337 338 339 340 361 362 363 364 365 366 367 368 389 390 391 392 393 394 395 396 417 418 419 420 421 422 423 424 445 446 447 448 449 450 451 452 473 474 475 476 477 478 479 480 500 501 502 503 504 505 506 507 508 528 529 530 531 532 533 534 535 536 555 556 557 558 559 560 561 562 563 564 583 584 585 586 587 588 589 590 591 592 593 610 611 612 613 614 615 616 617 618 619 620 621 637 638 639 640 641 642 643 644 645 646 647 648 649 650 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 688 689 690 691 toJSON
+-----+--------------------+--------------------+
|label| features| indexed|
+-----+--------------------+--------------------+
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
| 1.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[151,152,153...|(692,[151,152,153...|
| 0.0|(692,[129,130,131...|(692,[129,130,131...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[99,100,101,...|(692,[99,100,101,...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[153,154,155...|(692,[153,154,155...|
| 0.0|(692,[151,152,153...|(692,[151,152,153...|
| 1.0|(692,[129,130,131...|(692,[129,130,131...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 1.0|(692,[150,151,152...|(692,[150,151,152...|
| 0.0|(692,[124,125,126...|(692,[124,125,126...|
| 0.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[97,98,99,12...|(692,[97,98,99,12...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
+-----+--------------------+--------------------+
only showing top 20 rows

Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.296 sec - in org.eclairjs.nashorn.MlTest
Running org.eclairjs.nashorn.PairRDDTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.226 sec - in org.eclairjs.nashorn.PairRDDTest
Running org.eclairjs.nashorn.SparkContextTest
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.612 sec - in org.eclairjs.nashorn.SparkContextTest
Running org.eclairjs.nashorn.SqlStreamingTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.844 sec - in org.eclairjs.nashorn.SqlStreamingTest
Running org.eclairjs.nashorn.SqlTest
== Parsed Logical Plan ==
'Except
:- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716]
+- Filter (age#4711 > 20)
+- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716]

== Analyzed Logical Plan ==
name: string, age: int, expense: int, DOB: timestamp, income: double, married: boolean, networth: double
Except
:- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716]
+- Filter (age#4737 > 20)
+- LogicalRDD [name#4736, age#4737, expense#4738, DOB#4739, income#4740, married#4741, networth#4742]

== Optimized Logical Plan ==
Aggregate [name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716], [name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716]
+- Join LeftAnti, (((((((name#4710 <=> name#4736) && (age#4711 <=> age#4737)) && (expense#4712 <=> expense#4738)) && (DOB#4713 <=> DOB#4739)) && (income#4714 <=> income#4740)) && (married#4715 <=> married#4741)) && (networth#4716 <=> networth#4742))
:- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716]
+- Filter (isnotnull(age#4737) && (age#4737 > 20))
+- LogicalRDD [name#4736, age#4737, expense#4738, DOB#4739, income#4740, married#4741, networth#4742]

== Physical Plan ==
*HashAggregate(keys=[name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716], functions=[], output=[name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716])
+- Exchange hashpartitioning(name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716, 200)
+- *HashAggregate(keys=[name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716], functions=[], output=[name#4710, age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716])
+- SortMergeJoin [coalesce(name#4710, ), coalesce(age#4711, 0), coalesce(expense#4712, 0), coalesce(DOB#4713, 0), coalesce(income#4714, 0.0), coalesce(married#4715, false), coalesce(networth#4716, 0.0)], [coalesce(name#4736, ), coalesce(age#4737, 0), coalesce(expense#4738, 0), coalesce(DOB#4739, 0), coalesce(income#4740, 0.0), coalesce(married#4741, false), coalesce(networth#4742, 0.0)], LeftAnti, (((((((name#4710 <=> name#4736) && (age#4711 <=> age#4737)) && (expense#4712 <=> expense#4738)) && (DOB#4713 <=> DOB#4739)) && (income#4714 <=> income#4740)) && (married#4715 <=> married#4741)) && (networth#4716 <=> networth#4742))
:- *Sort [coalesce(name#4710, ) ASC, coalesce(age#4711, 0) ASC, coalesce(expense#4712, 0) ASC, coalesce(DOB#4713, 0) ASC, coalesce(income#4714, 0.0) ASC, coalesce(married#4715, false) ASC, coalesce(networth#4716, 0.0) ASC], false, 0
: +- Exchange hashpartitioning(coalesce(name#4710, ), coalesce(age#4711, 0), coalesce(expense#4712, 0), coalesce(DOB#4713, 0), coalesce(income#4714, 0.0), coalesce(married#4715, false), coalesce(networth#4716, 0.0), 200)
: +- Scan ExistingRDD[name#4710,age#4711,expense#4712,DOB#4713,income#4714,married#4715,networth#4716]
+- *Sort [coalesce(name#4736, ) ASC, coalesce(age#4737, 0) ASC, coalesce(expense#4738, 0) ASC, coalesce(DOB#4739, 0) ASC, coalesce(income#4740, 0.0) ASC, coalesce(married#4741, false) ASC, coalesce(networth#4742, 0.0) ASC], false, 0
+- Exchange hashpartitioning(coalesce(name#4736, ), coalesce(age#4737, 0), coalesce(expense#4738, 0), coalesce(DOB#4739, 0), coalesce(income#4740, 0.0), coalesce(married#4741, false), coalesce(networth#4742, 0.0), 200)
+- *Filter (isnotnull(age#4737) && (age#4737 > 20))
+- Scan ExistingRDD[name#4736,age#4737,expense#4738,DOB#4739,income#4740,married#4741,networth#4742]
root
|-- name: string (nullable = true)
|-- age: integer (nullable = true)
|-- expense: integer (nullable = true)
|-- DOB: timestamp (nullable = true)
|-- income: double (nullable = true)
|-- married: boolean (nullable = true)
|-- networth: double (nullable = true)

+---+----------+
|key| value|
+---+----------+
| 1|[10 05 06]|
| 2|[0C 0E 09]|
+---+----------+

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
+---+-----+
|key|value|
+---+-----+
| 1| 1|
| 1| 2|
| 2| 1|
| 2| 1|
| 2| 3|
| 3| 2|
| 3| 3|
+---+-----+

+---------+---+---+---+
|key_value| 1| 2| 3|
+---------+---+---+---+
| 2| 2| 0| 1|
| 1| 1| 1| 0|
| 3| 0| 1| 1|
+---------+---+---+---+

+------------+--------+
|sum(expense)|max(age)|
+------------+--------+
| 6| 30|
+------------+--------+

Tests run: 110, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.765 sec <<< FAILURE! - in org.eclairjs.nashorn.SqlTest
rowCreateFromArray(org.eclairjs.nashorn.SqlTest) Time elapsed: 0.828 sec <<< FAILURE!
org.junit.ComparisonFailure: should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01 17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>
at org.eclairjs.nashorn.SqlTest.rowCreateFromArray(SqlTest.java:1974)

Running org.eclairjs.nashorn.SqlUDFTest
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.205 sec - in org.eclairjs.nashorn.SqlUDFTest
Running org.eclairjs.nashorn.WrappedObjectTest
{"0":1,"1":"A","length":2}
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in org.eclairjs.nashorn.WrappedObjectTest
Running org.eclairjs.nashorn.ZClusterTest
MASTER STARTED
WORKER STARTED
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was loaded from an external source
IN MAIN
IN MAIN
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.565 sec - in org.eclairjs.nashorn.ZClusterTest

Results :

Failed tests:
SqlTest.rowCreateFromArray:1974 should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01 17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>

Tests run: 292, Failures: 1, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:27 min
[INFO] Finished at: 2016-11-17T14:43:07+01:00
[INFO] Final Memory: 77M/488M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project eclairjs-nashorn: There are test failures.
[ERROR]
[ERROR] Please refer to /Users/eduardo/sw/incubator-toree/eclairjs/server/target/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException

I would really appreciate any help you can give me. Thanks a lot.

[Brian-P-Burns]

@rosale What's interesting is that you had 6 failures on the linux run and
1 failure on the mac run. We'll dig into this further to see if we can
reproduce. In the meantime you can skip the tests like so...

mvn package -DskipTests

On Thu, Nov 17, 2016 at 8:45 AM, rosale notifications@github.com wrote:

@bpburns https://github.com/bpburns thank you very much for your prompt
answer. I used the Oracle JVM.

I already tried to deploy the EclairJS Server on my Mac (MacBook Pro, Mid
2015), OS X El Capitan 10.11.6) by using the same JVM and the following
settings:

Spark (V2.0.0 built for Hadoop 2.6.0 and later)
Apache Maven 3.3.9
sbt 0.13.13
git 2.10.2

Unfortunately, I've got similar errors after executing the command mvn
package:

---

T E S T S

Running org.eclairjs.nashorn.CoreExamplesTest
Initial w:
0.4788752026744254,-0.35196535813838126,0.18919006260531712,0.
24688981973357493,-0.4150740295882427,0.8416380267684647,-0.
1082605636940599,0.2317320754087695,-0.6099894816250035,0.7594347720633767
On iteration 1
On iteration 2
On iteration 3
On iteration 4
On iteration 5
On iteration 6
On iteration 7
On iteration 8
On iteration 9
On iteration 10
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.043 sec

• in org.eclairjs.nashorn.CoreExamplesTest
  Running org.eclairjs.nashorn.CoreTest
  doing foreach 2
  doing foreach 1
  doing foreach 3
  doing foreachPartition 2
  doing foreachPartition 3
  doing foreachPartition 1
  Tests run: 40, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.913 sec
• in org.eclairjs.nashorn.CoreTest
  Running org.eclairjs.nashorn.DStreamTest
  16/11/17 14:41:26 ERROR ReceiverTracker: Deregistered receiver for stream
  0: Stopped by driver
  Exception in thread "receiver-supervisor-future-0" java.lang.Error:
  java.lang.InterruptedException: sleep interrupted
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1148)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
  ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
  Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.
  liftedTree1$1(Future.scala:24)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(
  Future.scala:24)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1142)
  ... 2 more
  16/11/17 14:41:29 ERROR ReceiverTracker: Deregistered receiver for stream
  0: Stopped by driver
  Exception in thread "receiver-supervisor-future-0" java.lang.Error:
  java.lang.InterruptedException: sleep interrupted
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1148)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
  ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
  Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.
  liftedTree1$1(Future.scala:24)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(
  Future.scala:24)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1142)
  ... 2 more
  16/11/17 14:41:32 ERROR ReceiverTracker: Deregistered receiver for stream
  0: Stopped by driver
  Exception in thread "receiver-supervisor-future-0" java.lang.Error:
  java.lang.InterruptedException: sleep interrupted
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1148)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
  ThreadPoolExecutor.java:617)
  at java.lang.Thread.run(Thread.java:745)
  Caused by: java.lang.InterruptedException: sleep interrupted
  at java.lang.Thread.sleep(Native Method)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply$mcV$sp(ReceiverSupervisor.scala:196)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at org.apache.spark.streaming.receiver.ReceiverSupervisor$$
  anonfun$restartReceiver$1.apply(ReceiverSupervisor.scala:189)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.
  liftedTree1$1(Future.scala:24)
  at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(
  Future.scala:24)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(
  ThreadPoolExecutor.java:1142)
  ... 2 more
  Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.351 sec
• in org.eclairjs.nashorn.DStreamTest
  Running org.eclairjs.nashorn.MlLibTest
  16/11/17 14:41:43 ERROR LBFGS: Failure! Resetting history: breeze.optimize.FirstOrderException:
  Line search failed
  {"testErr":0,"summary":"TreeEnsembleModel classifier with 3 trees\n"}
  Precision at 1 = 0.3
  NDCG at 1 = 0.3
  Precision at 3 = 0.43333333333333335
  NDCG at 3 = 0.40409616986363245
  Precision at 5 = 0.45333333333333337
  NDCG at 5 = 0.42532336613625027
  Mean average precision = 0.26890009065009063
  Tests run: 29, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.682
  sec - in org.eclairjs.nashorn.MlLibTest

Running org.eclairjs.nashorn.MlTest
+---+--------+-------------+
| id|category|categoryIndex|
+---+--------+-------------+
| 0| a| 0.0|
| 1| b| 2.0|
| 2| c| 1.0|
| 3| a| 0.0|
| 4| a| 0.0|
| 5| c| 1.0|
+---+--------+-------------+

Chose undefined categorical features: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14
15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39
40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64
65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89
90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110
111 112 113 114 115 116 117 118 119 120 121 122 133 134 135 136 137 138 139
140 141 142 143 144 145 146 147 148 149 161 162 163 164 165 166 167 168 169
170 171 172 173 174 175 176 190 191 192 193 194 195 196 197 198 199 200 201
202 203 219 220 221 222 223 224 225 226 227 228 229 230 231 247 248 249 250
251 252 253 254 255 256 257 258 276 277 278 279 280 281 282 283 284 285 304
305 306 307 308 309 310 311 312 313 332 333 334 335 336 337 338 339 340 361
362 363 364 365 366 367 368 389 390 391 392 393 394 395 396 417 418 419 420
421 422 423 424 445 446 447 448 449 450 451 452 473 474 475 476 477 478 479
480 500 501 502 503 504 505 506 507 508 528 529 530 531 532 533 534 535 536
555 556 557 558 559 560 561 562 563 564 583 584 585 586 587 588 589 590 591
592 593 610 611 612 613 614 615 616 617 618 619 620 621 637 638 639 640 641
642 643 644 645 646 647 648 649 650 664 665 666 667 668 669 670 671 672 673
674 675 676 677 678 679 680 681 688 689 690 691 toJSON
+-----+--------------------+--------------------+
|label| features| indexed|
+-----+--------------------+--------------------+
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
| 1.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[151,152,153...|(692,[151,152,153...|
| 0.0|(692,[129,130,131...|(692,[129,130,131...|
| 1.0|(692,[158,159,160...|(692,[158,159,160...|
| 1.0|(692,[99,100,101,...|(692,[99,100,101,...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[127,128,129...|(692,[127,128,129...|
| 1.0|(692,[154,155,156...|(692,[154,155,156...|
| 0.0|(692,[153,154,155...|(692,[153,154,155...|
| 0.0|(692,[151,152,153...|(692,[151,152,153...|
| 1.0|(692,[129,130,131...|(692,[129,130,131...|
| 0.0|(692,[154,155,156...|(692,[154,155,156...|
| 1.0|(692,[150,151,152...|(692,[150,151,152...|
| 0.0|(692,[124,125,126...|(692,[124,125,126...|
| 0.0|(692,[152,153,154...|(692,[152,153,154...|
| 1.0|(692,[97,98,99,12...|(692,[97,98,99,12...|
| 1.0|(692,[124,125,126...|(692,[124,125,126...|
+-----+--------------------+--------------------+
only showing top 20 rows

Tests run: 50, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.296
sec - in org.eclairjs.nashorn.MlTest
Running org.eclairjs.nashorn.PairRDDTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.226 sec

• in org.eclairjs.nashorn.PairRDDTest
  Running org.eclairjs.nashorn.SparkContextTest
  Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.612 sec
• in org.eclairjs.nashorn.SparkContextTest
  Running org.eclairjs.nashorn.SqlStreamingTest
  Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.844 sec
• in org.eclairjs.nashorn.SqlStreamingTest
  Running org.eclairjs.nashorn.SqlTest
  == Parsed Logical Plan ==
  'Except
  :- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714,
  married#4715, networth#4716]
  +- Filter (age#4711 > 20)
  +- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714,
  married#4715, networth#4716]

== Analyzed Logical Plan ==
name: string, age: int, expense: int, DOB: timestamp, income: double,
married: boolean, networth: double
Except
:- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714,
married#4715, networth#4716]
+- Filter (age#4737 > 20)
+- LogicalRDD [name#4736, age#4737, expense#4738, DOB#4739, income#4740,
married#4741, networth#4742]

== Optimized Logical Plan ==
Aggregate [name#4710, age#4711, expense#4712, DOB#4713, income#4714,
married#4715, networth#4716], [name#4710, age#4711, expense#4712, DOB#4713,
income#4714, married#4715, networth#4716]
+- Join LeftAnti, (((((((name#4710 <=> name#4736) && (age#4711 <=>
age#4737)) && (expense#4712 <=> expense#4738)) && (DOB#4713 <=> DOB#4739))
&& (income#4714 <=> income#4740)) && (married#4715 <=> married#4741)) &&
(networth#4716 <=> networth#4742))
:- LogicalRDD [name#4710, age#4711, expense#4712, DOB#4713, income#4714,
married#4715, networth#4716]
+- Filter (isnotnull(age#4737) && (age#4737 > 20))
+- LogicalRDD [name#4736, age#4737, expense#4738, DOB#4739, income#4740,
married#4741, networth#4742]

== Physical Plan ==
*HashAggregate(keys=[name#4710, age#4711, expense#4712, DOB#4713,
income#4714, married#4715, networth#4716], functions=[], output=[name#4710,
age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716])
+- Exchange hashpartitioning(name#4710, age#4711, expense#4712, DOB#4713,
income#4714, married#4715, networth#4716, 200)
+- *HashAggregate(keys=[name#4710, age#4711, expense#4712, DOB#4713,
income#4714, married#4715, networth#4716], functions=[], output=[name#4710,
age#4711, expense#4712, DOB#4713, income#4714, married#4715, networth#4716])
+- SortMergeJoin [coalesce(name#4710, ), coalesce(age#4711, 0),
coalesce(expense#4712, 0), coalesce(DOB#4713, 0), coalesce(income#4714,
0.0), coalesce(married#4715, false), coalesce(networth#4716, 0.0)],
[coalesce(name#4736, ), coalesce(age#4737, 0), coalesce(expense#4738, 0),
coalesce(DOB#4739, 0), coalesce(income#4740, 0.0), coalesce(married#4741,
false), coalesce(networth#4742, 0.0)], LeftAnti, (((((((name#4710 <=>
name#4736) && (age#4711 <=> age#4737)) && (expense#4712 <=> expense#4738))
&& (DOB#4713 <=> DOB#4739)) && (income#4714 <=> income#4740)) &&
(married#4715 <=> married#4741)) && (networth#4716 <=> networth#4742))
:- *Sort [coalesce(name#4710, ) ASC, coalesce(age#4711, 0) ASC,
coalesce(expense#4712, 0) ASC, coalesce(DOB#4713, 0) ASC,
coalesce(income#4714, 0.0) ASC, coalesce(married#4715, false) ASC,
coalesce(networth#4716, 0.0) ASC], false, 0
: +- Exchange hashpartitioning(coalesce(name#4710, ), coalesce(age#4711,
0), coalesce(expense#4712, 0), coalesce(DOB#4713, 0), coalesce(income#4714,
0.0), coalesce(married#4715, false), coalesce(networth#4716, 0.0), 200)
: +- Scan ExistingRDD[name#4710,age#4711,expense#4712,DOB#4713,
income#4714,married#4715,networth#4716]
+- *Sort [coalesce(name#4736, ) ASC, coalesce(age#4737, 0) ASC,
coalesce(expense#4738, 0) ASC, coalesce(DOB#4739, 0) ASC,
coalesce(income#4740, 0.0) ASC, coalesce(married#4741, false) ASC,
coalesce(networth#4742, 0.0) ASC], false, 0
+- Exchange hashpartitioning(coalesce(name#4736, ), coalesce(age#4737,
0), coalesce(expense#4738, 0), coalesce(DOB#4739, 0), coalesce(income#4740,
0.0), coalesce(married#4741, false), coalesce(networth#4742, 0.0), 200)
+- *Filter (isnotnull(age#4737) && (age#4737 > 20))
+- Scan ExistingRDD[name#4736,age#4737,expense#4738,DOB#4739,
income#4740,married#4741,networth#4742]

root
|-- name: string (nullable = true)
|-- age: integer (nullable = true)
|-- expense: integer (nullable = true)
|-- DOB: timestamp (nullable = true)
|-- income: double (nullable = true)
|-- married: boolean (nullable = true)
|-- networth: double (nullable = true)

+---+----------+
|key| value|
+---+----------+
| 1|[10 05 06]|
| 2|[0C 0E 09]|
+---+----------+

SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further
details.
+---+-----+
|key|value|
+---+-----+
| 1| 1|
| 1| 2|
| 2| 1|
| 2| 1|
| 2| 3|
| 3| 2|
| 3| 3|
+---+-----+

+---------+---+---+---+
|key_value| 1| 2| 3|
+---------+---+---+---+
| 2| 2| 0| 1|
| 1| 1| 1| 0|
| 3| 0| 1| 1|
+---------+---+---+---+

+------------+--------+
|sum(expense)|max(age)|
+------------+--------+
| 6| 30|
+------------+--------+

Tests run: 110, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 40.765
sec <<< FAILURE! - in org.eclairjs.nashorn.SqlTest
rowCreateFromArray(org.eclairjs.nashorn.SqlTest) Time elapsed: 0.828 sec
<<< FAILURE!
org.junit.ComparisonFailure: should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01
17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>
at org.eclairjs.nashorn.SqlTest.rowCreateFromArray(SqlTest.java:1974)

Running org.eclairjs.nashorn.SqlUDFTest
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.205 sec

• in org.eclairjs.nashorn.SqlUDFTest
  Running org.eclairjs.nashorn.WrappedObjectTest
  {"0":1,"1":"A","length":2}
  Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
• in org.eclairjs.nashorn.WrappedObjectTest
  Running org.eclairjs.nashorn.ZClusterTest
  MASTER STARTED
  WORKER STARTED
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  https://raw.githubusercontent.com/janl/mustache.js/master/mustache.js was
  loaded from an external source
  IN MAIN
  IN MAIN
  Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.565 sec
• in org.eclairjs.nashorn.ZClusterTest

Results :

Failed tests:
SqlTest.rowCreateFromArray:1974 should be same expected:<...[1122334,111,"2012-0[8-3]1","2012-09-01
17:12...> but was:<...[1122334,111,"2012-0[9-0]1","2012-09-01 17:12...>

Tests run: 292, Failures: 1, Errors: 0, Skipped: 0

[INFO] ------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------

[INFO] Total time: 02:27 min
[INFO] Finished at: 2016-11-17T14:43:07+01:00
[INFO] Final Memory: 77M/488M

[INFO] ------------------------------------------------------------

[ERROR] Failed to execute goal org.apache.maven.plugins:
maven-surefire-plugin:2.19.1:test (default-test) on project
eclairjs-nashorn: There are test failures.
[ERROR]
[ERROR] Please refer to /Users/eduardo/sw/incubator-
toree/eclairjs/server/target/surefire-reports for the individual test
results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the
-e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
MojoFailureException

I would really appreciate any help you can give me. Thanks a lot.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#9 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAiWKO4OR1iOkP5jvQyLmlq96JtpfmT-ks5q_FprgaJpZM4KxRY_
.

[doronrosenberg]

You could also use our prebuilt jars at http://repo2.maven.org/maven2/org/eclairjs/eclairjs-nashorn/0.9/eclairjs-nashorn-0.9-jar-with-dependencies.jar.

On OSX with Java 1.8.0_71 I see this:

Failed tests:
SqlStreamingTest.queryManagerTest:73 should be same expected: java.lang.Integer<1> but was: java.lang.Long<1>
SqlTest.dataFrameGetListTest:2007 should be same expected:<["["foo",["a","b","c"]]"]> but was:<["["foo",[["a","b","c"]]]"]>
Tests in error:
MlTest.ModelSelectionViaCrossValidationExample:770 » ClassCast jdk.nashorn.int...
MlTest.simpleTextClassificationPipeline:1140 » ClassCast jdk.nashorn.internal....
MlTest.tokenizerExample:1208 » ClassCast java.lang.Long cannot be cast to java...
SqlTest.createDataFrameJSON:1917 » ClassCast jdk.nashorn.internal.scripts.JO4 ...

[QuantumRich]

@doronrosenberg where would the updated README be? For some reason I can only find updates till November 14th and I am still running into the same original issue with the missing toree jars.

[doronrosenberg]

@QuantumRich

https://github.com/EclairJS/eclairjs/blob/master/server/README.md, the Build Toree section now has a git checkout e8ecd0623c65ad104045b1797fb27f69b8dfc23f that should fix the issue. I would also disable tests using -Dmaven.test.skip=true as they do take a long time to finish.

[QuantumRich]

@doronrosenberg

Unfortunately, I had gotten the first error in this thread using that branch.

[doronrosenberg]

@QuantumRich can you post the exact error message and what OS you are on? I just tried using the master of elcairjs following the README, we devs might all have something cached that is not there for new users and we need to try to figure out what that would be.

[doronrosenberg]

We also have pre-built jars at http://repo2.maven.org/maven2/org/eclairjs/eclairjs-nashorn/0.10/eclairjs-nashorn-0.10-jar-with-dependencies.jar

[QuantumRich]

Yes, thank you for the jars URL. I have been using one of these in the meantime.

This is my error on Mac OS X 10.11.6:

[INFO] Scanning for projects...
[WARNING] 
[WARNING] Some problems were encountered while building the effective model for org.eclairjs:eclairjs-nashorn:jar:0.10
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin @ line 83, column 15
[WARNING] 'build.plugins.plugin.version' for net.alchim31.maven:scala-maven-plugin is missing. @ line 173, column 15
[WARNING] 
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING] 
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING] 
[INFO] Inspecting build with total of 1 modules...
[INFO] Installing Nexus Staging features:
[INFO]   ... total of 1 executions of maven-deploy-plugin replaced with nexus-staging-maven-plugin
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building EclairJS Nashorn 0.10
[INFO] ------------------------------------------------------------------------
Downloading: https://repository.apache.org/content/groups/snapshots/org/apache/toree/kernel/toree-kernel-api_2.11/0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata org.apache.toree.kernel:toree-kernel-api_2.11:0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml from/to apache-snapshots (https://repository.apache.org/content/groups/snapshots): repository.apache.org: unknown error
[WARNING] Failure to transfer org.apache.toree.kernel:toree-kernel-api_2.11:0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml from https://repository.apache.org/content/groups/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache-snapshots has elapsed or updates are forced. Original error: Could not transfer metadata org.apache.toree.kernel:toree-kernel-api_2.11:0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml from/to apache-snapshots (https://repository.apache.org/content/groups/snapshots): repository.apache.org: unknown error
Downloading: https://repository.apache.org/content/groups/snapshots/org/apache/toree/kernel/toree-kernel-api_2.11/0.2.0.dev1-incubating-SNAPSHOT/toree-kernel-api_2.11-0.2.0.dev1-incubating-SNAPSHOT.pom
Downloading: https://repository.apache.org/content/groups/snapshots/org/apache/toree/kernel/toree-kernel_2.11/0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata org.apache.toree.kernel:toree-kernel_2.11:0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml from/to apache-snapshots (https://repository.apache.org/content/groups/snapshots): repository.apache.org
[WARNING] Failure to transfer org.apache.toree.kernel:toree-kernel_2.11:0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml from https://repository.apache.org/content/groups/snapshots was cached in the local repository, resolution will not be reattempted until the update interval of apache-snapshots has elapsed or updates are forced. Original error: Could not transfer metadata org.apache.toree.kernel:toree-kernel_2.11:0.2.0.dev1-incubating-SNAPSHOT/maven-metadata.xml from/to apache-snapshots (https://repository.apache.org/content/groups/snapshots): repository.apache.org
Downloading: https://repository.apache.org/content/groups/snapshots/org/apache/toree/kernel/toree-kernel_2.11/0.2.0.dev1-incubating-SNAPSHOT/toree-kernel_2.11-0.2.0.dev1-incubating-SNAPSHOT.pom
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1.644 s
[INFO] Finished at: 2017-01-17T11:21:44-05:00
[INFO] Final Memory: 24M/437M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project eclairjs-nashorn: Could not resolve dependencies for project org.eclairjs:eclairjs-nashorn:jar:0.10: Failed to collect dependencies at org.apache.toree.kernel:toree-kernel-api_2.11:jar:0.2.0.dev1-incubating-SNAPSHOT: Failed to read artifact descriptor for org.apache.toree.kernel:toree-kernel-api_2.11:jar:0.2.0.dev1-incubating-SNAPSHOT: Could not transfer artifact org.apache.toree.kernel:toree-kernel-api_2.11:pom:0.2.0.dev1-incubating-SNAPSHOT from/to apache-snapshots (https://repository.apache.org/content/groups/snapshots): repository.apache.org: Unknown host repository.apache.org -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException

[Brian-P-Burns]

@QuantumRich In your Toree build do a make sbt-publishM2. That will get the toree jar into your local ~/.m2 repository so the eclairjs build can find them.

[QuantumRich]

@bpburns I have already run that function with no errors.