Apache Spark and node.js

I would like to name a node.js program from spark-submit using the Spark API in JavaScript. Is there a JavaScript implementation of this API?

I know it is possible to call an external mapper and reducer (written in JavaScript) from Hadoop, but I want to be able to run the complete program as a single job from Spark.

+3


source to share


2 answers


I don't believe there is a current JavaScript spark wrapper, however I would check the information on the Spark pipe interface, this will allow you to use JavaScript code from Spark. Good luck with your Spark and Javascript adventures (unfortunately there was april fools joke about Spark and ScalaJS, which makes finding Spark + Javascript information a bit tricky).



+3


source


There is a new project called EclairJS that provides the Spark API from Node and JavaScript, see https://github.com/EclairJS/eclairjs-node .



+3


source







All Articles