Automic_Community_5543

Spark via REST

Discussion created by Automic_Community_5543 on Apr 9, 2018

When you use spark-submit (or spark-submit2), then you need an Agent on the edge nodes of the cluster. In many Hadoop Shops that is not a prefered solution. 

This One Automation Export has a set of objects to submit via the REST API that is available in any Spark Installation (see http://arturmkrtchyan.com/apache-spark-hidden-rest-api#).

Video -https://automic.box.com/s/bry6f8rkudhhjwrob39bli5qqasfgv4w

 


See Plugin

Outcomes