How do I start a spark cluster 2.0.1 with power shell script? RRS feed

  • Question

  • I am trying to create a spark cluster with power shell following this instruction. I changed the ClusterType from Hadoop to Spark as well as the newest version number to *3.5* (I initially tried with 2.0.1 but it didn't work). This created a spark cluster but with version 1.6.2 instead of 2.0.1 as intended. So is it possible to create a spark cluster with version 2.0.+ with powershell? This is necessary, because Azure does not provide an option to stop and start the cluster but have to create and delete it.

    • Edited by Psidom Thursday, January 5, 2017 9:05 PM
    Thursday, January 5, 2017 9:04 PM