Running mapper only HDInsight streaming activity RRS feed

  • Question

  • Hi,

    In one of my hadoop processing use cases, I need to run a mapper only streaming activity on the HDInsight cluster. Standard Hadoop processing environment supports configuration of mapper only streaming job execution with option -numReduceTasks 0 . But, on the HDInsight streaming configuration, it looks like both mapper and reducer configurations are mandatory. 

    Is there any way I can skip reducer configuration and run mapper only streaming activity.



    Tuesday, April 2, 2019 4:37 PM

All replies

  • Hi Viswanath,

    Thanks for reporting this issue. I’m working with the product team and get back to you when I have more information.

    Wednesday, April 3, 2019 6:30 AM