none
Parallel Training on Machine Learning Compute RRS feed

  • Question

  • Hi experts,

    Can I train model in parallel ?

    I want to train model in parallel on specified number of compute nodes. It is something like Hyperdrive Estimator because it can run same training job in parallel.

    Regards,

    Keita


    Thursday, October 17, 2019 9:20 AM

Answers

  • Hello Keita,

    There is an option to use azure Batch which is used to run large-scale parallel and high-performance computing (HPC) applications efficiently in the cloud. AzureBatchStep can be used in an Azure Machine Learning Pipeline to submit jobs to an Azure Batch pool of machines.

    To attach Azure Batch as a compute target, you must use the Azure Machine Learning SDK and provide the following information:

    • Azure Batch compute name: A friendly name to be used for the compute within the workspace
    • Azure Batch account name: The name of the Azure Batch account
    • Resource Group: The resource group that contains the Azure Batch account

    Please check out the sample notebook on Azure batch steps which can be used with Azure ML pipeline

    -Rohit

    • Marked as answer by keonabut Friday, October 18, 2019 10:17 AM
    Thursday, October 17, 2019 10:57 AM
    Moderator

All replies

  • Hello Keita,

    There is an option to use azure Batch which is used to run large-scale parallel and high-performance computing (HPC) applications efficiently in the cloud. AzureBatchStep can be used in an Azure Machine Learning Pipeline to submit jobs to an Azure Batch pool of machines.

    To attach Azure Batch as a compute target, you must use the Azure Machine Learning SDK and provide the following information:

    • Azure Batch compute name: A friendly name to be used for the compute within the workspace
    • Azure Batch account name: The name of the Azure Batch account
    • Resource Group: The resource group that contains the Azure Batch account

    Please check out the sample notebook on Azure batch steps which can be used with Azure ML pipeline

    -Rohit

    • Marked as answer by keonabut Friday, October 18, 2019 10:17 AM
    Thursday, October 17, 2019 10:57 AM
    Moderator
  • Thank you for your help. Please close it.
    Friday, October 18, 2019 10:17 AM