none
Virtual Networks and Databricks

    Question

  • Hi Guys,

    Since Databricks spin clusters with different Public IPs, I am trying to have a Static IP so we can use to White list Spark Cluster in Routers and other services. Using Virtual Networks, Peering and LoadBalancer.

    Please Help !

    Tuesday, June 26, 2018 8:39 PM

All replies

  • Hello,

    When I look at the configuration of Databricks cluster public IPs, they appear to be set as 'Dynamic' and cannot be changed to 'Static'.  Any change I attempted failed because there is a Resource Group lock in place on the Resource Group the cluster gets created in, see more on locks here:

    https://docs.microsoft.com/en-us/azure/azure-resource-manager/resource-group-lock-resources

    I tried to unsuccessfully to remove the lock on the Resource Group as it appears to be strictly managed by the Databricks service.  Static IPs do not appear to be a supported configuration.

    Here is a document describing how to peer Virtual Networks with Databricks:

    https://docs.azuredatabricks.net/administration-guide/cloud-configurations/azure/vnet-peering.html#virtual-network-peering

    If you are trying to connect Databricks to an on-premises network, there is a section in the above documentation which links to procedures on how to do that:

    https://docs.azuredatabricks.net/administration-guide/cloud-configurations/azure/vnet-peering.html#connect-an-on-premises-virtual-network-to-an-azure-virtual-network


    Tuesday, June 26, 2018 10:57 PM
    Moderator