Virtual Networks and Databricks


  • Hi Guys,

    Since Databricks spin clusters with different Public IPs, I am trying to have a Static IP so we can use to White list Spark Cluster in Routers and other services. Using Virtual Networks, Peering and LoadBalancer.

    Please Help !

    Tuesday, June 26, 2018 8:39 PM

All replies

  • Hello,

    When I look at the configuration of Databricks cluster public IPs, they appear to be set as 'Dynamic' and cannot be changed to 'Static'.  Any change I attempted failed because there is a Resource Group lock in place on the Resource Group the cluster gets created in, see more on locks here:

    I tried to unsuccessfully to remove the lock on the Resource Group as it appears to be strictly managed by the Databricks service.  Static IPs do not appear to be a supported configuration.

    Here is a document describing how to peer Virtual Networks with Databricks:

    If you are trying to connect Databricks to an on-premises network, there is a section in the above documentation which links to procedures on how to do that:

    Tuesday, June 26, 2018 10:57 PM