none
Hive ODBC connection does not show any tables or views. RRS feed

  • Question

  • Hi,

    When we use the ODBC drivers for HIVE in Power BI we see all the Hive tables and views that the user has access to. However, in Azure Data Catalogue we do not see any tables or views. Is this a known issue?

    Thanks

    John F Kidd

    Wednesday, May 17, 2017 8:07 PM

All replies

  • Hi John,

    It's definitely not the expected behavior, we need to install the Hive ODBC driver by ourselves, then use Azure Data Catalog to connect to the hive data source.

    Can I ask you some question to help you clarify the issue?

    1. Do you use the same machine to connect to hive with Power BI and Azure Data Catalog? If not, you need to install the Hive ODBC driver first on the machine you want to use Azure Data Catalog, then try to connect to hive by using ODBC Data Source Administrator to verify whether the driver installation is correct, then you can go to Azure Data Catalog to try again.

    2. What exact the hive data source you was trying to connect, and what's the version of driver you installed?

    Monday, May 22, 2017 3:48 AM
  • Hi,

    Thanks for getting back to me.

    - We are using the Microsoft Hive OBDC drivers downloaded form the website.

    - We are using the same machine and the same drivers for Power BI and ADC.

    Like I say we seem to connect but cannot see any tables. We are using Kerberos authentication.

    Tuesday, May 23, 2017 3:28 PM
  • Hi,

    It is also worth mentioning that the odbc database page of the desktop app asks for:

    - Driver

    - Connection String

    - Database

    - User

    - Password

    This seems strange as we should be able to select a system dsn as we do with Power BI.

    Tuesday, May 23, 2017 3:50 PM
  • And finally, to be clear, we are an on-premise HDP 2.5 cluster. Does Azure Data Catalog only work with HDInsight?
    Tuesday, May 23, 2017 3:55 PM
  • Hi John,

    In odbc database page of registration tool, so far it doesn't support dsn connection, and you need to input the information in dsn file to this page.

    Wednesday, May 24, 2017 7:26 AM
  • Hi John,

    I have tested with HDP 2.5 cluster (I created a VM on Azure and setup a HDP 2.5 cluster), it works for me in my local test.

    Here is what I did:

    1. Setup a VM on Azure and host a HDP 2.5 cluster.

    2. Install the latest Microsoft Hive ODBC driver, here is the link: https://www.microsoft.com/en-us/download/details.aspx?id=40886

    3. In the VM network settings, open 10000 port in network security group.

    4. Launch registration tool, and in hive page, input

    - Server (it's the public ip address in my case),

    - Port (it's 10000 in my case because I open 10000 port number in network security group),

    - Authentication Type, choose "Basic"

    - User Name and Password.

    5. Then click connect, I can see there are three database in server hierarchy, "default", "foodmart" and "xademo".

    6. Then I click "default", it will show two table in Available objects, "sample_07" and "sample_08".

    7. Then I choose both of them, click "Include Preview" and "Include Data Profile", and add an expert as my email address. Then click Register.

    Not sure whether you miss any step of them, if so, please follow the above steps to take one more try.

    Wednesday, May 24, 2017 8:14 AM
  • Hi,

    Our instance is Kerborized and uses Active Directory. I followed the steps above (and already tried this) and it gives an authentication error.

    I think you need to have the same environment as me to test this properly.

    Thanks

    john

    Thursday, June 8, 2017 3:12 PM
  • Hi,

    Since so far we don't support DSN in Registration Tool, which is the way we use to connect to HDP via Power BI. And at the same time, there is no Kerberos auth option in Hive page of Registration Tool, I tested your scenario and it also returned authentication error from Registration Tool. According to the implement, Kerberos is not supported in Registration Tool so far.

    Thanks,

    Troy

    Monday, June 12, 2017 7:51 AM
  • Hi Troy,

    Thanks for getting back to us. We were really banking on rolling out this product to manage our business data catalog for our data lake. We are currently Hadoop / HDP onsite and looking to use HDInsight as a joint cloud and onsite cluster. Also, the HDInsight instance will also be secured using AD.

    As this won't happen in the near term, are there any plans to fix the issue above issue and provide DSN and AD so that we have the same behaviour as Power BI?

    If not we will need to look elsewhere.

    John

    Friday, June 16, 2017 10:47 AM
  • Hi John,

    Since so far the Registration Tool doesn't support DSN connection in Hive, it should be a feature gap and we will add them into our development plan.

    Before we estimate the development plan, there is no ETA yet. I'm very sorry for the imperfect user experiences.

    Troy

    Monday, June 19, 2017 6:50 AM
  • Thanks for letting us know Troy. I guess for now we will have to look at another solution. Please keep me posted with any new features that will solve our problem.
    Monday, June 19, 2017 4:27 PM
  • Hi Troy, any update on this? Can't find the documentation of Data Catalog to fill in the ODBC Database or Hive Database. I've some issues configuring the HTTP path. We're using Databricks in Azure and it's not clear what settings to configure.
    Monday, July 29, 2019 1:35 PM
  • Hello Daniel , 

    We will reach out to the internal team and update you once we hear back from them .


    Thanks Himanshu

    Wednesday, July 31, 2019 10:14 PM
  • Just got a reply from the Azure catalog team that the ODBC driver is not set up to work with Databricks and we do not have a resolution. for that at this time .


    Thanks Himanshu

    Thursday, August 1, 2019 4:52 PM