locked
Unable to insert into Snowflake using Azure Data Factory V2 with Snowflake ODBC (V2.20) 64 bit - System DSN on Windows VM RRS feed

  • Question

  • I can select the snowflake tables in Azure Data Factory V2 using ODBC Connector (V2.20) stored in a VM. VM does have Integration Runtime through which this DSN is accessible. 

    When i try toinsert anything using ADF getting below error:

    <o:p> </o:p>

    Failure happened on 'Sink' side. ErrorCode=SystemErrorOdbcWriteError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [07009] [Snowflake][ODBC] (10670) Invalid descriptor index, descriptor record does not exist, or descriptor record was not properly initialized.,Source=Microsoft.DataTransfer.ClientLibrary.Odbc.OdbcConnector,''Type=Microsoft.DataTransfer.ClientLibrary.Odbc.Exceptions.OdbcException,Message=ERROR [07009] [Snowflake][ODBC] (10670) Invalid descriptor index, descriptor record does not exist, or descriptor record was not properly initialized.,Source=Snowflake,<o:p></o:p>

    <o:p> </o:p>

    I have 40 columns in my source and the same are present in Snowflake too. Mapped exactly as per the target (snowflake) column order. <o:p></o:p>

    I further did troubleshoot by adding a link service inside a SQL Server to Snowflake using the same DSN in the VM. Able to connect snowflake and perform inserts too. <o:p></o:p>

    <o:p> </o:p>

    Am I missing something in VM ODBC Registry settings? <o:p></o:p>

    Or Azure Data Factory do not support Direct ingestion using ODBC connector of Snowflake?<o:p></o:p>

    Or where can I configure "Nested queries, allow in process, supports like operator" for the ODBC DSN? I read a similar article to create the link service in SQL Server these settings to be enabled in MSDASQL properties. in my case i dont want to use Link Service, i would like to use Azure Data Factory only using ODBC DSN to Snowflake. <o:p></o:p>

    <o:p> </o:p>

    Appreciate if anyone have solution for this issue.<o:p></o:p>

    Thursday, November 21, 2019 3:47 PM

Answers

  • I just got a word from the team , our ODBC sink connector can not support inserting data into snowflake using snowflake ODBC driver.

    They  did confirmed that they are working on  a Snowflake connector ,  which will be released in a future , no ETA at this time . 

    You can add the product feedback / requirement at https://feedback.azure.com/forums/270578-data-factory


    Thanks Himanshu

    • Marked as answer by labdub Tuesday, November 26, 2019 6:27 PM
    Tuesday, November 26, 2019 6:02 PM

All replies

  • Can you please share the runid ? 

    Thanks Himanshu

    Thursday, November 21, 2019 11:22 PM
  • 9ddebd6e-02a7-4769-ae5e-5b32024bd0a3
    • Edited by labdub Thursday, November 21, 2019 11:40 PM
    Thursday, November 21, 2019 11:38 PM
  • 9ddebd6e-02a7-4769-ae5e-5b32024bd0a3
    Thursday, November 21, 2019 11:42 PM
  • Thanks for the sharing the runid , team is looking into this and I will update you on this once I hear from them.


    Thanks Himanshu

    Friday, November 22, 2019 7:40 PM
  • Please share your findings..

    Tuesday, November 26, 2019 3:42 PM
  • I just got a word from the team , our ODBC sink connector can not support inserting data into snowflake using snowflake ODBC driver.

    They  did confirmed that they are working on  a Snowflake connector ,  which will be released in a future , no ETA at this time . 

    You can add the product feedback / requirement at https://feedback.azure.com/forums/270578-data-factory


    Thanks Himanshu

    • Marked as answer by labdub Tuesday, November 26, 2019 6:27 PM
    Tuesday, November 26, 2019 6:02 PM
  • Ok Thanks Himanshu
    Tuesday, November 26, 2019 6:27 PM