none
Lookup Error: The data type ByteArray is not supported

    Question

  • I'm following this documentation to Incrementally load data from multiple tables in SQL Server. 

    We are using MS Change Data Capture (CDC) so our high watermark is the max lsn.  The lookup runs:  select sys.fn_cdc_get_max_lsn() AS max_lsn

     How can we use the lookup to get the high watermark for each of the tables processed?

    Below is the error from ADF:

      "Message": "ErrorCode=DataTypeNotSupported,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Column: max_lsn,The data type ByteArray is not supported.,Source=,'",
        "ExceptionMessage": "ErrorCode=DataTypeNotSupported,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Column: max_lsn,The data type ByteArray is not supported.,Source=,'",
        "ExceptionType": "Microsoft.DataTransfer.Execution.Core.ExecutionException",
        "StackTrace": "   at System.Web.Http.Filters.ActionFilterAttribute.d__1.MoveNext()\r\n--- End of stack trace from previous location where exception was thrown

    Thursday, August 30, 2018 6:05 PM

All replies

  • The ByteArray is currently not supported in Lookup. You may check limit at https://docs.microsoft.com/en-us/azure/data-factory/control-flow-lookup-activity

    Thursday, August 30, 2018 10:46 PM