none
ADF v2 - passing multiple arguments with expressions to spark

    Question

  • Hello.

    This works when I rerun with manual trigger:

    arguments:[

    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename",

    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename2",

    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename3",

    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename4"..]

    However this doesn't publish saying that it found invalid quotes(meaning '' in format datetime, is my guess) but it doesn't work without those quotes; and creating escape double quotes doesn't work in spark, it fails saying it found invalid string(%22, which is double quote)

    Any help will be appreciated.

    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename"
    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename"
    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename",
    "adllocation/@{formatDateTime(pipeline().parameters.windowStart,'yyyyMMddHHmmss')}/filename",

    byungjoon yoon, software engineer at servicelink

    Tuesday, July 24, 2018 4:03 PM

All replies

  • OK, so at least I can start from commandline, so I guess I will continue that way.

    FYI, This is happening because for UI double quotes are getting removed.

    If somebody from MS is watching this I would appreciate it if they can file it as a bug.


    byungjoon yoon, software engineer at servicelink

    Tuesday, July 24, 2018 5:06 PM