locked
Stream Analytics: Path Pattern when BLOB is input RRS feed

  • Question

  • I have a requirement where application will dump the data in DATA lake in various folder like below:

    CustomerID=1/FACT/Transactions/json
    CustomerID=1/DIM/Area/.json
    CustomerID=2/FACT/Transactions/json
    CustomerID=2/DIM/Area/.json

    I want to only pick JSON from Folder FACT/Transactions.

    I tried in Path Pattern to set /FACT/Transactions/,but it is not picking the file. Any suggestion on how I can do it?

    Tuesday, March 31, 2020 11:51 PM

Answers

  • Hello Khushboo , 

    The path pattern always works with date/time factor . The thing which you are trying at this time is not possible .


    Thanks Himanshu

    Thursday, April 9, 2020 6:36 PM

All replies

  • Hello Khushboo dubey and thank you for your question.

    I notice that your folders start with "CustomerID=1" but this is not part of your path pattern.   Can you try something like:

    CustomerID={custId}/FACT/Transactions/json

    Thursday, April 2, 2020 4:12 AM
  • Hi Martin,

    the CustomerID is nothing but GUID ,which will different.

    SO below is the Structure:

    • 01e1d1fe-a43a-41fe-9672-7267cf819a03/FACT/Transactions/json files
    • 01e1d1fe-a43a-41fe-9672-7267cf819a03/DIM/AREA/json files
    • 08caaa56-c544-45af-b92f-21bb1d3dac33/FACT/Transactions/json Files
    • 08caaa56-c544-45af-b92f-21bb1d3dac33/DIM/AREA/json

    So how to tell SA to fetch only from folder FACT/Transactions?

    Thursday, April 2, 2020 11:28 AM
  • Hello Khushboo , 

    The path pattern always works with date/time factor . The thing which you are trying at this time is not possible .


    Thanks Himanshu

    Thursday, April 9, 2020 6:36 PM