locked
How to replace/update documents when copying json files from ADLS to CosmosDB? RRS feed

  • Question

  • I have Azure Data Store as source and CosmosDB as sink. I can successfully copy all json files in the ADLS folder to CosmosDB.

    However when run manually again same pipeline or scheduled trigger, I get multiple of same of documents to site collection of DocumentDB as ADF append files. How do I replace(update) documents? Is it possible define document name as source json file name and use name to update file? Or is it possible to use id of the source json to replace file?

    {
        "name": "AzureDataLakeStoreRefineryDataset",
      "properties": {
        "type": "AzureDataLakeStoreFile",
        "linkedServiceName": {
          "referenceName": "AzureDataLakeStoreRefineryLinkedService",
          "type": "LinkedServiceReference"
        },

        "typeProperties": {
          "folderPath": "results/",

          "format": {
            "type": "JsonFormat"
          }
        }
      }
    }


    "id": "ed0e4960-d9c5-11e6-85dc-d7996816aad3", "context": { "device": { "type": "PC" }, "custom": { "dimensions": [ { "TargetResourceType": "Microsoft.Compute/virtualMachines" }, { "ResourceManagmentProcessRunId": "827f8aaa-ab72-437c-ba48-d8917a7336a3" }, { "OccurrenceTime": "1/13/2017 11:24:37 AM" } ] } } }


    Kenny_I

    Monday, January 8, 2018 1:49 PM