locked
Preserve ACL between ADSL Gen 2 when using a data factory copy data pipeline RRS feed

  • Question

  • Hi,

    as a native solution is not ready yet to backup ADLS Gen 2, I did create a second ADLS Gen2 (with a cool access to reduce the cost) and executed a Data Factory copy data pipeline.

    I did try to preserve ACL but didn't figured out how to preserves those ones..

    For exemple I did try the following options with no success.

    1. "preserve": [ "Attributes" ]

    2. "preserve": [ "ACL", "Owner", "Group" ]

    Actually I did get the following error with the second option :

    Copy with preserving ACL is not supported from AzureBlobFS to AzureBlobFS

    Please find below a sample code of a copy data pipeline.

    {
        "name": "bck",
        "properties": {
            "activities": [
                {
                    "name": "refined",
                    "type": "Copy",
                    "dependsOn": [],
                    "policy": {
                        "timeout": "7.00:00:00",
                        "retry": 0,
                        "retryIntervalInSeconds": 30,
                        "secureOutput": false,
                        "secureInput": false
                    },
                    "userProperties": [],
                    "typeProperties": {
                        "source": {
                            "type": "BinarySource",
                            "storeSettings": {
                                "type": "AzureBlobFSReadSettings",
                                "recursive": true
                            }
                        },
                        "sink": {
                            "type": "BinarySink",
                            "storeSettings": {
                                "type": "AzureBlobFSWriteSettings",
                                "copyBehavior": "PreserveHierarchy"
                            }
                        },
                        "enableStaging": false,
                        "preserve": [
                            "Attributes"
                        ]
                    },
                    "inputs": [
                        {
                            "referenceName": "adls_ref",
                            "type": "DatasetReference"
                        }
                    ],
                    "outputs": [
                        {
                            "referenceName": "adlsbck_ref",
                            "type": "DatasetReference"
                        }
                    ]
                }
            ],
            "annotations": []
        }
    }


    Regards,

    James

    Wednesday, January 29, 2020 8:16 AM

Answers

  • Hi James,

    I had a conversation with the internal team and they confirmed that preserving ACLs is only enabled for ADLS Gen1 to ADLS Gen2 copies.

    I would recommend you to provide feedback at the feedback forum. All the feedback you share, is closely monitored by the Data Factory Product team and implemented in future releases.

    Also, Regarding service general availability, I would suggest to keep an eye on Azure updates. 

    Azure updates provide information about important Azure product updates, roadmap, and announcements.

    Thursday, January 30, 2020 6:16 AM

All replies