您的评估是全面的。如果您想复制权限,这些确实是可用的选项。所以你必须选择其中一个,对不起。如果您真的想要一个可以复制权限的无服务器选项,则Azure Data Factory将不得不这样做。您可以在这里创建一个反馈项目 - feedback.azure/forums / 270578-data-factory ?
谢谢, Sachin Sheth Azure Data Lake项目经理。
I am working on a backup strategy for Data Lake Store (DLS). My plan is to create two DLS accounts and copy data between them. I have evaluated several approaches to achieve this but none of them satisfies the requirement to preserve the POSIX ACLs (permissions in DLS parlance). PowerShell cmdlets require data to be downloaded from the primary DLS onto a VM and re-uploaded onto the secondary DLS. The AdlCopy tool works only on Windows 10, does not preserve permissions and neither supports copying data across regions (not that this is a hard requirement). Data Factory seemed like the most sensible approach until I realized it also doesn't preserve permissions. Which leads me to my last option - Distcp. According to the Distcp guide (hadoop.apache/docs/current/hadoop-distcp/DistCp.html), the tool supports preserving of permissions. However, the downside of using Distcp is that the tool must be run from HDInsight. Although it supports both intra and inter-cluster copying, I would rather not have a running HDInsight cluster just for backup operations. Am I missing something? Does anyone have any better suggestions?
解决方案Your assessment is comprehensive. Those are indeed the options that are available should you want to copy over permissions. So you will have to choose one of them, sorry. If you truly want a serverless option that would copy over the permissions, Azure Data Factory would have to be it. Could you please create a feedback item here - feedback.azure/forums/270578-data-factory?
Thanks, Sachin Sheth Program Manager, Azure Data Lake.
更多推荐
Data Lake Store的备份
发布评论