在加载到SSIS包中的（SQL）DB表之前从文件中删除dupes

本文介绍了在加载到SSIS包中的（SQL）DB表之前从文件中删除dupes的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！ 问题描述

我有2个文件（文本），我想加载到我的DB（SQL）表中。但我的两个文件中都有 dupes （主键欺骗）如何在将文件加载到SSIS包中的数据库之前根除或消除文件中的欺骗行为。 有人可以详细告诉我所有的任务是什么（控制流任务和数据流任务）我必须包含在SSIS包中才能完成上述任务？

I have 2 files (text) that I want to load into my DB (SQL) table.But my both the files have dupes in them (primary key dupes and duplicate rows).So how to eradicate or eliminate dupes from files before loading it to DB in SSIS packages. Can some one tell me in detail what all the tasks (Controlflow task and Data flow task) I have to include in a SSIS package to achieve the above task?

推荐答案

我最近必须在SSIS包中做到这一点。我使用了排序转换并选中了删除具有重复排序值的行框。 这是一篇非常好的文章，介绍了如何做到这一点。 www.mssqltips/ sqlservertip / 3036 / removed-duplicates-rows-with-ssis-sort-transformation / [ ^ ] I had to do that recently inside an SSIS package. I used the sort transformation and checked the box to "remove rows with duplicate sort values". This is a pretty good article on how to do that. www.mssqltips/sqlservertip/3036/removing-duplicates-rows-with-ssis-sort-transformation/[^]