【发布时间】:2023-03-28 13:42:01
【问题描述】:
我这样做是为了更好地使用 SSIS 和 Microsoft Dynamics CRM。首先,我将介绍一些背景:
- 向 Dynamics CRM 添加记录非常慢。
- 对此启用重复检测会使添加记录变得更慢。
- 从源检索数据所需的时间几乎没有创建数据那么长。
我想做的是获取名称中带有 sample 的每个 Account 记录,例如 A。基准(示例),并创建尽可能多的迭代,没有重复,直到 Microsoft 关闭我的在线试用组织。以下是这些帐户的命名约定:
- A.基准(样本),A.基准(样本)1,A.基准(样本)2,... A.基准(样本)?
我已经创建了 脚本组件 来为每个 原始示例帐户 和数据流中的每个 示例帐户 创建 10 次迭代,以0。然后将此数据流放置在循环容器中。我允许它循环直到失败,稍后会详细介绍。
是的,这很愚蠢。然而,它带来了一些非常重要的挑战。例如,这个挑战需要创建数百万条记录,所以我需要高效地完成这项工作。我已经:
- 尽可能增加批量大小。
- 尽可能限制添加的属性数量。
现在,我认为我要做的就是防止重复项返回到 Dynamics CRM 目标(当前为平面文件)。该程序第一次运行良好,但第二次运行导致此结果。我想删除所有具有 !IsNull(accountid) 或具有相同名称且具有 !IsNull(accountid) 的记录的记录。请参阅以下记录:
"accountnumber","name","ownerid","owneridtype","accountid","ErrorColumn","CrmErrorMessage"
"buubblee","A. Datum Corporation (sample)","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{3A32DC19-9456-E711-80E2-3863BB368DE0}","",""
"buubblee","A. Datum Corporation (sample)1","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{C3964ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)1","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)10","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{F3964ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)10","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)11","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)12","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)13","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)14","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)15","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)16","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)17","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)18","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)19","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)2","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{04974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)2","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)20","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)3","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{13974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)3","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)4","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{26974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)4","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)5","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{38974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)5","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)6","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{4C974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)6","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)7","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{57974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)7","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)8","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{62974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)8","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"buubblee","A. Datum Corporation (sample)9","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{72974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"buubblee","A. Datum Corporation (sample)9","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{2E32DC19-9456-E711-80E2-3863BB368DE0}","",""
"ABC28UU7","Adventure Works (sample)1","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{7D974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)1","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)10","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{92974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)10","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)11","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)12","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)13","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)14","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)15","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)16","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)17","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)18","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)19","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)2","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{9D974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)2","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)20","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)3","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{A3974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)3","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)4","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{AA974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)4","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)5","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{B1974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)5","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)6","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{B7974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)6","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)7","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{BE974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)7","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)8","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{C5974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)8","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"ABC28UU7","Adventure Works (sample)9","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","{CB974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"ABC28UU7","Adventure Works (sample)9","{31EAF056-9756-E711-80E1-3863BB35DE20}","systemuser","","",""
"","custom","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{61AD988F-7D5B-E711-80E4-ECB1D78B6B00}","",""
"","Test (sample)","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{81073B99-7D5B-E711-80E4-ECB1D78B6B00}","",""
"","Test (sample)1","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{D2974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)1","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)10","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{DA974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)10","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)11","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)12","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)13","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)14","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)15","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)16","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)17","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)18","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)19","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)2","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{E1974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)2","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)20","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)3","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{E8974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)3","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)4","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{EE974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)4","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)5","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{F4974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)5","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)6","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{FC974ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)6","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)7","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{03984ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)7","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)8","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{09984ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)8","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
"","Test (sample)9","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","{11984ECD-E05C-E711-80E5-ECB1D78B6B00}","",""
"","Test (sample)9","{FD1AEC8D-025A-45B8-9206-A200680865E4}","systemuser","","",""
完成后,我会将这个数据流放入一个For循环容器,设置EvalExpression为true,等待微软发送我一个停止和停止。 (实际结果可能不会那么壮观。)
我已经尝试按名称、帐户 ID 进行排序,反之亦然,然后再次按帐户 ID 排序并删除重复项,但 排序组件 并没有始终如一地删除我想要的重复项。我正在寻找替代方案。这是我尝试过的证据:
我很乐意为整个练习考虑不同的方法。总而言之,我想在不使用 Dynamics CRM 重复检测的情况下每天创建数百万个唯一命名的 sample Account 记录迭代。我也想用一个控制流来做到这一点。另一方面,我认为我需要只是多了一个脚本组件。
【问题讨论】:
-
Adding records to Dynamics CRM is very slow.欢迎使用 Dynamics CRM!无论您做什么,添加数百万行都可能需要几天时间。祝你好运!
标签: c# mysql csv ssis dynamics-crm