Wednesday 8 May 2013


This is the flow of transformations you need to follow,
Remove_duplicates
First you need to sort the data,for this use sorter.
In expression transformation you need to create following ports,
expression_condition
Here FIELD9 is the column name which contains product key for me.
for v_count you need to use following condition,
condition
The output from this expression will be in the form of,
Product, O_count
A, 1
B, 1
B, 2
B, 3
C, 1
C, 2
D, 1
Now use a router transformation using group condition as,
O_count=1.
Then all unique rows will go to one target and connect the default group to another table which will hold the duplicates.

1 comments: