while creating a data flow,we need one more operation as a part of data cleaning and that is remove duplicates for a specified column
Love this idea. I voted for it
Thank you for the idea @aditya.k.pinjala-Oracle I think this would be an excellent improvement for data flows- I do have this as an item in the backlog.
Not sure I understand. What is the input and outcome, and how is it different from aggregate? Can you share an example?
This old blog might help. Have not tried it in a while and might depend on your data but I had used this in the past. https://medium.com/@mmilella/remove-duplicates-in-a-data-set-d7820173d03a
