Hi all,
I'm importing an employee transaction list with historical employment data using a direct connector to my HRIS. I’m creating a new unique ID property from Employee ID + Effective Date
.
I ran into the following challenge: my source data sometimes contains two events for the same employee on the same day (e.g., a hire and a no-show termination).
My question is: is there an automated method in Pigment to identify and remove all rows that share a non-unique key during an import? I want these conflicting pairs of rows to be excluded entirely and I need the monthly import from my HRIS to run automatically without failing.
Any ideas on how to set this up?
Thanks!