Skip to main content
Question

Impact of CSV Uploads on Historical Data in Pigment

  • January 2, 2025
  • 1 reply
  • 80 views

Forum|alt.badge.img+1

Hi,


We have a data table on Pigment that we update daily with new data by uploading a CSV file.
The CSV contains data from January 1, 2021, and every day the new daily data is added to the file before being uploaded to Pigment.

I wanted to know if CSV uploads delete the old data and then completely update everything, or if they only push the new data.
For example: If tomorrow the file no longer contains data starting from January 1, 2021, but instead starts from January 1, 2022, will we still retain the 2021 data in our source list in Pigment when I upload this new file, or will it be deleted?

If the historical data is deleted, is there a way to push the new data every day without deleting the old one?

Thanks in advance!

1 reply

Keiran
Employee
Forum|alt.badge.img+11
  • Employee
  • 68 replies
  • January 2, 2025

Hi Maxence,

Assuming you’re using a transaction list, it’s up to you if you want to it to behave this way, there’s an option for clearing items prior to importing, which would change this behaviour.

If this is not enabled, any new lines will just be added, and existing ones updated assuming you have a Unique Property.

Hope this helps!