Pigment Champs! Could you please help me understand how Pigment is handling DevOps (Or is it still not available)? Is there any Best Practice document on Pigment (Like Planual in Anaplan)? I see many Pigment sponsored apps have hardcoding in the formula. For Example - As Per Pigment: 1+ INP_YearlySalaryIncrease[BY CONSTANT: Month.Year][FILTER: Month.'Month of Year'= 'Month of Year'."February" ][BY CONSTANT: EE_Data_Stand.Region] I want to write it this way - (1+'01. INP Yearly Salary Increase')[BY CONSTANT:Month.Year][FILTER: Month.'Month of Year'= '00. INP Month of Increase'][BY Constant: 'EE Data Stand'.Region], here the inputs can be changed easily and freely. How does Pigment’s engine perform calculations? How many cores does it leverage at the same time? Is there any recommendation about the source data, that it should have a unique key? I understand that transactional dimension does not need one but it means that you would have to delete and reload/refresh the entire transactional data set as and when there is a change in the existing row as there is no way Pigment can identify which row has been changed due to the change in the source data? Has anyone performed any testing on the load timings when the data is around 10 million records? Also is there any limit on the number of rows that can be added to dimensions? Thanks,Misbah

Hi Misbah !nice to have you here :)what do you mean by devops ?hard coding is a big no no and it is stated in our modeling palette, which I'llbe able to share promptly :)without going into details, it’s based on a cloud computing engine, not limited to a single machine, so it really depends how we scale itUNIQUE ID always. The fact that TL don’t need it is only a shortcut (very handy one)no problem to load huge data sets. I was just chatting about an SA on a project loaded files with 20m recordsfor dimensions themselves, no specific limits. however depending how you use them, you need to be considerate. we Have a customer running most of their calcs on a 1.3m items dimensions, it works. Some 200k+ is common

Queries related to Pigment

Pigment Champs!

Could you please help me understand how

Pigment is handling DevOps (Or is it still not available)?
Is there any Best Practice document on Pigment (Like Planual in Anaplan)? I see many Pigment sponsored apps have hardcoding in the formula. For Example - As Per Pigment:
1+ INP_YearlySalaryIncrease[BY CONSTANT: Month.Year][FILTER: Month.'Month of Year'= 'Month of Year'."February" ][BY CONSTANT: EE_Data_Stand.Region]
I want to write it this way - (1+'01. INP Yearly Salary Increase')[BY CONSTANT:Month.Year][FILTER: Month.'Month of Year'= '00. INP Month of Increase'][BY Constant: 'EE Data Stand'.Region], here the inputs can be changed easily and freely.
How does Pigment’s engine perform calculations? How many cores does it leverage at the same time?
Is there any recommendation about the source data, that it should have a unique key? I understand that transactional dimension does not need one but it means that you would have to delete and reload/refresh the entire transactional data set as and when there is a change in the existing row as there is no way Pigment can identify which row has been changed due to the change in the source data?
Has anyone performed any testing on the load timings when the data is around 10 million records? Also is there any limit on the number of rows that can be added to dimensions?

Thanks,

Misbah

Be the first to reply!

Hi Misbah !

nice to have you here :)

what do you mean by devops ?
hard coding is a big no no and it is stated in our modeling palette, which I'll be able to share promptly :)
without going into details, it’s based on a cloud computing engine, not limited to a single machine, so it really depends how we scale it
UNIQUE ID always. The fact that TL don’t need it is only a shortcut (very handy one)
no problem to load huge data sets. I was just chatting about an SA on a project loaded files with 20m records
for dimensions themselves, no specific limits. however depending how you use them, you need to be considerate. we Have a customer running most of their calcs on a 1.3m items dimensions, it works. Some 200k+ is common

@Nathan Thank You for your prompt response!

Dev/Test/Prod Environments → Does pigment have any thing on this ?
Awesome! Looking forward to seeing it

Hi @Misbah,

I think what you mean is more about Test and Deploy - and it’s still Under Development
Product Roadmap - Pigment

stay tuned, it will release very soon !

@Nathan

@Thu Mai

Thank You!

Hi @Misbah! Information on Test & Deploy is available here:

https://community.pigment.com/test-deploy-145

Hi @Misbah, we performed performance tests using a > 10 millions rows data (using a cloud file storage connection. It loads in 20'.

Pm me if you d like more insights

Ask your question here!

Not finding what you're looking for?

Sign up

Single Sign-On Need help?

Log into the Pigment Community

Single Sign-On Need help?

Scanning file for viruses.

This file cannot be downloaded