stddev_pop - unsupported aggregation function

[MiguelRosaTauroni]

Hi!

First of all, thank you for your work on this project — we’ve been following it for a while and have recently conducted several tests under different conditions. We're glad to report that most of our use cases have been successfully handled.

During our testing, we noticed that the stddev_pop aggregation function appears to be unimplemented and is currently marked as a #TODO in the SparkProcessingEngine.java file. It also seems that this function is not yet supported in the latest 1.9.0 release.

For context, we need stddev_pop for a statistical validation rule applied on large datasets during our Spark-based processing pipeline.

We would like to know if there are plans to support this function in a future release, or if its implementation has been postponed or discarded for any specific reason.

Thanks in advance, and keep up the great work!

[NicoLaval]

Hi @MiguelRosaTauroni,

Thank you for your interest in our work.
We would love to hear more about your use of Trevas.

You can already use stddev_pop as an Analytic (see here).

For Aggregations, we actually had an issue and it's disabled for now (see here). We'll add this to our roadmap and look into this again.

[MiguelRosaTauroni]

Hi @NicoLaval,

Thanks for your quick repl, it's great to hear that the function is included in the roadmap!

We’re part of the ECB task force evaluating Trevas behavior across different scenarios. Some of our colleagues have already been in contact with you over time, and I’ve seen that they’ve contributed to discussions and issues here as well. From my side, I’ll also be sharing some findings and opening relevant issues as we continue testing.

Thanks again for your support!