How to scale past 25k rows when you need to leverage calculations?

Hey everyone,

I’m looking for a solution to help scale my app more efficiently. Our tool allows users to define criteria and scorecards, and then score a population based on how well they match those scorecards.

The challenge we’re facing is that the scoring uses complex criteria in JavaScript fields, which also require sorting. For example, if we score 10,000 rows of data, we display them in rank order using a list component.

However, big tables aren’t a viable solution because they don’t allow sorting on calculated fields.

We considered creating a dynamic helper table to handle these calculations, pulling the relevant subset of data from a big table and calculating scores in the helper table for better performance. But the problem is, multiple relations to big tables don’t exist, so we can’t pull a subset from a big table for these calculations.

Any ideas or suggestions on how we can scale our app beyond the 25k row limit given the above criteria?

Thanks!