Jump to content

Diminishing returns from Compiled Blocks?

Recommended Posts


I've just got a question about compile blocks.

I'm working on a relatively simple process that I need to run on extremely heavy data sets (groom curves), and I've noticed something odd.

I need to do a check on each curve, and for reasons I need to do it on every curve in isolation so I'm putting my loop inside a compile block, If I loop over 100'000 curves and run this process then I get extremely fast results for the first 10'000 or so curves, however after about the halfway point I see my CPU usage drops right off and instead of seeing it calculate hundreds of curves per second it's down to 10-20 curves per second.

It calculates the first half of the data set in about 4 mins but takes 30 mins to do the second half!

At first I thought that this was due to the data set getting progressively heavier, however if that was true I would expect the CPU usage to remain high, despite the progress slowing down? I also had a go at randomising the sort order too, to see if that changed the result and it was the same.

So I guess my question is this:

What factors, apart from the size of the data-set could cause a compiled block process to slow down over time?

Any insights are very welcome!

Thanks in advance!


Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

  • Create New...