Welcome to od|forum

Register now to gain access to all of our features. Once registered and logged in, you will be able to contribute to this site by submitting your own content or replying to existing content. You'll be able to customize your profile, receive reputation points as a reward for submitting content, while also communicating with other members via your own private inbox, plus much more! This message will be removed once you have signed in.

Sign in to follow this  
Followers 0
benderonline

Mantra Checkpoint Tiles

I have a long-ish PBR render (4-5hr frame) that ran to 66% with checkpoints enabled before timing out on the farm. I resubmitted the frame with checkpoints enabled and got the message:

>Resuming from checkpoint file: read 4040 tiles from /path/to/bla_sh004_lighting_v010_bty.1062.exr.mantra_checkpoint

(I presumed this meant a successful resume) I then watched as my new render started from exactly the same tile as the first render... it didn't seem to actually skip any part of the render. Is this expected behaviour? Am I misunderstanding checkpoints? I figured this should start back up SOMEWHERE near the percentage of completion I got up to previously, but it appears that's not the case...

edit: interesting observation is that looking at the images in Nuke, the same tiles (up to 66%) in the EXR are there - just a hunch that the new render is just rendering straight over the old tiles instead of recognising that they've, in fact, been completed. Is this possible?

 

Edited by benderonline
Updates

Share this post


Link to post
Share on other sites

The below looks like a clue, from the Houdini 15 release notes.   Checkpoint files are only used when resuming a render if you enable "Resume from checkpoint files" on the /out/<whatever> render node.   It looks like the parameter is named "vm_readcheckpoint".
 

Quote

By default Mantra now writes out "checkpoint" files containing the current render state at certain intervals. If the render fails because of a fixable problem such as out-of-memory, you can resume the render from the last checkpoint by turning on Resume from checkpoint files on the render node.

 

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0