Jump to content

Save out field data to text file, and more!


Recommended Posts

I am doing an experiment (research) where I want to save some simulation data to disk so I can run it through a machine learning algorithm, but I am hoping I could get some guidance or suggestions as to how to approach this.

In the end, I want to save out training examples to disk which include:

  • Value at a cell and 6 neighboring cells from a scalar field at time step t  -- (pressure)
  • Value of the gradients/divergence between the center cell and the 6 neighboring cells from a vector field at time step t  -- (velocity)
  • Value of a cell from a scalar field at time step t + 1  -- (pressure)

In a previous project, I wrote a new SOP Operator in the hdk and used ofstream to write to disk, but it was painful and the lack of an IDE made it a slow to code. I am left wondering if there are functionalities of houdini that would make this task easier that I just don't know about. 

Basically, I want to do some simple math, save out scalar and vector field data as lines in a text file ("[a,b,c,d,e,f,g,h...]\n"), and also save cell data from the next timestep, all presumably in a SIM node attached to my Multisolver after the "gas project non divergent" node. (The data will then be loaded into a separate python program to train the Machine learner, but that's not important.)

Any, and I mean any, guidance or suggestions on how to best utilize houdini to get this data out would be much appreciated. Thanks

Link to comment
Share on other sites

i´m with szymon. using numpy might be a very good option especially sice you are using python anyways. put all values into an array and save it to disk as binary data. should be fairly fast and easy to read back into python for further processing.

 

6 hours ago, jopojelly said:

I am doing an experiment (research) where I want to save some simulation data to disk so I can run it through a machine learning algorithm

that sounds interesting! what are you using machine learning for? training samples for faster solve, building meta-models, setting up a rsm model, ...?

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...