[yt-users] Memory leaks and volume rendering

[Nathan Goldbaum]

Hi John,

The nuclear option is to call a separate python interpreter to evaluate the interior of your loop.  The OS generally does a much better job of cleaning up after python than the interpreter its self.  You can do this relatively straightforwardly via the subprocess module, passing parameters as command line arguments via the argparse module.

Also, is it possible that the file you are trying to volume render is too big?  Can you do one iteration of the loop for just that plotfile?

-Nathan

On Jan 29, 2012, at 6:55 AM, John ZuHone wrote:

> Hi guys,
> 
> Neither of these seemed to help (for which I am a little surprised), it ran out of memory at the same position as before. 
> 
> Best,
> 
> John
> 
> On Jan 29, 2012, at 2:13 AM, Sam Skillman wrote:
> 
>> Hi John,
>> 
>> Additionally, adding 'del cam, image' at the end of each loop should help considerably.  The camera object contains the homogenized volume roughly equal to the size of the entire dataset for one field, so I'm guessing that is where most of it is coming from.
>> 
>> Let us know if that doesn't help.
>> 
>> Sam
>> 
>> On Sat, Jan 28, 2012 at 7:31 PM, Nathan Goldbaum <goldbaum at ucolick.org> wrote:
>> Hi John,
>> 
>> I've found that calling the garbage collector via gc.collect() at the end of a loop over filenames fixes issues like this.  Probably worth a try, anyway.
>> 
>> -Nathan
>> 
>> On Jan 28, 2012, at 8:52 AM, John ZuHone wrote:
>> 
>> > Hi all,
>> >
>> > I'm volume rendering a ~1 GB dataset on an 8 CPU machine with 32 GB of RAM. I keep using up the memory on the machine with the following script, which creates a time series object and runs through the pfs to create each image. Is there other memory I should be freeing up at each iteration in the loop?
>> >
>> > http://paste.yt-project.org/show/2137/
>> >
>> > Best,
>> >
>> > John
>> > _______________________________________________
>> > yt-users mailing list
>> > yt-users at lists.spacepope.org
>> > http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>> >
>> > 
>> >
>> 
>> _______________________________________________
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>> 
>> _______________________________________________
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
> 
> !DSPAM:10175,4f255dfd1561963799029!
> _______________________________________________
> yt-users mailing list
> yt-users at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
> 
> 
> !DSPAM:10175,4f255dfd1561963799029!