[yt-users] MemoryError when using BinnedProfile1D

[Matthew Turk]

Hi Yuan,

On Thu, Jul 18, 2013 at 9:43 PM, Yuan Li <bear0980 at gmail.com> wrote:
> Hi yt users,
>
> I have been having trouble using BinnedProfile1D. I am using the same script
> that seemed to be working before. Now it is giving me "MemoryError":
> http://paste.yt-project.org/show/A67caGKsv6mFqA83MZoZ/
>
> I can still use it on a low resolution run without a problem.
>
>
> I am not sure why it needs so much memory (I am already asking for 30 gb of
> memory). If I do a similar analysis with plotcollection and
> add_profile_sphere for the same data, I do not need to ask for much memory
> at all. I thought BinnedProfile1D would need less memory than
> add_profile_sphere. Please let me know if I was wrong and the job simply
> requires a lot of memory.
>
> What I am trying to do is just very basic analysis:
> ...
> sp=pf.h.sphere([0.5, 0.5, 0.5], rmax/pf['kpc'])
> sp_in=sp.cut_region(["grid['Theta']>0.6"])
> prof=BinnedProfile1D(sp_in, 128, "Radiuskpc", 1e-2,rmax)
> r=prof["Radiuskpc"]
> prof.add_fields("Temperature",weight="CellMassMsun")

Hm, this looks okay to me.  The only two things that I think could be a problem:

 * Have you tried it on the sp object instead of sp_in?  It may be
that the cut_region is not operating in a memory conservative way.
 * Which version are you on?  (yt instinfo should tell you)  A month
or so ago we identified (thanks to Mike Kuhlen and Nathan Goldbaum) a
way to dramatically reduce memory used in radius fields.  That may be
relevant here.

-Matt

> ...
>
>
> It usually fails at the temperature part. Please let me know if you have any
> ideas or suggestions.
>
> Thank you!
> Yuan
>
> _______________________________________________
> yt-users mailing list
> yt-users at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>