[yt-dev] profiles on non-prgio sets

[david collins]

> 64 cores, using 12GB on each?  That's a problem.  MassFraction it

12Gb total, but still...  I'll grab some more failure info and get
back to you.  In serial it ran fine, and took about 1 hour for both
[density,cellmass] and [density,cellvolume] within the default
head-node allowance on nautilus, which is 12Gb.  Timing wise longer
than I want to deal with, but it does run.

d.

> sounds like has a handful of dependencies -- CellMassMsun, which
> depends on Density and dx, but dx should be used as a single value not
> as a field.  So that gives 3*512^3*64 bits = 3 gigabytes, but that's a
> far cry from 12 gb/core.  Plus, the domain decomp for profiles is
> per-grid -- so only one of your cores should get assigned the root
> grid.  This is very bizarre.
>
>>
>> Would lazy_reader off change things?
>
> Yes, but it would make them worse.  :)
>
> -Matt
>
>>
>> Thanks,
>> d.
>>
>>> Are you running in parallel? Which fields are you profiling? Do they have
>>> lots of dependencies, or require ghost zones? Is yt using lazy_reader? Does
>>> your data have many grids?
>>
>>
>>>
>>> Matt
>>>
>>> On Mar 14, 2012 12:37 AM, "david collins" <antpuncher at gmail.com> wrote:
>>>>
>>>> I should add that this was done on 64 cores-- in serial it works fine,
>>>> just slow.
>>>>
>>>> On Tue, Mar 13, 2012 at 9:35 PM, david collins <antpuncher at gmail.com>
>>>> wrote:
>>>> > Hi, all--
>>>> >
>>>> > I have an old dataset that I'm trying to make profiles on.  It's a
>>>> > 512^3 root grid, but was written with ParallelRootGridIO off.  I find
>>>> > that it's using strange amounts of memory, more than 12 Gb.  Is this a
>>>> > known problem with a straight forward work-around?
>>>> >
>>>> > d.
>>>> >
>>>> > --
>>>> > Sent from my computer.
>>>>
>>>>
>>>>
>>>> --
>>>> Sent from my computer.
>>>> _______________________________________________
>>>> yt-dev mailing list
>>>> yt-dev at lists.spacepope.org
>>>> http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org
>>>
>>>
>>> _______________________________________________
>>> yt-dev mailing list
>>> yt-dev at lists.spacepope.org
>>> http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org
>>>
>>
>>
>>
>> --
>> Sent from my computer.
>> _______________________________________________
>> yt-dev mailing list
>> yt-dev at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org
> _______________________________________________
> yt-dev mailing list
> yt-dev at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org



-- 
Sent from my computer.