[yt-users] h5py Issues

[Matthew Turk]

Hi Brian,

It might have too many groups -- I'm not sure.  How big is pretty big,
also?  >2 gigs?  >4 gigs?

I'd suggest moving it out of the way for now and continuing on.
Stephen, if you're listening, is it possible that the .yt file has had
a ridiculous number of HDF5 groups made, which is confusing and
overflowing h5py?

-Matt

On Fri, Jul 23, 2010 at 11:15 AM, Brian Crosby <crosby.bd at gmail.com> wrote:
> Matt,
>
> The sim is a 1024^3 box.  They .yt file is pretty big, as it was created earlier during a halo finding and merger tree building job, but it's only creating 18 projections per dump.  This error came about before even the first projection was created and saved, so there are none in there.
>
> Thanks,
> Brian
>
>
> On Jul 23, 2010, at 2:08 PM, Matthew Turk wrote:
>
>> Hi Brian,
>>
>> Can you tell us a little bit about the .yt file (or whichever file
>> it's saving to)?  Is it humongous, or does it have a ridiculous number
>> of objects in it already?  How many projections have you saved to it?
>> How big is the sim?
>>
>> -Matt
>>
>> On Fri, Jul 23, 2010 at 11:04 AM, Brian Crosby <crosby.bd at gmail.com> wrote:
>>> In attempting to make a series of projections with halos plotted using the
>>> public install of yt on Kraken, I've encountered an odd problem.  The job
>>> terminates without giving an apparent error statement in the output files,
>>> but rather ends with this cryptic (at least to me) mess:
>>> h5py._stub.IOError  File "h5g.pyx", line 104, in h5py.h5g.GroupIter.__init__
>>> (h5py/h5g.c:1248)
>>>   File "h5g.pyx", line 104, in h5py.h5g.GroupIter.__init__ (h5py/h5g.c:1248)
>>> : Addr overflow (Invalid arguments to routine: Address overflowed)
>>> h5py._stub.IOError: Addr overflow (Invalid arguments to routine: Address
>>> overflowed)
>>>     return func(*args, **kwds)
>>>   File "h5g.pyx", line 317, in h5py.h5g.GroupID.get_num_objs
>>> (h5py/h5g.c:2482)
>>>     return func(*args, **kwds)
>>>   File "h5g.pyx", line 317, in h5py.h5g.GroupID.get_num_objs
>>> (h5py/h5g.c:2482)
>>>     return func(*args, **kwds)
>>>   File "h5g.pyx", line 317, in h5py.h5g.GroupID.get_num_objs
>>> (h5py/h5g.c:2482)
>>>     return func(*args, **kwds)
>>>   File "h5g.pyx", line 317, in h5py.h5g.GroupID.get_num_objs
>>> (h5py/h5g.c:2482)
>>>   File
>>> "/lustre/scratch/proj/yt_common/trunk/lib/python2.6/site-packages/h5py-1.2.1-py2.6-linux-x86_64.egg/h5py/_sync.py",
>>> line 88, in wrap
>>> Does anyone have an idea what could be causing this problem?
>>> Thanks,
>>> Brian
>>> _______________________________________________
>>> yt-users mailing list
>>> yt-users at lists.spacepope.org
>>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>>
>>>
>> _______________________________________________
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>
> _______________________________________________
> yt-users mailing list
> yt-users at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>