[Yt-dev] Projection speed improvement patch

[Stephen Skory]

Matt,


> Hm, at the risk of replying to my own message, we might be able to do
> this by using a memmap onto the disk.  But then we'd be assuming
> homogenous clusters, which honestly, I think we should just go ahead
> and assume.  But I'd rather keep things off the disk if at all
> possible.  I suppose when we're dealing with arrays of this size,
> though, it does become a bit prohibitive...

Pardon my ignorance, but how is the Alltoallv used? In Parallel HOP, I communicate arrays that are large fractions of a GB in size with no problem using un-pickled methods. I looked and it appears that Alltoallv is a not pickling comm, is this correct?


_______________________________________________________
sskory at physics.ucsd.edu           o__  Stephen Skory
http://physics.ucsd.edu/~sskory/ _.>/ _Graduate Student
________________________________(_)_\(_)_______________