[Yt-dev] Projection speed improvement patch
stephenskory at yahoo.com
Sun Nov 8 15:27:29 PST 2009
> Hm, at the risk of replying to my own message, we might be able to do
> this by using a memmap onto the disk. But then we'd be assuming
> homogenous clusters, which honestly, I think we should just go ahead
> and assume. But I'd rather keep things off the disk if at all
> possible. I suppose when we're dealing with arrays of this size,
> though, it does become a bit prohibitive...
Pardon my ignorance, but how is the Alltoallv used? In Parallel HOP, I communicate arrays that are large fractions of a GB in size with no problem using un-pickled methods. I looked and it appears that Alltoallv is a not pickling comm, is this correct?
sskory at physics.ucsd.edu o__ Stephen Skory
http://physics.ucsd.edu/~sskory/ _.>/ _Graduate Student
More information about the yt-dev