[yt-dev] Fwd: [mpi4py] Fwd: [Numpy-discussion] Improving Python+MPI import performance

[Stephen Skory]

Hi Britton & Matt,

> I just tested this new import method with Matt's fix on Kraken against the
> standard import for a variety of core counts.  In the attached figure, I
> plot the mean time to import, with errorbars showing the minimum and maximum
> time for all cores.  I think the plot speaks for itself.

I just tried on Janus, and while the new import is faster, it's not
quite as impressive as what Britton sees, it's definitely not slower.
At 1024 threads it went from 18 sec to 16. But clearly that disk is
much nicer to work with than Kraken's lustre. So, I figure we should
use this!

-- 
Stephen Skory
s at skory.us
http://stephenskory.com/
510.621.3687 (google voice)