[yt-dev] Parallelization & the ART frontend

Christopher Moody cemoody at ucsc.edu
Tue Feb 7 18:30:44 PST 2012


Hi guys,

I've been working hard on the ART frontend. Lately, I'm to the point where
I'm playing around with more complex datasets that are taking much longer
to project - so I'd really like to to start using the parallelization
engines. I've tried Sam's workshop parallelization demos, and they all
work. But launching with the ART frontend (
http://paste.yt-project.org/show/2152/) spawns many independent processes
which evidently are not actually splitting the projection job, but still
taking up lots of processors.

My mpi installation  works:
yt : [INFO     ] 2012-02-07 18:12:28,207 Global parallel computation
enabled: 0 / 8yt : [INFO     ] 2012-02-07 18:12:28,207 Global parallel
computation enabled: 2 / 8
yt : [INFO     ] 2012-02-07 18:12:28,208 Global parallel computation
enabled: 1 / 8
yt : [INFO     ] 2012-02-07 18:12:28,208 Global parallel computation
enabled: 6 / 8
yt : [INFO     ] 2012-02-07 18:12:28,208 Global parallel computation
enabled: 3 / 8
yt : [INFO     ] 2012-02-07 18:12:28,208 Global parallel computation
enabled: 4 / 8
yt : [INFO     ] 2012-02-07 18:12:28,208 Global parallel computation
enabled: 5 / 8yt : [INFO     ] 2012-02-07 18:12:28,209 Global parallel
computation enabled: 7 / 8

But the script is just run 8 times, not any faster.

What am I missing here?

Many thanks!
chris
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.spacepope.org/pipermail/yt-dev-spacepope.org/attachments/20120207/3db3a633/attachment.htm>


More information about the yt-dev mailing list