[yt-users] Change in parallel execution policy
Matthew Turk
matthewturk at gmail.com
Wed Nov 5 09:58:45 PST 2008
Hi guys,
I've changed the policy in trunk. After talking with Stephen Skory
about this, and going back and forth, it became obvious that the
original policy of running in parallel "whenever possible" via
autodiscovery of the mpi4py module & job size was not a viable option.
You now have to use the executable 'mpi4py' instead of the standard
'python' if you want to notify yt to run in parallel. (The executable
mpi4py is part of the mpi4py distribution, and is available by running
the 'install_exe' task on their setup.py.)
So, instead of:
mpirun -np 4 python2.5 some_script.py
you'd run:
mpirun -np 4 mpi4py some_script.py
By avoiding global variables, we are able to preserve the usage of
identical scripts in parallel and in serial. (From the yt
perspective.)
I'm still working on parallelizing other objects (slices & cutting
planes) besides projections, quantities & profiles; Stephen Skory has
begun work on parallelizing HOP, which would be a pretty awesome
addition. More updates as they come.
-Matt
More information about the yt-users
mailing list