Hi Matt,<div><br></div><div>I've got the log output here:<a href="http://paste.yt-project.org/show/2153/">http://paste.yt-project.org/show/2153/</a> with the serial version here <a href="http://paste.yt-project.org/show/2154/">http://paste.yt-project.org/show/2154/</a> . </div>
<div><br></div><div>The most interesting tidbit is below, where it looks like core 0 projects Levels 0-5 and core 1 projects Level 6 (which takes up like 99% of the projection time.)</div><div><br></div><div>chris</div><div>
<br></div><div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,403 Going to obtain []</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,406 Preloading ['density'] from 0 grids</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,406 End of projecting level level 0, memory usage 3.545e-01</div>
<div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,406 Preloading ['density'] from 0 grids</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,406 End of projecting level level 1, memory usage 3.545e-01</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,407 Preloading ['density'] from 0 grids</div>
<div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,407 End of projecting level level 2, memory usage 3.545e-01</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,408 Preloading ['density'] from 0 grids</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,408 End of projecting level level 3, memory usage 3.545e-01</div>
<div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,408 Preloading ['density'] from 0 grids</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,408 End of projecting level level 4, memory usage 3.545e-01</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,409 Preloading ['density'] from 0 grids</div>
<div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,409 End of projecting level level 5, memory usage 3.545e-01</div><div>P001 yt : [DEBUG ] 2012-02-08 11:39:53,409 Preloading ['density'] from 6 grids</div><div>P001 yt : [INFO ] 2012-02-08 11:39:53,410 Starting 'Projecting level 6 / 6 '</div>
<div>P000 yt : [INFO ] 2012-02-08 11:39:54,057 Finishing 'Projecting level 0 / 6 '</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,057 End of projecting level level 0, memory usage 4.482e-01</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,057 Preloading ['density'] from 1 grids</div>
<div>P000 yt : [INFO ] 2012-02-08 11:39:54,058 Starting 'Projecting level 1 / 6 'P000 yt : [INFO ] 2012-02-08 11:39:54,070 Finishing 'Projecting level 1 / 6 '</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,070 End of projecting level level 1, memory usage 4.482e-01</div>
<div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,070 Preloading ['density'] from 1 gridsP000 yt : [INFO ] 2012-02-08 11:39:54,071 Starting 'Projecting level 2 / 6 '</div><div>P000 yt : [INFO ] 2012-02-08 11:39:54,130 Finishing 'Projecting level 2 / 6 '</div>
<div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,130 End of projecting level level 2, memory usage 4.482e-01</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,130 Preloading ['density'] from 1 grids</div><div>P000 yt : [INFO ] 2012-02-08 11:39:54,131 Starting 'Projecting level 3 / 6 '</div>
<div>P000 yt : [INFO ] 2012-02-08 11:39:54,783 Finishing 'Projecting level 3 / 6 '</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,784 End of projecting level level 3, memory usage 4.482e-01</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:54,784 Preloading ['density'] from 1 grids</div>
<div>P000 yt : [INFO ] 2012-02-08 11:39:54,784 Starting 'Projecting level 4 / 6 '</div><div>P000 yt : [INFO ] 2012-02-08 11:39:59,389 Finishing 'Projecting level 4 / 6 '</div><div>P000 yt : [DEBUG ] 2012-02-08 11:39:59,389 End of projecting level level 4, memory usage 5.918e-01</div>
<div>P000 yt : [DEBUG ] 2012-02-08 11:39:59,389 Preloading ['density'] from 1 grids</div><div>P000 yt : [INFO ] 2012-02-08 11:39:59,389 Starting 'Projecting level 5 / 6 '</div><div>P000 yt : [INFO ] 2012-02-08 11:40:17,735 Finishing 'Projecting level 5 / 6 '</div>
<div>P000 yt : [DEBUG ] 2012-02-08 11:40:17,735 End of projecting level level 5, memory usage 1.569e+00</div><div>P000 yt : [DEBUG ] 2012-02-08 11:40:17,735 Preloading ['density'] from 0 grids</div><div>P000 yt : [DEBUG ] 2012-02-08 11:40:17,736 End of projecting level level 6, memory usage 1.569e+00</div>
<div>P001 yt : [INFO ] 2012-02-08 11:41:31,681 Finishing 'Projecting level 6 / 6 '</div><div>P001 yt : [DEBUG ] 2012-02-08 11:41:31,681 End of projecting level level 6, memory usage 2.113e+00</div><div>P000 yt : [DEBUG ] 2012-02-08 11:41:33,807 Opening MPI Barrier on 0</div>
<div>P000 yt : [INFO ] 2012-02-08 11:41:34,502 Projection completed</div><div>P001 yt : [DEBUG ] 2012-02-08 11:41:34,502 Opening MPI Barrier on 1</div><div>P001 yt : [INFO ] 2012-02-08 11:41:34,502 Projection completed</div>
<div>P001 yt : [DEBUG ] 2012-02-08 11:41:34,579 Opening MPI Barrier on 1</div></div><div><br></div><div><br></div><div><br><br><div class="gmail_quote">On Wed, Feb 8, 2012 at 6:46 AM, Matthew Turk <span dir="ltr"><<a href="mailto:matthewturk@gmail.com">matthewturk@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Chris,<br>
<div class="im"><br>
On Tue, Feb 7, 2012 at 9:30 PM, Christopher Moody <<a href="mailto:cemoody@ucsc.edu">cemoody@ucsc.edu</a>> wrote:<br>
> Hi guys,<br>
><br>
> I've been working hard on the ART frontend. Lately, I'm to the point where<br>
> I'm playing around with more complex datasets that are taking much longer to<br>
> project - so I'd really like to to start using the parallelization engines.<br>
> I've tried Sam's workshop parallelization demos, and they all work. But<br>
> launching with the ART frontend (<a href="http://paste.yt-project.org/show/2152/" target="_blank">http://paste.yt-project.org/show/2152/</a>)<br>
> spawns many independent processes which evidently are not actually splitting<br>
> the projection job, but still taking up lots of processors.<br>
<br>
</div>My guess is that parallelism is not enabled for the ART frontend<br>
simply as a matter of how the IO is conducted. To make it really work<br>
in parallel, the IO needs to be split up so that when process 1 reads<br>
a given grid patch, the rest of the processors don't also need to read<br>
all the data for that grid patch.<br>
<br>
Can you lower your loglevel (by setting loglevel = 1 in ~/.yt/config<br>
or by --config yt.loglevel=1 on the command line) and report back with<br>
what it says during a projection job there?<br>
<br>
-MAtt<br>
<div class="im"><br>
><br>
> My mpi installation works:<br>
> yt : [INFO ] 2012-02-07 18:12:28,207 Global parallel computation<br>
> enabled: 0 / 8yt : [INFO ] 2012-02-07 18:12:28,207 Global parallel<br>
> computation enabled: 2 / 8<br>
> yt : [INFO ] 2012-02-07 18:12:28,208 Global parallel computation<br>
> enabled: 1 / 8<br>
> yt : [INFO ] 2012-02-07 18:12:28,208 Global parallel computation<br>
> enabled: 6 / 8<br>
> yt : [INFO ] 2012-02-07 18:12:28,208 Global parallel computation<br>
> enabled: 3 / 8<br>
> yt : [INFO ] 2012-02-07 18:12:28,208 Global parallel computation<br>
> enabled: 4 / 8<br>
> yt : [INFO ] 2012-02-07 18:12:28,208 Global parallel computation<br>
> enabled: 5 / 8yt : [INFO ] 2012-02-07 18:12:28,209 Global parallel<br>
> computation enabled: 7 / 8<br>
><br>
> But the script is just run 8 times, not any faster.<br>
><br>
> What am I missing here?<br>
><br>
> Many thanks!<br>
> chris<br>
><br>
</div>> _______________________________________________<br>
> yt-dev mailing list<br>
> <a href="mailto:yt-dev@lists.spacepope.org">yt-dev@lists.spacepope.org</a><br>
> <a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
><br>
_______________________________________________<br>
yt-dev mailing list<br>
<a href="mailto:yt-dev@lists.spacepope.org">yt-dev@lists.spacepope.org</a><br>
<a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
</blockquote></div><br></div>