[yt-users] annotate_contour takes much longer time to run than expected on some machines

Cameron Hummels chummels at gmail.com
Mon Aug 10 15:33:56 PDT 2015


I recently ran into some major slowdowns in going from yt version 3.1 to
3.2 on certain machines, although it wasn't related to my calling the
annotate_contour callback.  When I tracked it down with pdb, the slowdown
was in indexing certain arrays, so maybe there is a similar issue you're
encountering.  I'm going to track down the changeset that this is tied to
this week, and I'll let you know what I find.

Cameron

On Mon, Aug 10, 2015 at 3:15 PM, Nathan Goldbaum <nathan12343 at gmail.com>
wrote:

> Hey Bili,
>
> Just a shot in the dark, but do you have different matplotlib versions
> installed on your machine and server at UCSD? The contour callback is using
> some internal machinery in matplotlib that changed relatively recently.
>
> It might also be worthwhile to run your script under cProfile so we get an
> idea of which function exactly is taking so long. Even better if you can
> run *that* function under the line_profiler.
>
> -Nathan
>
> On Mon, Aug 10, 2015 at 5:10 PM, Bili Dong <qobilidop at gmail.com> wrote:
>
>> Hi yt-users,
>>
>> I’m using yt-3.2 (Changeset = 329b5039b031 stable).
>>
>> The problem is that the same script that could finish in seconds on my
>> local machine will take much  (order of magnitude) longer time to run on
>> the server I’m using. In some cases, it get stuck for hours that I don’t
>> know if it will ever finish. I’ve tracked down the bottleneck to be the
>> `annotate_contour` method. The server should be faster than my local
>> machine. (I’m not exactly sure about how to compare it. But the server is
>> generally much faster in other situations.)
>>
>> For example, for this script (http://paste.yt-project.org/show/5808/),
>> on my local machine the output shows:
>>
>> ```
>> yt : [INFO     ] 2015-08-10 *14:48:15*,401 Making a fixed resolution
>> buffer of (('gas', 'density')) 800 by 800
>> yt : [INFO     ] 2015-08-10 *14:48:15*,751 Saving plot
>> snapshot_200_Projection_z_density.png
>> yt : [INFO     ] 2015-08-10 *14:48:16*,716 Saving plot
>> snapshot_200_Projection_z_density.png
>> ```
>>
>> However, on the server the output shows:
>> ```
>> yt : [INFO     ] 2015-08-10 *14:51:25*,551 Making a fixed resolution
>> buffer of (('gas', 'density')) 800 by 800
>> yt : [INFO     ] 2015-08-10 *14:51:25*,917 Saving plot
>> snapshot_200_Projection_z_density.png
>> yt : [INFO     ] 2015-08-10 *14:56:21*,922 Saving plot
>> snapshot_200_Projection_z_density.png
>> ```
>>
>> That’s *296* times slower!!!
>>
>> This is likely to be a very specific problem with the server. But I’d
>> like to know if anyone else has encountered similar problems before so I
>> can learn from your experience. For now, I have no idea what could have
>> gone wrong.
>>
>> BTW, I’m using TSCC (http://idi.ucsd.edu/computing/) at UC San Diego, if
>> you happen to know it.
>>
>> Thanks,
>> Bili
>>
>> _______________________________________________
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>
>>
>
> _______________________________________________
> yt-users mailing list
> yt-users at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>
>


-- 
Cameron Hummels
NSF Postdoctoral Fellow
Department of Astronomy
California Institute of Technology
http://chummels.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.spacepope.org/pipermail/yt-users-spacepope.org/attachments/20150810/13ebf8a2/attachment.html>


More information about the yt-users mailing list