<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Nathan,<div> usings pmods in the import leads to an error explosion in the matplotlib imports. It's even worse than the original test.</div><div><br></div><div>Eric<br><div><div>On Sep 5, 2012, at 12:42 PM, Nathan Goldbaum wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Hi Eric,</div><div><br></div><div>Exactly right. This is a drop-in replacement for yt.mods on high-latency parallel filesystems (like Kraken, unfortunately).</div><div><br></div><div>There's some discussion on the dev mailing list: <a href="http://lists.spacepope.org/htdig.cgi/yt-dev-spacepope.org/2012-January/001760.html">http://lists.spacepope.org/htdig.cgi/yt-dev-spacepope.org/2012-January/001760.html</a></div><div><br></div><div>Unfortunately this isn't covered in the docs (except for a note in the changelog) but it should be in there.</div><div><br></div><div>Cheers,</div><div><br></div><div>Nathan</div><br><div><div>On Sep 5, 2012, at 9:40 AM, Eric Hallman wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Nathan,<div> I've been off yt for a while, I'm unaware of pmods. It's specific to parallel I'm guessing?</div><div><br></div><div>Eric<br><div><div>On Sep 5, 2012, at 12:38 PM, Nathan Goldbaum wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>Hi Eric,<br><br>Have you tried from yt.pmods import * instead of the normal yt.mods?<br><br>Cheers,<br><br>Nathan<br><br>On Sep 5, 2012, at 9:37 AM, Eric Hallman wrote:<br><br><blockquote type="cite">Hey everyone,<br></blockquote><blockquote type="cite"> so this issue seems like one I've had before, but I searched the lists and don't find this exact issue.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">On batch jobs on kraken, attempting to do halo finding, I get an almost immediate crash (with an eternal hang until the time limit is reached) due to matplotlib. I've been unable to reproduce it in the interactive queue on kraken, which is frustrating. I'm hoping someone has seen it and can comment.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">this is with yt/dev on kraken, and I set env variables to MPLCONFIGDIR like so:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">export MPLCONFIGDIR=${PBS_O_WORKDIR}/.matplotlib/<br></blockquote><blockquote type="cite">[ ! -d ${MPLCONFIGDIR} ] && mkdir ${MPLCONFIGDIR}<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">because if you don't, it fails immediately with perm issues.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Anyway, it's a simple script and call<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">aprun -n 12 python halo_finding.py --parallel<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">but the details of the script are not too important, since the job fails when yt is imported, as so: <br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Traceback (most recent call last):<br></blockquote><blockquote type="cite"> File "halo_finding.py", line 1, in <module><br></blockquote><blockquote type="cite"> from yt.mods import *<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/yt-2.4dev-py2.7-linux-x86_64.egg/yt/mods.py", line 115, in <module><br></blockquote><blockquote type="cite"> from yt.visualization.api import \<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/yt-2.4dev-py2.7-linux-x86_64.egg/yt/visualization/api.py", line 34, in <module><br></blockquote><blockquote type="cite"> from plot_collection import \<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/yt-2.4dev-py2.7-linux-x86_64.egg/yt/visualization/plot_collection.py", line 26, in <module><br></blockquote><blockquote type="cite"> from matplotlib import figure<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/matplotlib/figure.py", line 18, in <module><br></blockquote><blockquote type="cite"> from axes import Axes, SubplotBase, subplot_class_factory<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/matplotlib/axes.py", line 18, in <module><br></blockquote><blockquote type="cite"> import matplotlib.contour as mcontour<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/matplotlib/contour.py", line 21, in <module><br></blockquote><blockquote type="cite"> import matplotlib.texmanager as texmanager<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/matplotlib/texmanager.py", line 72, in <module><br></blockquote><blockquote type="cite"> class TexManager:<br></blockquote><blockquote type="cite"> File "/lustre/scratch/proj/sw/yt/dev/lib/python2.7/site-packages/matplotlib/texmanager.py", line 92, in TexManager<br></blockquote><blockquote type="cite"> os.mkdir(texcache)<br></blockquote><blockquote type="cite">OSError: [Errno 17] File exists: '/lustre/scratch/hallman/gigaCubes/run1024/.matplotlib/tex.cache'<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">In each case, I have deleted tex.cache before I restart, thinking an old version persisted there, but the same error happens. The most irritating thing is that the job does not kick out of the batch system, so the time continues to run on however many processors you have until the limit is reached (eternal hang!).<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I hope this is something obvious and I'm just dumb. Let me know.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Eric<br></blockquote><blockquote type="cite">-- <br></blockquote><blockquote type="cite">Eric Hallman<br></blockquote><blockquote type="cite">Tech-X Corporation <a href="mailto:hallman@txcorp.com">hallman@txcorp.com</a><br></blockquote><blockquote type="cite">5621 Arapahoe Ave, Suite A Phone: (720) 254-5833<br></blockquote><blockquote type="cite">Boulder, CO 80303 Fax: (303) 448-7756<br></blockquote><blockquote type="cite">--<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">_______________________________________________<br></blockquote><blockquote type="cite">yt-users mailing list<br></blockquote><blockquote type="cite"><a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br></blockquote><blockquote type="cite"><a href="http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org">http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org</a><br></blockquote><br>_______________________________________________<br>yt-users mailing list<br><a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br><a href="http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org">http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org</a><br></div></blockquote></div><br><div apple-content-edited="true">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>-- <br>Eric Hallman<br>Tech-X Corporation <a href="mailto:hallman@txcorp.com">hallman@txcorp.com</a><br>5621 Arapahoe Ave, Suite A Phone: (720) 254-5833<br>Boulder, CO 80303 Fax: (303) 448-7756<br>--</div><div><br></div></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br></div></div>_______________________________________________<br>yt-users mailing list<br><a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br><a href="http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org">http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org</a><br></blockquote></div><br></div>_______________________________________________<br>yt-users mailing list<br><a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br>http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org<br></blockquote></div><br><div apple-content-edited="true">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: medium; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>-- <br>Eric Hallman<br>Tech-X Corporation <a href="mailto:hallman@txcorp.com">hallman@txcorp.com</a><br>5621 Arapahoe Ave, Suite A Phone: (720) 254-5833<br>Boulder, CO 80303 Fax: (303) 448-7756<br>--</div><div><br></div></div></span><br class="Apple-interchange-newline"></span><br class="Apple-interchange-newline">
</div>
<br></div></body></html>