[yt-users] yt/mpi4py on oak ridge cray machines

Britton Smith brittonsmith at gmail.com
Wed Aug 13 08:38:56 PDT 2014


* Blacklight


On Wed, Aug 13, 2014 at 4:37 PM, Matthew Turk <matthewturk at gmail.com> wrote:

> On Wed, Aug 13, 2014 at 10:29 AM, Michael Zingale
> <michael.zingale at stonybrook.edu> wrote:
> > Matt, now that 3.0 is out, perhaps it's time to start contacting the
> various
> > centers and push for a central install of yt?
> >
>
> Yes, absolutely.  We may need to put out a minor bugfix release in a
> few weeks, but I don't see any reason we can't start the ball rolling
> now.  Perhaps:
>
>  * Blue Waters (I'll take this one)
>  * Stampede
>  * Titan
>  * Nautilus
>  * Gordon
>  * NERSC
>
> Any others?
>
> As a bit of additional info, one side effect of the PNaCl porting is
> that we now have a repeatable static build of python.  At big
> supercomputer centers with parallel file systems, the time to import a
> parallel python job tends to be dominated by the cost of the calls to
> the metadata nodes, searching for .py files.  With the PNaCl build,
> Mike, Sam and I managed to get a zipimporter working that will import
> any python files from a single central file (i.e., same amount of
> data, vastly fewer calls to the MDS) and use the built-in static
> libraries.  Right now I'm stuck on the fact that the glibc on Titan is
> a billion years old, but my semi-optimistic hope is that eventually
> we'll have a single binary loader with no external dependencies that
> requires only a handful of files to import.
>
> -Matt
>
> >
> > On Wed, Aug 13, 2014 at 11:21 AM, Matthew Turk <matthewturk at gmail.com>
> > wrote:
> >>
> >> Hi David,
> >>
> >> I've recently been using Titan and have found it more efficient to
> >> build my own mpi4py and python, with the install script.
> >>
> >> -Matt
> >>
> >> On Wed, Aug 13, 2014 at 9:16 AM, David Sullivan <
> D.Sullivan at sussex.ac.uk>
> >> wrote:
> >> > Hi all,
> >> >
> >> > I’ve been trying to build yt and mpi4py on the cray machines at oak
> >> > ridge
> >> > and came across this old thread in the mailing list:
> >> >
> >> >
> http://lists.spacepope.org/pipermail/yt-users-spacepope.org/2013-December/019903.html
> >> >
> >> > I was just wondering if anyone had managed this since? If so, what the
> >> > best
> >> > approach is (system python or install script)?
> >> >
> >> > Many thanks,
> >> > David
> >> >
> >> > _______________________________________________
> >> > yt-users mailing list
> >> > yt-users at lists.spacepope.org
> >> > http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
> >> >
> >> _______________________________________________
> >> yt-users mailing list
> >> yt-users at lists.spacepope.org
> >> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
> >
> >
> >
> >
> > --
> > Michael Zingale
> > Associate Professor
> >
> > Dept. of Physics & Astronomy • Stony Brook University • Stony Brook, NY
> > 11794-3800
> > phone:  631-632-8225
> > e-mail: Michael.Zingale at stonybrook.edu
> > web: http://www.astro.sunysb.edu/mzingale
> >
> > _______________________________________________
> > yt-users mailing list
> > yt-users at lists.spacepope.org
> > http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
> >
> _______________________________________________
> yt-users mailing list
> yt-users at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.spacepope.org/pipermail/yt-users-spacepope.org/attachments/20140813/9da9c5e2/attachment.htm>


More information about the yt-users mailing list