[yt-users] yt on Blue Waters
Jonah Miller
jonah.maxwell.miller at gmail.com
Wed Apr 20 14:34:55 PDT 2016
Hi Brian, Matt,
Thanks a lot! These instructions are exactly what I was hoping for!
Regarding the all-in-one install script, that won't work if I want to
install a fork of yt though, will it? This is to test my carpet frontend
on some production data.
Best,
Jonah
On 16-04-20 05:24 PM, Matthew Turk wrote:
> I think it's a lot easier now that the new install script has been merged in:
>
> http://lists.spacepope.org/pipermail/yt-dev-spacepope.org/2016-April/006350.html
>
> -Matt
>
> On Wed, Apr 20, 2016 at 4:22 PM, Brian O'Shea <bwoshea at gmail.com> wrote:
>> Yes indeed. It's a gigantic pain. Here are instructions. Good luck!
>>
>> -----------------
>>
>> 0) Get the GNU software environment set up: “module swap PrgEnv-cray
>> PrgEnv-gnu” . This will be necessary later.
>>
>> 1) Install the Anaconda python distribution
>> (https://store.continuum.io/cshop/anaconda/) for 64-bit Linux systems.
>> Refresh your path so the Anaconda python’s in your path.
>>
>> 2) Download mpi4py from https://bitbucket.org/mpi4py/mpi4py/, or grab it
>> from my home directory on Blue Waters (~bwoshea/mpi4py-1.3.1.tar.gz).
>>
>> 3) Once you’ve unpacked it in your home directory, edit the file mpi.cfg,
>> which is in the top-level mpi4py directory, and add the following chunk of
>> text at the end of the file:
>>
>> [cray]
>> mpicc = cc
>> mpicxx = CC
>> extra_link_args = -shared
>>
>> then, in the top-level mpi4py directory, type:
>>
>> python setup.py build --mpi=cray
>> python setp.py install
>>
>> At this point, you should have a functional version of mpi4py that uses the
>> cray MPI libraries.
>>
>> 4) You can then install yt via source in your home directory:
>>
>> hg clone https://bitbucket.org/yt_analysis/yt
>> hg update yt
>> python setup.py develop
>>
>> And it should work, though you’re going to need to modify your
>> LD_LIBRARY_PATH to point to your anaconda /lib directory. You can verify
>> that yt and mpi4py are playing nicely together by running the scripts
>> hw_MPI.py and yt_parallel_test.py, both of which are sitting in my home
>> directory. (Note that you can do this via batch script or through the
>> interactive queue, both with aprun - you can’t just do it from the login
>> node.)
>>
>> 5) and, optionally, if you want to install Rockstar using yt from source,
>> you do the following:
>>
>> hg clone http://bitbucket.org/MatthewTurk/rockstar
>> cd rockstar
>> hg pull
>> hg up -C tip
>> make lib
>>
>> and *then* make a file called rockstar.cfg that has a single line of text:
>> the path of the rockstar source code directory. At that point, you need to
>> run “python setup.py develop” again, and yt will recognize that rockstar has
>> been installed and play nicely with it. You will likely also have to modify
>> your LD_LIBRARY_PATH to point at your rockstar directory so it can find the
>> rockstar library (librockstar.so).
>>
>>
>> On Wed, Apr 20, 2016 at 5:04 PM, Jonah Miller
>> <jonah.maxwell.miller at gmail.com> wrote:
>>> Hi yt users,
>>>
>>> Does anybody have experience installing the development version of yt on
>>> blue waters (as opposed to relying on the module pre-provided)? If so, do
>>> you have any tips or gotchas? I will be attempting an installation in the
>>> next few days and I'm sort of hoping it's a solved problem.
>>>
>>> Best,
>>> Jonah Miller
>>> _______________________________________________
>>> yt-users mailing list
>>> yt-users at lists.spacepope.org
>>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>
>>
>> _______________________________________________
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>
> _______________________________________________
> yt-users mailing list
> yt-users at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
More information about the yt-users
mailing list