[yt-users] yt on kraken

Cameron Hummels chummels at astro.columbia.edu
Wed Feb 22 16:23:50 PST 2012


Nathan, I was using Kraken this afternoon as well, and it was one of the
longest waits I've had in terms of system delays.  So it wasn't just
you--we were all suffering from it. 

On 02/22/2012 06:38 PM, David Collins wrote:
>> I ended up starting an interactive job on a compute node.  The import still
>> took about 10 minutes.  It finally did finish importing though.
> It doesn't surprise me that it still took that long even on an
> interactive node.  The problem isn't the node but the disk, and 100%
> of the disks on Kraken are 100% terrible and getting worse.
>
> I almost always shuffle my stuff to Nautilus, if you have an account
> there.  Using hpss and/or htar to transfer files between the two is
> really fast (limited only by Kraken's disk) you can get dozens of Gb
> in minutes.  (If they're small sets, you can use the home disk to
> transfer.)
>
>
>> Nathan Goldbaum
>> Graduate Student
>> Astronomy & Astrophysics, UCSC
>> goldbaum at ucolick.org
>> http://www.ucolick.org/~goldbaum
>>
>> On Feb 22, 2012, at 2:45 PM, Geoffrey So wrote:
>>
>> I would recommend if possible getting an interactive node to try yt on.
>>  I've seen many users abuse the login node of Kraken, running multiple jobs,
>> and sometimes it's multiple users at the same time that slows the node down.
>>  Have you tried another login node of Kraken, since there's 11 to choose
>> from.
>>
>> If I do >top and see many jobs running I usually just switch,
>>
>> ssh -Y krakenpf1
>>
>> you can do this all the way to krakenpf11
>>
>> From
>> G.S.
>>
>> On Wed, Feb 22, 2012 at 2:35 PM, Britton Smith <brittonsmith at gmail.com>
>> wrote:
>>> Hi Nathan,
>>>
>>> That's on the high side a little, but, sadly, not the maximum I've ever
>>> waited.
>>>
>>> Britton
>>>
>>>
>>> On Wed, Feb 22, 2012 at 5:33 PM, Nathan Goldbaum <goldbaum at ucolick.org>
>>> wrote:
>>>> Hi Britton,
>>>>
>>>> Thanks for the suggestion.  I've been waiting for more than 10 minutes
>>>> now and it still hasn't finished the import - does that seem excessive?
>>>>
>>>> Nathan Goldbaum
>>>> Graduate Student
>>>> Astronomy & Astrophysics, UCSC
>>>> goldbaum at ucolick.org
>>>> http://www.ucolick.org/~goldbaum
>>>>
>>>> On Feb 22, 2012, at 2:19 PM, Britton Smith wrote:
>>>>
>>>> Hi Nathan,
>>>>
>>>> It's most likely not hanging, but working on the import.  The filesystem
>>>> on Kraken can be incredibly slow at times.  If you're only waiting a minute
>>>> or so, you will probably need to give it a bit longer.
>>>>
>>>> Britton
>>>>
>>>> On Wed, Feb 22, 2012 at 5:15 PM, Nathan Goldbaum <goldbaum at ucolick.org>
>>>> wrote:
>>>>> Hi all,
>>>>>
>>>>> I'm trying to run yt on a login node on kraken.  All I'm doing is
>>>>> invoking python from the command line and importing yt.  However, python
>>>>> hangs on 'from yt.mods import *'.
>>>>>
>>>>> The python interpreter also takes a very long time (~ a minute or so) to
>>>>> start from the command line.
>>>>>
>>>>> This happens using both the yt/dev and yt/2.3 module.
>>>>>
>>>>> Anyone have any ideas?
>>>>>
>>>>> Nathan Goldbaum
>>>>> Graduate Student
>>>>> Astronomy & Astrophysics, UCSC
>>>>> goldbaum at ucolick.org
>>>>> http://www.ucolick.org/~goldbaum
>>>>>
>>>>> _______________________________________________
>>>>> yt-users mailing list
>>>>> yt-users at lists.spacepope.org
>>>>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>>>
>>>> _______________________________________________
>>>>
>>>> yt-users mailing list
>>>> yt-users at lists.spacepope.org
>>>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>>>
>>>>
>>>> !DSPAM:10175,4f456a0711289135847791!
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> yt-users mailing list
>>>> yt-users at lists.spacepope.org
>>>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>>>
>>>
>>> _______________________________________________
>>> yt-users mailing list
>>> yt-users at lists.spacepope.org
>>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>>
>> !DSPAM:10175,4f456ff71280950242198!
>> _______________________________________________
>>
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>
>>
>> !DSPAM:10175,4f456ff71280950242198!
>>
>>
>>
>> _______________________________________________
>> yt-users mailing list
>> yt-users at lists.spacepope.org
>> http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org
>>
>
>

-- 
Cameron Hummels
PhD Candidate, Astronomy Department of Columbia University
Public Outreach Director, Astronomy Department of Columbia University
NASA IYA New York State Student Ambassador
http://outreach.astro.columbia.edu 
PGP: 0x06F886E3




More information about the yt-users mailing list