Hi everyone,<div>As Matt said, I'm still traveling and won't be able to look at this until at least September 9. The issues you brought up are worrisome, and I'm sorry to leave this in an unfinished state! At any rate, I'll look at this when I'm back.<span></span></div>
<div><br></div><div>chris<br><div><br><br>On Tuesday, September 4, 2012, Matthew Turk wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hello Stephen,<br>
<br>
* Stephen Skory <<a href="javascript:;" onclick="_e(event, 'cvml', 's@skory.us')">s@skory.us</a>> [120903 15:28]:<br>
> Hi all (especially Chris & Matt),<br>
><br>
> this morning I've spent some time trying to get rockstar to work for<br>
> me, and I've made some progress, I think, but I'm getting answers I<br>
> don't trust, and a crash, besides, so there's more to be done.<br>
<br>
I agree -- and I appreciate you taking a look at this. I am growing<br>
increasingly positive that the only way to make substantive improvement in<br>
projects like yt is to have investments and interest from multiple individuals,<br>
not just as a sanity check but also as a mechanism for encouraging and spurring<br>
development. So, let's do this.<br>
<br>
><br>
> What I've done is to pull and merge Chris' current PR for rockstar<br>
> (<a href="https://bitbucket.org/yt_analysis/yt/pull-request/247/art-rockstar-camera-updates" target="_blank">https://bitbucket.org/yt_analysis/yt/pull-request/247/art-rockstar-camera-updates</a>)<br>
> into a copy of the current tip of yt. Then upon that, I've made the<br>
> following changes (<a href="http://paste.yt-project.org/show/2671/" target="_blank">http://paste.yt-project.org/show/2671/</a>). In<br>
> particular, here's the substantive things I've done:<br>
<br>
For what it's worth, this pull request is still somewhat in limbo. Chris has<br>
been traveling for some time, but I hope we can return to it soon.<br>
<br>
><br>
> - I modified the part of RockstarHaloFinder.__init__ that finds the<br>
> total number of particles to work in parallel (meaning, not all the<br>
> particles are loaded on all processors).<br>
<br>
This is what the processor pool does.<br>
<br>
><br>
> - I am running on only one data output in my time series. I think this<br>
> is why I've had to comment out one of the ProcessorPool() blocks, but<br>
> frankly, I don't really understand the ProcessorPool stuff. If I keep<br>
> both blocks, the second one in the sequence complains that there are<br>
> no workers available.<br>
<br>
The processor pool system is to divide into workers and readers. With Rockstar,<br>
the IO nodes and the computation nodes are separate. The processor pool<br>
mechanism accomplishes this.<br>
<br>
><br>
> - My test data does not have the 'particle_type' field, which the<br>
> rockstar wrapper was relying on. I've made a few changes that<br>
> basically assume that if there is no 'particle_type' field, everything<br>
> is a DM particle (which is the case for my test data). This has<br>
> required a few changes in rockstar.py and rockstar_interface.pyx (look<br>
> for the rh.dm_type stuff).<br>
><br>
> With these changes, I can get some stuff to run. Here are the most<br>
> interesting lines I see:<br>
><br>
> [ 0s] Accepting connections...<br>
> [ 0s] Accepted all reader / writer connections.<br>
> [ 0s] Verified all reader / writer connections.<br>
> [ 0s] Reading 1 blocks for snapshot 0...<br>
> (snip)<br>
> reading from particle filename ./inline.0: data0012<br>
> [ 21s] Transferring particles to writers...<br>
> [ 22s] Analyzing for halos / subhalos...<br>
> [ 33s] Constructing merger tree...<br>
> [ 33s] [Success] Done with snapshot 0.<br>
><br>
> Immediately after this I see some unhelpful crash error messages.<br>
<br>
That does sound unhelpful.<br>
<br>
><br>
> I do get a "halos_0.0.ascii" file (and some other stuff) in my<br>
> xxx_rockstar directory, but the centers of mass for the halos are very<br>
> fishy (and likely everything else). I think this might be related to<br>
> the fact that I'm getting a crash. I think that the centers are fishy<br>
> because, for example, the largest halo in the rockstar text file is no<br>
> where near the largest that HOP finds, although they do have a similar<br>
> number of particles.<br>
><br>
> There was a bit of momentum on rockstar a couple weeks ago, and I'm<br>
> hoping that we can try to get this thing working. I can share the<br>
> dataset I'm using for my tests, if anyone wants it (it's similar to<br>
> one of the compendium datasets, if not identical), and my script as<br>
> well.<br>
<br>
I'd be very keen to push forward on the Rockstar stuff, or at the very minimum,<br>
walk through every line of code in it, describe how it interfaces with Rockstar,<br>
and give suggestions and code review for how to go forward. Unfortunately my<br>
time is otherwise occupied until at least the middle of next week and I cannot<br>
dedicate time to actively developing it until then.<br>
<br>
The items you have described all sound to me like genuine issues with the<br>
Rockstar interface. I am somewhat confused as to why the original, pre-PR<br>
interface did not work for you, and I'm even more confused why the particle<br>
number would remain the same while the values calculated for the halo differ.<br>
<br>
I have an outstanding fork with changes to Rockstar that require patching the<br>
Rockstar source. Peter suggested we add Rockstar to the download script, which<br>
means we can also apply a handful of patches.<br>
<br>
On Wednesday I should be able to talk to you about this in detail in IRC. Would<br>
you be available around 3PM Eastern? Anyone else interested can hang out in #yt<br>
as well.<br>
<br>
-Matt<br>
<br>
><br>
> Thanks!<br>
><br>
> --<br>
> Stephen Skory<br>
> <a href="javascript:;" onclick="_e(event, 'cvml', 's@skory.us')">s@skory.us</a><br>
> <a href="http://stephenskory.com/" target="_blank">http://stephenskory.com/</a><br>
> 510.621.3687 (google voice)<br>
> _______________________________________________<br>
> yt-dev mailing list<br>
> <a href="javascript:;" onclick="_e(event, 'cvml', 'yt-dev@lists.spacepope.org')">yt-dev@lists.spacepope.org</a><br>
> <a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
_______________________________________________<br>
yt-dev mailing list<br>
<a href="javascript:;" onclick="_e(event, 'cvml', 'yt-dev@lists.spacepope.org')">yt-dev@lists.spacepope.org</a><br>
<a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
</blockquote></div></div>