<div dir="ltr">So to address the enzo testing side of things:<div><br></div><div>Sam, do you mean, make a gold standard prior to making changes, then after changes test against the previously-made gold standard? This addresses the issues of seeing if your changes break the code, but what if a bad changeset somehow gets into the codebase? I like having a way of comparing long-term (ie after several changesets) to see if the gold standard has drifted substantially, say from changeset 1000 to 1100. Or perhaps there is a mechanism in your new jenkins instance that precludes this? Is jenkins already being run on every PR to make sure we're not merging in bad code that breaks the test suite relative to the previous gold standard? I think what kacper has done in yt to make this happen is one of the major successes of our development process, but it seems like it's a lot of work to make it happen.<div>
<br></div><div><div>Another concern I have is that the defaults right now in the enzo testing suite give you a bunch of errors because they're looking for the external gold-standard. So to a new user, even one who has read through the documentation on how to use the test suite, it just appears like enzo is broken and failing on a bunch of fronts. At the very least if we keep this model, we should make sure that it doesn't default to looking for a non-existent gold standard and that the docs are updated to reflect this.</div>
</div><div><br></div><div>Cameron</div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Thu, Jul 17, 2014 at 7:39 AM, Sam Skillman <span dir="ltr"><<a href="mailto:samskillman@gmail.com" target="_blank">samskillman@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I'll just mention that the enzo tests are set up such that having a public gold standard is not really a priority. It's best to just create a local gold standard and test against that. </div>
<div class="HOEnZb"><div class="h5"><div class="gmail_extra">
<br><br><div class="gmail_quote">On Thu, Jul 17, 2014 at 7:23 AM, Matthew Turk <span dir="ltr"><<a href="mailto:matthewturk@gmail.com" target="_blank">matthewturk@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>On Thu, Jul 17, 2014 at 9:19 AM, Cameron Hummels <<a href="mailto:chummels@gmail.com" target="_blank">chummels@gmail.com</a>> wrote:<br>
> Thanks for the update, Kacper. I guess I didn't realize it was just a<br>
> man-hour thing.<br>
<br>
</div>It definitely is. We had to take it down and migrate it because of<br>
funds (and it was to the tune of a couple hundred a month, but that<br>
could come way down), but we haven't had the opportunity to bring it<br>
up because it will take time and effort to make it do what we want it<br>
to do.<br>
<br>
These aspects of it were around before:<br>
<br>
* Answer tests -> this has been switched over, as Kacper noted<br>
* Project indexing -> Britton's going to move this to a repository system<br>
* Image and notebook sharing -> This will probably use SEEDME, but<br>
it's a person-hour thing<br>
* Data widgets -> These were hardly used, but eventually we will try<br>
to bring them back up<br>
<br>
If anybody wants to try to help out, that would be great. I'm not<br>
going to be able to work on this for some time. It'll require some<br>
web work, some infrastructure management, and probably some patience!<br>
<br>
-Matt<br>
<div><div><br>
><br>
> Cameron<br>
><br>
><br>
> On Thu, Jul 17, 2014 at 2:08 AM, Kacper Kowalik <<a href="mailto:xarthisius.kk@gmail.com" target="_blank">xarthisius.kk@gmail.com</a>><br>
> wrote:<br>
>><br>
>> On 07/17/2014 07:28 AM, Cameron Hummels wrote:<br>
>> > Hey everyone,<br>
>> ><br>
>> > Is there a timeline for the yt hub coming back up? I believe the hold<br>
>> > up<br>
>> > had been the fee of hosting the hub, which I think was being covered by<br>
>> > Matt's personal funds. Is there ever any hope of getting some dedicated<br>
>> > funds to support this in the future? If not, I'm happy to chip in some<br>
>> > money to help this get back up. It seemed like a great resource both<br>
>> > for<br>
>> > hosting datasets and projects tangentially related to yt. Also, I think<br>
>> > it<br>
>> > was the location of the enzo test gold standard, right?<br>
>> ><br>
>> > Anyway, I just wanted to see if there was a timeline for it coming back<br>
>> > or<br>
>> > if was out for the foreseeable future, or if we could help.<br>
>> ><br>
>> > Cameron<br>
>><br>
>> Hi Cameron,<br>
>> I think at this point all the required infrastructure is available, so<br>
>> it's not a matter of funds, but rather time. The original hub code needs<br>
>> to be rewritten in some parts to fit into new environment.<br>
>><br>
>> Some of this work has been already done, e.g. Matt ported answer tests'<br>
>> storage to rackspace[1], there's <a href="http://nbviewer.yt-project.org" target="_blank">http://nbviewer.yt-project.org</a> running.<br>
>><br>
>> Additionally, there's a very interesting project that we are planning to<br>
>> use wrt datasets sharing: <a href="http://seedme.org" target="_blank">seedme.org</a>. I'm going to adapt existing<br>
>> commandline client in order to make 'yt upload_notebook' work again.<br>
>> However, my time is very limited at the moment and I don't expect it to<br>
>> change before September.<br>
>><br>
>> Cheers,<br>
>> Kacper<br>
>><br>
>> [1] <a href="https://bitbucket.org/yt_analysis/yt/pull-request/832" target="_blank">https://bitbucket.org/yt_analysis/yt/pull-request/832</a><br>
>><br>
>><br>
>> _______________________________________________<br>
>> yt-dev mailing list<br>
>> <a href="mailto:yt-dev@lists.spacepope.org" target="_blank">yt-dev@lists.spacepope.org</a><br>
>> <a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
>><br>
><br>
><br>
><br>
> --<br>
> Cameron Hummels<br>
> Postdoctoral Researcher<br>
> Steward Observatory<br>
> University of Arizona<br>
> <a href="http://chummels.org" target="_blank">http://chummels.org</a><br>
><br>
> _______________________________________________<br>
> yt-dev mailing list<br>
> <a href="mailto:yt-dev@lists.spacepope.org" target="_blank">yt-dev@lists.spacepope.org</a><br>
> <a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
><br>
_______________________________________________<br>
yt-dev mailing list<br>
<a href="mailto:yt-dev@lists.spacepope.org" target="_blank">yt-dev@lists.spacepope.org</a><br>
<a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
</div></div></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
yt-dev mailing list<br>
<a href="mailto:yt-dev@lists.spacepope.org">yt-dev@lists.spacepope.org</a><br>
<a href="http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br>Cameron Hummels<div>Postdoctoral Researcher</div><div>Steward Observatory</div><div>University of Arizona</div><div><a href="http://chummels.org" target="_blank">http://chummels.org</a></div>
</div>