[yt-dev] Answer testing

[Matthew Turk]

Hi all,

Currently we run all unit and answer tests on every push.  Running answer
testing, particularly with FLASH data, takes a long time.  (Sidenote: FLASH in
2.x is particularly bad for large data objects, which answer testing does.)
This will get worse once Orion and Chombo have been added.  I think we're
looking at up to 15 minutes per run.  This has two effects:

1) Changes which break unit tests take longer to get reported.
2) We'll go through our ShiningPanda monthly allocation quite quickly.

There are two solutions that I see:

1) Buy more time on ShiningPanda
2) Only run answer testing at most once a day, but still run unit tests on every
push.

My proposal is to go with #2 with the backup of #1 as needed.  Can I get [+-]1
on this?

-Matt