[yt-dev] Issue #894: Test suite does not detect load function breakage (yt_analysis/yt)

[Andrew Myers]

New issue 894: Test suite does not detect load function breakage
https://bitbucket.org/yt_analysis/yt/issue/894/test-suite-does-not-detect-load-function

Andrew Myers:

This issue came up regarding PR 1190. Currently, if one breaks the code in such a way that the load function fails for certain datasets, the test suite will skip those datasets instead of reporting a failure. 

IME, breaking the _is_valid methods is really easy to do when doing frontend work, and it be nice if the answer tests reported a failure when this happens. 

As Nathan suggested in IRC, the requires_ds decorator probably just needs to be made smarter.

Responsible: atmyers