[yt-dev] Proposal: deprecate lazy_reader

Cameron Hummels chummels at astro.columbia.edu
Thu Feb 23 08:46:22 PST 2012


+1

On 2/23/12 11:43 AM, Matthew Turk wrote:
> Hi all,
>
> Long ago, I added the "lazy_reader" option to profiles.  This then
> showed up also in DerivedQuantities.  In almost all cases used, this
> is set to True, and I believe that the only case when it cannot be is
> when calculating energy.  lazy_reader = True means data is read on
> demand, grid by grid (mediated by preloading for those formats where
> multiple grids might be in a single file) and False means that all of
> the data necessary for the reduction is loaded immediately into
> memory.
>
> I'd like to propose we deprecate it as an option, and force all
> profiles to be "lazy".  I would be implementing this in the geometry
> handling branch.  In the geometry handling branch, I have implemented
> a chunking scheme which is more flexible; in this way subsets of data
> objects can be loaded.  By moving to this scheme, the chunks can
> either be the *entire* data object (i.e., the non-lazy method from
> before) or subsets divided in several different ways.  For example,
> you could do grid-by-grid, you could do gridfile-by-gridfile, or
> whatever type of scheme you like.  I believe that getting rid of lazy
> and moving to just always operating on chunks is the best way to
> accomplish this.
>
> [+-][01] on removing lazy_reader as optional?
>
> -Matt
> _______________________________________________
> yt-dev mailing list
> yt-dev at lists.spacepope.org
> http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org
>



More information about the yt-dev mailing list