[Yt-dev] precision in io

[Geoffrey So]

I was wondering if there is a consensus about the precision of the data
output by YT should be?

I've came upon this question when trying to output ellipsoidal parameters
along with halo attributes.  With the current setting, the halo attributes
are outputted with 9 decimal points, but the ellipsoid parameters determined
using the particle's position (when the data is 64 bit) has 16 decimals.

I was thinking that it is best to keep whatever precision we have, but
Stephen brought up a good point, that the halos are only vaguely defined,
that the extra digits are a waste of storage.  So I just want to see if
anyone even cares, and what we want to go with.  Either way, I think it is
best to be consistent across the board, having both halo or ellipsoid IO in
the same amount of decimals.

From
G.S.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.spacepope.org/pipermail/yt-dev-spacepope.org/attachments/20110813/ff1dd739/attachment.htm>