[Yt-svn] yt: 10 new changesets

hg at spacepope.org hg at spacepope.org
Wed May 19 23:12:49 PDT 2010


hg Repository: yt
details:   yt/rev/91d14576ae7a
changeset: 1687:91d14576ae7a
user:      mturk
date:
Tue May 18 12:36:46 2010 -0700
description:
[svn r1720] Backport from hg:

 * Adding camera class, along with generic HomogenizedVolume class, to make
   multiple traversals of the same partitioned/homogenized volume much faster in
   the volume rendering.
 * Add initial version of stereoscopic image camera
 * Remove some pointer dereferencing in the original enzohop code to speed it
   up by ~10-30%.
 * Bug fix for projections to limit the IO as well as restrict the number of
   calls to loading data from grids for weight fields.
 * Fix some generated smoothed grids that had derived fields.
 * John Wise's fix to the coord_axes callback
 * Britton Smith's path length in cosmology

hg Repository: yt
details:   yt/rev/34f4011cbaa7
changeset: 1688:34f4011cbaa7
user:      joishi
date:
Tue May 18 15:38:40 2010 -0700
description:
[svn r1721] corrected ipython shell selection for general threaded case. this should be sensitive to what the user has in matplotlibrc.

hg Repository: yt
details:   yt/rev/3c7465ff2ce5
changeset: 1689:3c7465ff2ce5
user:      mturk
date:
Tue May 18 21:57:40 2010 -0700
description:
[svn r1722] Moving to an "incorrect" toe-in method to avoid having to calculate a proper
view-frustrum just yet.

hg Repository: yt
details:   yt/rev/1ad8b3afad35
changeset: 1690:1ad8b3afad35
user:      Matthew Turk <matthewturk at gmail.com>
date:
Tue May 18 22:03:19 2010 -0700
description:
Merging from trunk

hg Repository: yt
details:   yt/rev/9546507db533
changeset: 1691:9546507db533
user:      mturk
date:
Tue May 18 22:05:13 2010 -0700
description:
[svn r1723] Backporting from hg:

 * Adding very simple OpenGL image viewer for buffers and (hopefully) stereo pairs
 * Adding a linear colormapper for the extracted color maps

hg Repository: yt
details:   yt/rev/015c5ef507b7
changeset: 1692:015c5ef507b7
user:      mturk
date:
Wed May 19 16:27:01 2010 -0700
description:
[svn r1724] Supply a default of 0.005, which according to my remote, stereo-testers is
about optimal for now.  :)

hg Repository: yt
details:   yt/rev/5692f8979860
changeset: 1693:5692f8979860
user:      mturk
date:
Wed May 19 16:53:51 2010 -0700
description:
[svn r1725] Fixing the stereo image display, which now *will* display stereo image pairs.
The fix is not elegant, but for now it will have to do.

hg Repository: yt
details:   yt/rev/59091556cc27
changeset: 1694:59091556cc27
user:      Matthew Turk <matthewturk at gmail.com>
date:
Wed May 19 23:09:34 2010 -0700
description:
Modifying class structure for the (very basic) OpenGL stuff and added a simple
grid renderer.

hg Repository: yt
details:   yt/rev/b76332129421
changeset: 1695:b76332129421
user:      Matthew Turk <matthewturk at gmail.com>
date:
Wed May 19 23:11:47 2010 -0700
description:
Merge

hg Repository: yt
details:   yt/rev/5360cff8a412
changeset: 1696:5360cff8a412
user:      Matthew Turk <matthewturk at gmail.com>
date:
Wed May 19 23:12:36 2010 -0700
description:
Merging from trunk

diffstat:

 .hgignore                                          |     3 +
 scripts/fbranch                                    |     5 +-
 scripts/fbury                                      |     5 +-
 scripts/fdigup                                     |     5 +-
 scripts/fido                                       |     5 +-
 scripts/fimport                                    |     5 +-
 scripts/iyt                                        |    11 +-
 yt/_amr_utils/Octree.pyx                           |   280 ++
 yt/_amr_utils/QuadTree.pyx                         |   257 ++
 yt/_amr_utils/png_writer.pyx                       |     1 -
 yt/amr_utils.c                                     |  2451 ++++++++++---------------
 yt/amr_utils.pyx                                   |     1 +
 yt/arraytypes.py                                   |    11 +
 yt/extensions/DualEPS.py                           |   699 +++++++
 yt/extensions/MergerTree.py                        |     4 +
 yt/extensions/image_writer.py                      |    23 +-
 yt/extensions/opengl_image_viewer.py               |   360 +++
 yt/extensions/volume_rendering/__init__.py         |     4 +-
 yt/extensions/volume_rendering/camera.py           |   158 +
 yt/extensions/volume_rendering/grid_partitioner.py |    86 +
 yt/extensions/volume_rendering/multi_texture.py    |   302 +++
 yt/fido/share_data.py                              |    83 +
 yt/lagos/BaseDataTypes.py                          |    37 +-
 yt/lagos/Clump.py                                  |    12 +
 yt/lagos/Cosmology.py                              |     6 +
 yt/lagos/HaloFinding.py                            |   133 +-
 yt/lagos/hop/EnzoHop.c                             |    20 +-
 yt/lagos/hop/hop_numpy.h                           |     6 +-
 yt/lagos/hop/kd.h                                  |     6 +-
 yt/raven/Callbacks.py                              |     2 +-
 yt/reason/plot_editors.py                          |    10 +-
 yt/reason/reason_v2.py                             |     5 +-
 yt/reason/tvtk_interface.py                        |     5 +-
 33 files changed, 3464 insertions(+), 1537 deletions(-)

diffs (truncated from 12299 to 300 lines):

diff -r 8c9dd4a6f88f -r 5360cff8a412 .hgignore
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/.hgignore	Wed May 19 23:12:36 2010 -0700
@@ -0,0 +1,3 @@
+syntax: glob
+*.pyc
+.*.swp
diff -r 8c9dd4a6f88f -r 5360cff8a412 scripts/fbranch
--- a/scripts/fbranch	Wed May 12 15:24:57 2010 -0700
+++ b/scripts/fbranch	Wed May 19 23:12:36 2010 -0700
@@ -1,1 +1,4 @@
-basic.py
\ No newline at end of file
+#!python2.5
+import yt.fido
+
+yt.fido.runAction()
diff -r 8c9dd4a6f88f -r 5360cff8a412 scripts/fbury
--- a/scripts/fbury	Wed May 12 15:24:57 2010 -0700
+++ b/scripts/fbury	Wed May 19 23:12:36 2010 -0700
@@ -1,1 +1,4 @@
-basic.py
\ No newline at end of file
+#!python2.5
+import yt.fido
+
+yt.fido.runAction()
diff -r 8c9dd4a6f88f -r 5360cff8a412 scripts/fdigup
--- a/scripts/fdigup	Wed May 12 15:24:57 2010 -0700
+++ b/scripts/fdigup	Wed May 19 23:12:36 2010 -0700
@@ -1,1 +1,4 @@
-basic.py
\ No newline at end of file
+#!python2.5
+import yt.fido
+
+yt.fido.runAction()
diff -r 8c9dd4a6f88f -r 5360cff8a412 scripts/fido
--- a/scripts/fido	Wed May 12 15:24:57 2010 -0700
+++ b/scripts/fido	Wed May 19 23:12:36 2010 -0700
@@ -1,1 +1,4 @@
-basic.py
\ No newline at end of file
+#!python2.5
+from yt.mods import *
+
+fido.runAction()
diff -r 8c9dd4a6f88f -r 5360cff8a412 scripts/fimport
--- a/scripts/fimport	Wed May 12 15:24:57 2010 -0700
+++ b/scripts/fimport	Wed May 19 23:12:36 2010 -0700
@@ -1,1 +1,4 @@
-basic.py
\ No newline at end of file
+#!python2.5
+from yt.mods import *
+
+fido.runAction()
diff -r 8c9dd4a6f88f -r 5360cff8a412 scripts/iyt
--- a/scripts/iyt	Wed May 12 15:24:57 2010 -0700
+++ b/scripts/iyt	Wed May 19 23:12:36 2010 -0700
@@ -19,9 +19,16 @@
     sys.exit()
 
 if "DISPLAY" in os.environ:
+    from matplotlib import rcParams
+    ipbackends = dict(Qt4 = IPython.Shell.IPShellMatplotlibQt4,
+                      WX  = IPython.Shell.IPShellMatplotlibWX,
+                      GTK = IPython.Shell.IPShellMatplotlibGTK,
+                      Qt  = IPython.Shell.IPShellMatplotlibQt)
+    bend = (rcParams["backend"]).rstrip('Agg')
+
     try:
-        ip_shell = IPython.Shell.IPShellMatplotlibWX(user_ns=namespace)
-    except ImportError:
+        ip_shell = ipbackends[bend](user_ns=namespace)
+    except KeyError:
         ip_shell = IPython.Shell.IPShellMatplotlib(user_ns=namespace)
 else:
     ip_shell = IPython.Shell.IPShellMatplotlib(user_ns=namespace)
diff -r 8c9dd4a6f88f -r 5360cff8a412 yt/_amr_utils/Octree.pyx
--- /dev/null	Thu Jan 01 00:00:00 1970 +0000
+++ b/yt/_amr_utils/Octree.pyx	Wed May 19 23:12:36 2010 -0700
@@ -0,0 +1,280 @@
+"""
+A refine-by-two AMR-specific octree
+
+Author: Matthew Turk <matthewturk at gmail.com>
+Affiliation: UCSD
+Homepage: http://yt.enzotools.org/
+License:
+  Copyright (C) 2010 Matthew Turk.  All Rights Reserved.
+
+  This file is part of yt.
+
+  yt is free software; you can redistribute it and/or modify
+  it under the terms of the GNU General Public License as published by
+  the Free Software Foundation; either version 3 of the License, or
+  (at your option) any later version.
+
+  This program is distributed in the hope that it will be useful,
+  but WITHOUT ANY WARRANTY; without even the implied warranty of
+  MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+  GNU General Public License for more details.
+
+  You should have received a copy of the GNU General Public License
+  along with this program.  If not, see <http://www.gnu.org/licenses/>.
+"""
+
+
+import numpy as np
+cimport numpy as np
+# Double up here for def'd functions
+cimport numpy as cnp
+cimport cython
+
+from stdlib cimport malloc, free, abs
+
+cdef extern from "stdlib.h":
+    # NOTE that size_t might not be int
+    void *alloca(int)
+
+cdef struct OctreeNode:
+    np.float64_t *val
+    np.float64_t weight_val
+    np.int64_t pos[3]
+    int level
+    int nvals
+    OctreeNode *children[2][2][2]
+
+cdef void OTN_add_value(OctreeNode *self,
+        np.float64_t *val, np.float64_t weight_val):
+    cdef int i
+    for i in range(self.nvals):
+        self.val[i] += val[i]
+    self.weight_val += weight_val
+
+cdef void OTN_refine(OctreeNode *self):
+    cdef int i, j, i1, j1
+    cdef np.int64_t npos[3]
+    cdef OctreeNode *node
+    for i in range(2):
+        npos[0] = self.pos[0] * 2 + i
+        for j in range(2):
+            npos[1] = self.pos[1] * 2 + j
+            # We have to be careful with allocation...
+            for k in range(2):
+                npos[2] = self.pos[2] * 2 + k
+                self.children[i][j][k] = OTN_initialize(
+                            npos,
+                            self.nvals, self.val, self.weight_val,
+                            self.level + 1)
+    for i in range(self.nvals): self.val[i] = 0.0
+    self.weight_val = 0.0
+
+cdef OctreeNode *OTN_initialize(np.int64_t pos[3], int nvals,
+                        np.float64_t *val, np.float64_t weight_val,
+                        int level):
+    cdef OctreeNode *node
+    cdef int i, j
+    node = <OctreeNode *> malloc(sizeof(OctreeNode))
+    node.pos[0] = pos[0]
+    node.pos[1] = pos[1]
+    node.pos[2] = pos[2]
+    node.nvals = nvals
+    node.val = <np.float64_t *> malloc(
+                nvals * sizeof(np.float64_t))
+    for i in range(nvals):
+        node.val[i] = val[i]
+    node.weight_val = weight_val
+    for i in range(2):
+        for j in range(2):
+            for k in range(2):
+                node.children[i][j][k] = NULL
+    node.level = level
+    return node
+
+cdef void OTN_free(OctreeNode *node):
+    cdef int i, j
+    for i in range(2):
+        for j in range(2):
+            for k in range(2):
+                if node.children[i][j][k] == NULL: continue
+                OTN_free(node.children[i][j][k])
+    free(node.val)
+    free(node)
+
+cdef class Octree:
+    cdef int nvals
+    cdef np.int64_t po2[80]
+    cdef OctreeNode ****root_nodes
+    cdef np.int64_t top_grid_dims[3]
+
+    def __cinit__(self, np.ndarray[np.int64_t, ndim=1] top_grid_dims,
+                  int nvals):
+        cdef int i, j
+        cdef OctreeNode *node
+        cdef np.int64_t pos[3]
+        cdef np.float64_t *vals = <np.float64_t *> alloca(
+                sizeof(np.float64_t)*nvals)
+        cdef np.float64_t weight_val = 0.0
+        self.nvals = nvals
+        for i in range(nvals): vals[i] = 0.0
+
+        self.top_grid_dims[0] = top_grid_dims[0]
+        self.top_grid_dims[1] = top_grid_dims[1]
+        self.top_grid_dims[2] = top_grid_dims[2]
+
+        # This wouldn't be necessary if we did bitshifting...
+        for i in range(80):
+            self.po2[i] = 2**i
+        # Cython doesn't seem to like sizeof(OctreeNode ***)
+        self.root_nodes = <OctreeNode ****> \
+            malloc(sizeof(void*) * top_grid_dims[0])
+
+        # We initialize our root values to 0.0.
+        for i in range(top_grid_dims[0]):
+            pos[0] = i
+            self.root_nodes[i] = <OctreeNode ***> \
+                malloc(sizeof(OctreeNode **) * top_grid_dims[1])
+            for j in range(top_grid_dims[1]):
+                pos[1] = j
+                self.root_nodes[i][j] = <OctreeNode **> \
+                    malloc(sizeof(OctreeNode *) * top_grid_dims[1])
+                for k in range(top_grid_dims[2]):
+                    pos[2] = k
+                    self.root_nodes[i][j][k] = OTN_initialize(
+                        pos, nvals, vals, weight_val, 0)
+
+    cdef void add_to_position(self,
+                 int level, np.int64_t pos[3],
+                 np.float64_t *val,
+                 np.float64_t weight_val):
+        cdef int i, j
+        cdef OctreeNode *node
+        node = self.find_on_root_level(pos, level)
+        cdef np.int64_t fac
+        for L in range(level):
+            if node.children[0][0][0] == NULL:
+                OTN_refine(node)
+            # Maybe we should use bitwise operators?
+            fac = self.po2[level - L - 1]
+            i = (pos[0] >= fac*(2*node.pos[0]+1))
+            j = (pos[1] >= fac*(2*node.pos[1]+1))
+            k = (pos[2] >= fac*(2*node.pos[2]+1))
+            node = node.children[i][j][k]
+        OTN_add_value(node, val, weight_val)
+            
+    cdef OctreeNode *find_on_root_level(self, np.int64_t pos[3], int level):
+        # We need this because the root level won't just have four children
+        # So we find on the root level, then we traverse the tree.
+        cdef np.int64_t i, j
+        i = <np.int64_t> (pos[0] / self.po2[level])
+        j = <np.int64_t> (pos[1] / self.po2[level])
+        k = <np.int64_t> (pos[2] / self.po2[level])
+        return self.root_nodes[i][j][k]
+        
+    
+    @cython.boundscheck(False)
+    @cython.wraparound(False)
+    def add_array_to_tree(self, int level,
+            np.ndarray[np.int64_t, ndim=1] pxs,
+            np.ndarray[np.int64_t, ndim=1] pys,
+            np.ndarray[np.int64_t, ndim=1] pzs,
+            np.ndarray[np.float64_t, ndim=2] pvals,
+            np.ndarray[np.float64_t, ndim=1] pweight_vals):
+        cdef int np = pxs.shape[0]
+        cdef int p
+        cdef cnp.float64_t *vals
+        cdef cnp.float64_t *data = <cnp.float64_t *> pvals.data
+        cdef cnp.int64_t pos[3]
+        for p in range(np):
+            vals = data + self.nvals*p
+            pos[0] = pxs[p]
+            pos[1] = pys[p]
+            pos[2] = pzs[p]
+            self.add_to_position(level, pos, vals, pweight_vals[p])
+
+    def add_grid_to_tree(self, int level,
+                         np.ndarray[np.int64_t, ndim=1] start_index,
+                         np.ndarray[np.float64_t, ndim=2] pvals,
+                         np.ndarray[np.float64_t, ndim=2] wvals,
+                         np.ndarray[np.int32_t, ndim=2] cm):
+        pass
+
+    @cython.boundscheck(False)
+    @cython.wraparound(False)
+    def get_all_from_level(self, int level, int count_only = 0):
+        cdef int i, j
+        cdef int total = 0
+        vals = []
+        for i in range(self.top_grid_dims[0]):
+            for j in range(self.top_grid_dims[1]):
+                for k in range(self.top_grid_dims[2]):
+                    total += self.count_at_level(self.root_nodes[i][j][k], level)
+        if count_only: return total
+        # Allocate our array
+        cdef np.ndarray[np.int64_t, ndim=2] npos
+        cdef np.ndarray[np.float64_t, ndim=2] nvals
+        cdef np.ndarray[np.float64_t, ndim=1] nwvals
+        npos = np.zeros( (total, 2), dtype='int64')



More information about the yt-svn mailing list