<div dir="ltr"><div><div><div>Hi,<br><br></div>I tried with python 2 and I received:<br><br><br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/__init__.py", line 108, in <module><br> from yt.fields.api import \<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/fields/api.py", line 19, in <module><br> from . import angular_momentum<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/fields/angular_momentum.py", line 31, in <module><br> from .vector_operations import \<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/fields/vector_operations.py", line 31, in <module><br> from yt.utilities.lib.misc_utilities import obtain_rv_vec<br>ImportError: /home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/utilities/lib/misc_utilities.so: undefined symbol: PyUnicodeUCS4_DecodeUTF8<br>Traceback (most recent call last):<br> File "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py", line 12, in <module><br> import yt<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/__init__.py", line 108, in <module><br> from yt.fields.api import \<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/fields/api.py", line 19, in <module><br> from . import angular_momentum<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/fields/angular_momentum.py", line 31, in <module><br> from .vector_operations import \<br> File "/home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/fields/vector_operations.py", line 31, in <module><br> from yt.utilities.lib.misc_utilities import obtain_rv_vec<br>ImportError: /home/jullian/.local/lib/python2.7/site-packages/yt-3.2.3-py2.7-linux-x86_64.egg/yt/utilities/lib/misc_utilities.so: undefined symbol: PyUnicodeUCS4_DecodeUTF8<br><br><br></div>I installed yt-x86-64 by the All-in-One Installation Script and I don't know how to change PyUnicode and rebuild. Do you have some guess to me?<br><br></div>Thanks<br><div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">2016-06-09 12:02 GMT-03:00 Matthew Turk <span dir="ltr"><<a href="mailto:matthewturk@gmail.com" target="_blank">matthewturk@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Jullian,<br>
<br>
My guess from reading is that there's a python3 incompatibility<br>
specifically in the Rockstar code interface that yt provides. I<br>
believe that it should be fixable, but right now I don't have the<br>
setup to check it. If you file a bug we will mark it as a blocker and<br>
then return to it before the impending 3.3 release of yt; I'm sorry to<br>
not have better news right now. It should work on Python2, but for<br>
Python3 there is some location where the unicode/non-unicode decoding<br>
needs to happen to move between python strings and char*.<br>
<br>
-Matt<br>
<div><div class="h5"><br>
On Tue, Jun 7, 2016 at 11:35 AM, Jullian Santos<br>
<<a href="mailto:jullianhbsantos@gmail.com">jullianhbsantos@gmail.com</a>> wrote:<br>
> Hello,<br>
> My name is Jullian Santos, I am a Ph.D. student of the University of São<br>
> Paulo, Brazil, and I am having some troubles with the Rockstar halo finding<br>
> function.<br>
><br>
><br>
> I tried to run a test analyses given by yt-project page (the link is below,<br>
> I only modified the file to be opened) but the job always finish in error. I<br>
> submitted the job in my own machine with the command:<br>
><br>
><br>
> #PBS -S /bin/bash<br>
> #PBS -l nodes=4<br>
> #PBS -e /sto/home/jullian/M2.e.txt<br>
> #PBS -o /sto/home/jullian/M2.o.txt<br>
> #PBS -V<br>
><br>
><br>
> mpirun -n 4 $PBS_NODEFILE python3<br>
> "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py"<br>
><br>
> and the program returned:<br>
><br>
> writers<br>
> P001 yt : [WARNING ] 2016-06-07 14:46:19,708 Total Particle Count:<br>
> 1.125e+06<br>
> File "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py", line 62, in<br>
> <module><br>
> hc.create()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 293, in create<br>
> self._run(save_halos, save_catalog, njobs=njobs, dynamic=dynamic)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/utilities/parallel_tools/parallel_analysis_interface.py",<br>
> line 305, in barrierize<br>
> retval = func(*args, **kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 362, in _run<br>
> self.halos_ds = self.finder_method(self.data_ds)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 46, in __call__<br>
> return self.function(ds, *self.args, **self.kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 79, in _rockstar_method<br>
> rh.run()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_finding/rockstar/rockstar.py",<br>
> line 348, in run<br>
> min_halo_size = self.min_halo_size)<br>
> File "yt/analysis_modules/halo_finding/rockstar/rockstar_interface.pyx",<br>
> line 254, in<br>
> yt.analysis_modules.halo_finding.rockstar.rockstar_interface.RockstarInterface.setup_rockstar<br>
> (yt/analysis_modules/halo_finding/rockstar/rockstar_interface.c:3785)<br>
> P002 yt : [ERROR ] 2016-06-07 14:46:19,758 TypeError: expected bytes, str<br>
> found<br>
> File "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py", line 62, in<br>
> <module><br>
> hc.create()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 293, in create<br>
> self._run(save_halos, save_catalog, njobs=njobs, dynamic=dynamic)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/utilities/parallel_tools/parallel_analysis_interface.py",<br>
> line 305, in barrierize<br>
> retval = func(*args, **kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 362, in _run<br>
> self.halos_ds = self.finder_method(self.data_ds)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 46, in __call__<br>
> return self.function(ds, *self.args, **self.kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 79, in _rockstar_method<br>
> rh.run()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_finding/rockstar/rockstar.py",<br>
> line 348, in run<br>
> min_halo_size = self.min_halo_size)<br>
> File "yt/analysis_modules/halo_finding/rockstar/rockstar_interface.pyx",<br>
> line 254, in<br>
> yt.analysis_modules.halo_finding.rockstar.rockstar_interface.RockstarInterface.setup_rockstar<br>
> (yt/analysis_modules/halo_finding/rockstar/rockstar_interface.c:3785)<br>
> P003 yt : [ERROR ] 2016-06-07 14:46:19,758 TypeError: expected bytes, str<br>
> found<br>
> P002 yt : [ERROR ] 2016-06-07 14:46:19,759 Error occured on rank 0.<br>
> application called MPI_Abort(MPI_COMM_WORLD, 1) - process 2<br>
> P003 yt : [ERROR ] 2016-06-07 14:46:19,759 Error occured on rank 1.<br>
> application called MPI_Abort(MPI_COMM_WORLD, 1) - process 3<br>
> File "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py", line 62, in<br>
> <module><br>
> hc.create()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 293, in create<br>
> self._run(save_halos, save_catalog, njobs=njobs, dynamic=dynamic)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/utilities/parallel_tools/parallel_analysis_interface.py",<br>
> line 305, in barrierize<br>
> retval = func(*args, **kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 362, in _run<br>
> self.halos_ds = self.finder_method(self.data_ds)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 46, in __call__<br>
> return self.function(ds, *self.args, **self.kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 79, in _rockstar_method<br>
> rh.run()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_finding/rockstar/rockstar.py",<br>
> line 348, in run<br>
> min_halo_size = self.min_halo_size)<br>
> File "yt/analysis_modules/halo_finding/rockstar/rockstar_interface.pyx",<br>
> line 254, in<br>
> yt.analysis_modules.halo_finding.rockstar.rockstar_interface.RockstarInterface.setup_rockstar<br>
> (yt/analysis_modules/halo_finding/rockstar/rockstar_interface.c:3785)<br>
> P000 yt : [ERROR ] 2016-06-07 14:46:19,761 TypeError: expected bytes, str<br>
> found<br>
> application called MPI_Abort(MPI_COMM_WORLD, 1) - process 0<br>
> File "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py", line 62, in<br>
> <module><br>
> hc.create()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 293, in create<br>
> self._run(save_halos, save_catalog, njobs=njobs, dynamic=dynamic)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/utilities/parallel_tools/parallel_analysis_interface.py",<br>
> line 305, in barrierize<br>
> retval = func(*args, **kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_catalog.py",<br>
> line 362, in _run<br>
> self.halos_ds = self.finder_method(self.data_ds)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 46, in __call__<br>
> return self.function(ds, *self.args, **self.kwargs)<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_analysis/halo_finding_methods.py",<br>
> line 79, in _rockstar_method<br>
> rh.run()<br>
> File<br>
> "/home/jullian/yt-x86_64/src/yt-hg/yt/analysis_modules/halo_finding/rockstar/rockstar.py",<br>
> line 348, in run<br>
> min_halo_size = self.min_halo_size)<br>
> File "yt/analysis_modules/halo_finding/rockstar/rockstar_interface.pyx",<br>
> line 254, in<br>
> yt.analysis_modules.halo_finding.rockstar.rockstar_interface.RockstarInterface.setup_rockstar<br>
> (yt/analysis_modules/halo_finding/rockstar/rockstar_interface.c:3785)<br>
> P001 yt : [ERROR ] 2016-06-07 14:46:19,761 TypeError: expected bytes, str<br>
> found<br>
> application called MPI_Abort(MPI_COMM_WORLD, 1) - process 1<br>
><br>
> ===================================================================================<br>
> = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES<br>
> = EXIT CODE: 1<br>
> = CLEANING UP REMAINING PROCESSES<br>
> = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES<br>
> ===================================================================================<br>
><br>
> ===================================================================================<br>
> = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES<br>
> = EXIT CODE: 1<br>
> = CLEANING UP REMAINING PROCESSES<br>
> = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES<br>
> ===================================================================================<br>
><br>
><br>
><br>
> If I try to run with the command suggested in the yt page (mpirun -n 4<br>
> $PBS_NODEFILE --mca btl ^openib python3<br>
> "/home/jullian/ABinitio/Out/DD0050/halo_rockstar.py" --parallel) I get:<br>
><br>
> [mpiexec@julian-ubuntu] match_arg (./utils/args/args.c:160): unrecognized<br>
> argument mca<br>
> [mpiexec@julian-ubuntu] HYDU_parse_array (./utils/args/args.c:175): argument<br>
> matching returned error<br>
> [mpiexec@julian-ubuntu] parse_args (./ui/mpich/utils.c:1609): error parsing<br>
> input array<br>
> [mpiexec@julian-ubuntu] HYD_uii_mpx_get_parameters<br>
> (./ui/mpich/utils.c:1660): unable to parse user arguments<br>
> [mpiexec@julian-ubuntu] main (./ui/mpich/mpiexec.c:153): error parsing<br>
> parameters<br>
><br>
> How could I fix this problem? Do I have to launch the script in some remote<br>
> machine? Do I have to use the IPython?<br>
><br>
><br>
> Thanks by the attention,<br>
><br>
> Best Regards,<br>
><br>
> Jullian<br>
><br>
><br>
> Script link:<br>
> <a href="http://yt-project.org/doc/cookbook/cosmological_analysis.html#running-rockstar-to-find-halos-on-multi-resolution-particle-datasets" rel="noreferrer" target="_blank">http://yt-project.org/doc/cookbook/cosmological_analysis.html#running-rockstar-to-find-halos-on-multi-resolution-particle-datasets</a><br>
><br>
</div></div>> _______________________________________________<br>
> yt-users mailing list<br>
> <a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br>
> <a href="http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org" rel="noreferrer" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org</a><br>
><br>
_______________________________________________<br>
yt-users mailing list<br>
<a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br>
<a href="http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org" rel="noreferrer" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org</a><br>
</blockquote></div><br></div>