[yt-dev] communicators in yt

[John Zuhone]

Hi devs,

Could someone with knowledge about this explain to me how parallel communicators work in yt? 

I’m trying to adjust the chunk size for grid geometries using the size of the communicator, see line 361 here:

https://bitbucket.org/jzuhone/yt-3.x/src/1307a7103665a9b2563050e9bba05f0f96d8715c/yt/geometry/grid_geometry_handler.py?at=yt <https://bitbucket.org/jzuhone/yt-3.x/src/1307a7103665a9b2563050e9bba05f0f96d8715c/yt/geometry/grid_geometry_handler.py?at=yt>

where I’m trying to determine the size of the communicator using this:

nproc = ytcfg.getint("yt", "__topcomm_parallel_size”)

For an 8-processor job, I expect this to be nproc = 8, but it’s not. I’m generating chunks in photon_simulator from a data source and then iterating over them using parallel_objects, see lines 91-93, 108 of:

https://bitbucket.org/jzuhone/yt-3.x/src/1307a7103665a9b2563050e9bba05f0f96d8715c/yt/analysis_modules/photon_simulator/photon_models.py?at=yt <https://bitbucket.org/jzuhone/yt-3.x/src/1307a7103665a9b2563050e9bba05f0f96d8715c/yt/analysis_modules/photon_simulator/photon_models.py?at=yt>

I realize this is a little obtuse, but can someone flesh this out for me, and tell me how to get the size I’m looking for in this case?

Best,

John Z
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.spacepope.org/pipermail/yt-dev-spacepope.org/attachments/20150408/102b0c4d/attachment.htm>
-------------- next part --------------
_______________________________________________
yt-dev mailing list
yt-dev at lists.spacepope.org
http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org