<meta http-equiv="Content-Type" content="text/html; charset=utf-8"><div dir="ltr">I can answer the first question. If you try to add a field that has already been defined, yt will warn you about it and use the original field definition. If you really want to redefine a field, you have to pass in force_override=True to the add_field function. This was a new addition in yt-3.2. Previously, yt would still use the original definition, but it wouldn't warn the user that it was doing so. I think that maybe these fields are getting added redundantly in the OWLS frontend. I can help try to track that down, but in the meantime it's probably fine to ignore these warnings. </div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jan 20, 2015 at 10:20 PM, Yuxiang Qin <span dir="ltr"><<a href="mailto:yuxiangq@student.unimelb.edu.au" target="_blank">yuxiangq@student.unimelb.edu.au</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Hi,</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">I got two more question about loading files. I don’t think I can find the answer on yt website, so here I am.</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">First thing is when I try to load in snapshot files (my data is a OWLS data), it always tells me some fields already exists. What is that meaning? it also tell s override it by setting force_override=True. What thing will I override? I put force_override=True to ds.load(), it doesn’t recognise it. So where should I put it?</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P001 yt : [WARNING  ] 2015-01-20 16:02:43,268 Field ('gas', 'C_density') already exists. To override use force_override=True.                                     </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P003 yt : [WARNING  ] 2015-01-20 16:02:43,268 Field ('gas', 'Fe_number_density') already exists. To override use force_override=True.                             </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P003 yt : [WARNING  ] 2015-01-20 16:02:43,268 Field ('deposit', 'PartType0_smoothed_Fe_density') already exists. To override use force_override=True.             </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P001 yt : [WARNING  ] 2015-01-20 16:02:43,268 Field ('deposit', 'PartType0_smoothed_C_mass') already exists. To override use force_override=True.                 </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P001 yt : [WARNING  ] 2015-01-20 16:02:43,269 Field ('gas', 'C_mass') already exists. To override use force_override=True.                                        </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P001 yt : [WARNING  ] 2015-01-20 16:02:43,269 Field ('deposit', 'PartType0_smoothed_N_number_density') already exists. To override use force_override=True.       </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P003 yt : [WARNING  ] 2015-01-20 16:02:43,270 Field ('gas', 'Fe_density') already exists. To override use force_override=True.                                    </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P003 yt : [WARNING  ] 2015-01-20 16:02:43,270 Field ('deposit', 'PartType0_smoothed_Fe_mass') already exists. To override use force_override=True.                </div><div style="margin:0px;font-family:'Andale Mono';color:rgb(41,249,20);background-color:rgb(0,0,0)">P001 yt : [WARNING  ] 2015-01-20 16:02:43,270 Field ('gas', 'N_number_density') already exists. To override use force_override=True.                              </div></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Ps. It’s not about parallel computation. When I run the script with one process, it also gives me those warnings.</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Second thing is when I try to load subhalo files, it cannot load in PartTypeN data. ds.field_list and ds.derived_field_list don’t show those PartTypeN fields. I think those fields are added by the people who run the simulation, not from original OWLS data. So how to load in those fields?</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Ps. Actually, I have question three again about the parallel computation, but I am eager to find out the answers to these two. So I post my question now :<</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Thanks a lot!</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Cheers,</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word">Yuxiang</div><div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;word-wrap:break-word"><br></div></div><div><div class="h5"><div><blockquote type="cite"><div>On 21 Jan 2015, at 11:29, Yuxiang Qin <<a href="mailto:yuxiangq@student.unimelb.edu.au" target="_blank">yuxiangq@student.unimelb.edu.au</a>> wrote:</div><br><div><div style="word-wrap:break-word"><span style="font-size:14px">Dear yt-users,</span><div><span style="font-size:14px"><br></span></div><div><span style="font-size:14px">I have a tiny question about loading files.</span></div><div><span style="font-size:14px"><br></span></div><div><span style="font-size:14px">I understand when yt load files, it will load all the files in the directory. For example: if I do </span><span style="font-size:14px;background-color:rgb(0,0,0)"><font color="#29f914" face="Andale Mono">ds=yt.load('snap_103.0.hdf5’)</font></span><span style="font-size:14px">, then </span><span style="font-size:14px;color:rgb(41,249,20);font-family:'Andale Mono';background-color:rgb(0,0,0)">ds.field_list</span><span style="font-size:14px"> , yt would open all the files:</span></div><div><span style="font-size:14px"><br></span></div><div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.0.hdf5<span style="color:#29f914">*   </span>snap_103.16.hdf5<span style="color:#29f914">*  </span>snap_103.22.hdf5<span style="color:#29f914">*  </span>snap_103.29.hdf5<span style="color:#29f914">*  </span>snap_103.6.hdf5<span style="color:#29f914">*</span></span></div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.10.hdf5<span style="color:#29f914">*  </span>snap_103.17.hdf5<span style="color:#29f914">*  </span>snap_103.23.hdf5<span style="color:#29f914">*  </span>snap_103.2.hdf5<span style="color:#29f914">*   </span>snap_103.7.hdf5<span style="color:#29f914">*</span></span></div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.11.hdf5<span style="color:#29f914">*  </span>snap_103.18.hdf5<span style="color:#29f914">*  </span>snap_103.24.hdf5<span style="color:#29f914">*  </span>snap_103.30.hdf5<span style="color:#29f914">*  </span>snap_103.8.hdf5<span style="color:#29f914">*</span></span></div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.12.hdf5<span style="color:#29f914">*  </span>snap_103.19.hdf5<span style="color:#29f914">*  </span>snap_103.25.hdf5<span style="color:#29f914">*  </span>snap_103.31.hdf5<span style="color:#29f914">*  </span>snap_103.9.hdf5<span style="color:#29f914">*</span></span></div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.13.hdf5<span style="color:#29f914">*  </span>snap_103.1.hdf5<span style="color:#29f914">*   </span>snap_103.26.hdf5<span style="color:#29f914">*  </span>snap_103.3.hdf5<span style="color:#29f914">*                   </span></span></div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.14.hdf5<span style="color:#29f914">*  </span>snap_103.20.hdf5<span style="color:#29f914">*  </span>snap_103.27.hdf5<span style="color:#29f914">*  </span>snap_103.4.hdf5<span style="color:#29f914">*                   </span></span></div><div style="margin:0px;font-family:'Andale Mono';color:rgb(51,196,38);background-color:rgb(0,0,0)"><span style="font-size:14px">snap_103.15.hdf5<span style="color:#29f914">*  </span>snap_103.21.hdf5<span style="color:#29f914">*  </span>snap_103.28.hdf5<span style="color:#29f914">*  </span>snap_103.5.hdf5<span style="color:#29f914">*                   </span></span></div></div><div><span style="font-size:14px"> <br></span><div>
<div style="text-align:start;text-indent:0px;word-wrap:break-word"><div style="letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><span style="font-size:14px"><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">However, if our data only has one file :</span><span style="color:rgb(51,196,38);font-family:'Andale Mono';background-color:rgb(0,0,0)">snap_103.hdf5</span><span style="font-family:'Andale Mono';background-color:rgb(0,0,0);color:rgb(41,249,20)">*</span><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">, then if I do </span><span style="background-color:rgb(0,0,0)"><font color="#29f914" face="Andale Mono">ds=yt.load('snap_103.hdf5’)</font></span>, then <span style="color:rgb(41,249,20);font-family:'Andale Mono';background-color:rgb(0,0,0)">ds.field_list</span>, yt would still try to open all the files from <span style="color:rgb(51,196,38);font-family:'Andale Mono';background-color:rgb(0,0,0)">snap_103.0.hdf5</span>, however there is no <span style="color:rgb(51,196,38);font-family:'Andale Mono';background-color:rgb(0,0,0)">snap_103.0.hdf5</span>. It would report error: </span></div><div style="letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><span style="font-size:14px"><br></span></div><div style="color:rgb(41,249,20);letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px;margin:0px;font-family:'Andale Mono';background-color:rgb(0,0,0);min-height:14px"><span style="font-size:14px"><span style="color:rgb(195,55,32)">IOError</span>: Unable to open file (Unable to open file: name = '/lustre/projects/p071_swin/yqin/smaug/ref_eff_l010n0128/data/snapshot_102/snap_102.0.hdf5', errno = 2, error message = 'no such file or directory', flags = 0, o_flags = 0)                                                                            <span></span></span></div><div style="letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255);font-size:14px"><br></span></div><div><font face="Helvetica, Arial, sans-serif"><span style="background-color:rgb(255,255,255);font-size:14px">Is there an argument saying I don’t want to do loading recursively? I can make a link named </span></font><span style="color:rgb(51,196,38);font-family:'Andale Mono';font-size:14px;background-color:rgb(0,0,0)">snap_103.0.hdf5</span><span style="font-family:Helvetica,Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"> to </span><span style="color:rgb(51,196,38);font-family:'Andale Mono';font-size:14px;background-color:rgb(0,0,0)">snap_103.hdf5</span><span style="background-color:rgb(255,255,255)"><font face="Helvetica, Arial, sans-serif"><span style="font-size:14px">. But it’s kind of inconvenient.</span></font></span></div><div><font face="Helvetica, Arial, sans-serif"><span style="background-color:rgb(255,255,255)"><span style="font-size:14px"><br></span></span></font></div><div><font face="Helvetica, Arial, sans-serif"><span style="background-color:rgb(255,255,255)"><span style="font-size:14px">Cheers,</span></span></font></div><div style="letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><span style="font-size:14px"><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">--</span></span></div><div style="letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><span style="font-size:14px"><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">Yuxiang Qin</span></span></div><div style="letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><span style="font-size:14px"><span style="background-color:rgb(255,255,255)"><font face="Helvetica, Arial, sans-serif">PhD Student</font><br style="font-family:Helvetica,Arial,sans-serif"></span><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">School of Physics</span><br style="font-family:Helvetica,Arial,sans-serif"><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">The University of Melbourne</span><br style="font-family:Helvetica,Arial,sans-serif"><span style="font-family:Helvetica,Arial,sans-serif;background-color:rgb(255,255,255)">VIC, Australia, 3010</span></span><br style="font-family:Helvetica,Arial,sans-serif;font-size:15px"></div></div>
</div>
<br></div></div></div></blockquote></div><br></div></div></div><br>_______________________________________________<br>
yt-users mailing list<br>
<a href="mailto:yt-users@lists.spacepope.org">yt-users@lists.spacepope.org</a><br>
<a href="http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org" target="_blank">http://lists.spacepope.org/listinfo.cgi/yt-users-spacepope.org</a><br>
<br></blockquote></div><br></div>