<div dir="ltr">Hello Jeremie,<div><br></div><div>I have added the mckernel-users mailing list to CC so that we all see your messages, please keep it in the loop!</div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 19, 2017 at 8:07 AM, FINIEL, JEREMIE <span dir="ltr"><<a href="mailto:jeremie.finiel@atos.net" target="_blank">jeremie.finiel@atos.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<font face="Calibri" size="2"><span style="font-size:11pt">
<div><span style="font-size:11pt">We had difficulties to launch McKernel on Nehalem processor (E5540 in this case). When starting mcreboot.sh, we just got this error two times: “error: booting”. Please find the dmesg log attached.</span></div></span></font></div></blockquote><div><br></div><div>I haven't had a chance so far to try McKernel on Nehalem, but I would expect it's more related to your Linux kernel version, what is the version you are running? Also, I looked at the dmesg but unfortunately the root cause of the failure is not visible, I will need to adjust how the kmsg is printed to make that part visible. Let me try to get a patch done this week, I'll contact you again.</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><font face="Calibri" size="2"><span style="font-size:11pt">
<div>We tried to launch MPI program with openMPI, but we had an error about hwloc pinning functions (hwloc_set_cpubind returned "Error" for bitmap "0").</div>
<div>As written in your paper, we tried with mvapich2 which work perfectly. </div>
<div>Could you let me know what specific development you had to do to have mvapich working with McKernel? I'm trying to see how hard it would be to have OpenMPI working too.</div></span></font></div></blockquote><div><br></div><div>Are you trying to run OpenMPI on another host? Could you let me know the platform and the configuration how you boot McKernel?</div><div>Hwloc generally is supported, what do you get for mcexec hwloc-ls? Does that work? Another thing you could try is to disable binding in OpenMPI, just as a test..</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><font face="Calibri" size="2"><span style="font-size:11pt">
<div>Now we would like to do some tests at a larger scale. So we develop a script to launch McKernel on each machines, but we got difficulties about right access. Mcreboot.sh must be launch with privilege access, but mcexec can be executed by a user only if
/dev/mcos0 is accessible by this user. For the moment, in order to avoid using root for every execution, I can change owner of /dev/mcos0 as a workaround. </div>
<div>Furthermore, when executing “./mcexec mpirun …” we notice that execution on the other machine is done in the Linux side and not in McKernel, but “mpirun ./mcexec …” seems to do the job. I would be interested to know how you launch your tests at large scale.
If, by any chances, you have a template script, it would be helpful.</div></span></font></div></blockquote><div><br></div><div>Ahh, yes, we are aware of this. One way to get around it is to set your umask to 0002 and use sudo to run the script (I mean not directly by root).</div><div><br></div><div>Best,</div><div>Balazs</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><font face="Calibri" size="2"><span style="font-size:11pt">
<div>Thank you in advance.</div>
<div> </div>
<div>Best regards,</div>
<div>Jérémie Finiel</div>
<div> </div>
<div> </div>
</span></font>
</div>
</blockquote></div><br></div></div>