<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
mso-fareast-language:FR;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="FR" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hello,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><br>
Thanks for granting me access to your repo.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">The purpose of my 6 months internship is to evaluate and compare different solutions of light weight and multi kernel for HPC.<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I have at my disposal Xeon (Broadwell) and KNL platforms.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">First I used benchmark like dgemm on single node to evaluate the performances. After noticing that icc create an additional OpenMP management thread, which forced me to allocate a dedicated core for that purpose. To avoid
this extra thread, I now compile with gcc. So far, results on Xeon performance are increased around 1%.<br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">As IHK/McKernel is designed to remove OS noise, I also used Intel FWQ benchmark to evaluate this.<br>
<br>
I assume that removing noise will improve the synchronization at large scale and thus improve performance. To this end, I intend to execute benchmark on multi nodes using MPI. It seems that the question of the extra managing thread will rise again, I’m curious
to know how you manage this. (Do you allocate a core for this purpose?)<br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I’m planning to use other benchmark like OSU benchmark, HPCG and Stream.<br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Thanks you again.<br>
<br>
Best regards,<br>
<br>
Jérémie Finiel</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Balazs Gerofi [mailto:bgerofi@riken.jp]
<br>
<b>Sent:</b> Friday, March 31, 2017 7:45 AM<br>
<b>To:</b> FINIEL, JEREMIE<br>
<b>Cc:</b> mckernel-users@pccluster.org; LAFERRIERE, Christophe; Olivier Gruber; WELTERLEN, BENOIT<br>
<b>Subject:</b> Re: [Mckernel-users 7] McKernel new user questions<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Hello Jeremie,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">sorry for the delay. I've just added your account. Please try to clone the repos from here:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">git clone <a href="mailto:postpeta@postpeta.pccluster.org:ihk">postpeta@postpeta.pccluster.org:ihk</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">git clone <a href="mailto:postpeta@postpeta.pccluster.org:mckernel">postpeta@postpeta.pccluster.org:mckernel</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Let's stay with the master branch for now, but note that we have a number of optimizations for KNL in another branch.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">If you could let us know what is that you are trying to run/do exactly we might be able to offer you something better! :)<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Balazs<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Wed, Mar 29, 2017 at 9:03 PM, FINIEL, JEREMIE <<a href="mailto:jeremie.finiel@atos.net" target="_blank">jeremie.finiel@atos.net</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thank you for your reply, here is my ssh public key:<br>
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDz4oufKicHO/796+mtDd/pqVBvZSLYl8PuyER8VH5JOa9sh6L7wojyxOVOIGsJPJY2kFfpF8/lt+EpSA7mdprgGtiPYNQ9WK7f07qpoJzlKY6aDT4BOxJlXphidPWbfuRuaI46dnvrX1v7Dd/weWiBZUzkKgFpTxghV0SC020LmIvleaboxBAADez4zbXhbiPcBa873zWrHPluqLNQHv6smSic+oqvBOK53XBZTqzqjbo+nJ95zL7gvW0mPgpHZ8NjPidstuWZGvRPc3LMWiMHXVy9E5jM9YU4RAP7KA/cTWxNpehQfwjbeY2JeeBZzeiIHMclqJpoYLXwuT2GLJGj
<a href="mailto:finielj@rio6.bullx">finielj@rio6.bullx</a><br>
<br>
best regards,<br>
<br>
Jérémie Finiel</span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> Balazs
Gerofi [mailto:<a href="mailto:bgerofi@riken.jp" target="_blank">bgerofi@riken.jp</a>]
<br>
<b>Sent:</b> Wednesday, March 29, 2017 11:54 AM<br>
<b>To:</b> FINIEL, JEREMIE; <a href="mailto:mckernel-users@pccluster.org" target="_blank">
mckernel-users@pccluster.org</a><br>
<b>Cc:</b> LAFERRIERE, Christophe; Olivier Gruber; WELTERLEN, BENOIT<br>
<b>Subject:</b> Re: [Mckernel-users 7] McKernel new user questions</span><o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hello Jeremie,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Thanks for your interest in McKernel!<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">You are using an outdated version, please send me your SSH public key I will give you access to our git repo.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Best,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Balazs<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Wed, Mar 29, 2017 at 18:40 FINIEL, JEREMIE <<a href="mailto:jeremie.finiel@atos.net" target="_blank">jeremie.finiel@atos.net</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Hello,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">I am a master degree student in MoSIG (Master of science in Informatics at Grenoble) in France, with specialization
Parallel, Distributed and Embedded Systems (PDES). <br>
I do my end-of-study internship at Atos/Bull in R&D HPC team about multikernel in HPC environment.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">I study and tried your solution, IHK/McKernel, and have some questions.<br>
I was able to use it on two socket Xeon platform. I’m trying now to use it on a KNL but have some difficulties.
</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">I saw that the max number of threads is hard coded to 16. Why this limitation?<br>
Also, with the Xeon platform, the output of lscpu is different with McKernel and Linux which is not the case with KNL.<br>
I would appreciate to know if you are able to use IHK/McKernel with KNL, and if so, which modification are required.<br>
Or do you have a development branch I could use for that purpose?</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Thank you in advance for your answer.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Best regards.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif"">Jérémie Finiel</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">_______________________________________________<br>
Mckernel-users mailing list<br>
<a href="mailto:Mckernel-users@pccluster.org" target="_blank">Mckernel-users@pccluster.org</a><br>
<a href="http://www.pccluster.org/mailman/listinfo/mckernel-users" target="_blank">http://www.pccluster.org/mailman/listinfo/mckernel-users</a><o:p></o:p></p>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>