http://climate-cms.wikis.unsw.edu.au/index.php?title=GA7_Performance&feed=atom&action=history
GA7 Performance - Revision history
2024-03-29T05:32:51Z
Revision history for this page on the wiki
MediaWiki 1.31.0
http://climate-cms.wikis.unsw.edu.au/index.php?title=GA7_Performance&diff=1600&oldid=prev
S.wales at 04:57, 28 November 2019
2019-11-28T04:57:27Z
<p></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 04:57, 28 November 2019</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l1" >Line 1:</td>
<td colspan="2" class="diff-lineno">Line 1:</td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;">{{Needs Update}}</ins></div></td></tr>
<tr><td colspan="2"> </td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins style="font-weight: bold; text-decoration: none;"></ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>The following charts show the performance of the UM running GA7 at various processor decomposition, to help you decide the best tradeoff between walltime and SU cost</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>The following charts show the performance of the UM running GA7 at various processor decomposition, to help you decide the best tradeoff between walltime and SU cost</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
</table>
S.wales
http://climate-cms.wikis.unsw.edu.au/index.php?title=GA7_Performance&diff=448&oldid=prev
S.wales at 23:33, 11 March 2019
2019-03-11T23:33:25Z
<p></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 23:33, 11 March 2019</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l43" >Line 43:</td>
<td colspan="2" class="diff-lineno">Line 43:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>[[include component="page" wikiName="climate-cms" page="Index UM" editable="1"]]</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>[[include component="page" wikiName="climate-cms" page="Index UM" editable="1"]]</div></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>[[Category:<del class="diffchange diffchange-inline">UM</del>]]</div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>[[Category:<ins class="diffchange diffchange-inline">Unified Model</ins>]]</div></td></tr>
</table>
S.wales
http://climate-cms.wikis.unsw.edu.au/index.php?title=GA7_Performance&diff=431&oldid=prev
Admin at 03:33, 20 February 2019
2019-02-20T03:33:08Z
<p></p>
<table class="diff diff-contentalign-left" data-mw="interface">
<col class="diff-marker" />
<col class="diff-content" />
<col class="diff-marker" />
<col class="diff-content" />
<tr class="diff-title" lang="en">
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">← Older revision</td>
<td colspan="2" style="background-color: #fff; color: #222; text-align: center;">Revision as of 03:33, 20 February 2019</td>
</tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l36" >Line 36:</td>
<td colspan="2" class="diff-lineno">Line 36:</td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>NCI recommend starting out choosing a decomposition setting by minimising the value (walltime x SU cost), which can be seen below for UM versions 10.6 and 11.0</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>NCI recommend starting out choosing a decomposition setting by minimising the value (walltime x SU cost), which can be seen below for UM versions 10.6 and 11.0</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">[[media type</del>=<del class="diffchange diffchange-inline">"custom" key</del>=<del class="diffchange diffchange-inline">"29628909"]]</del></div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">{{#iDisplay:https://docs.google.com/spreadsheets/d/e/2PACX-1vRTqfedW7WxkTeam0WehVmNouUd5R9N6Ho0lHGPii_CdnD9joiL7vxZG3QQ_9m6TH8ks-ucS3XXxp5d/pubchart?oid</ins>=<ins class="diffchange diffchange-inline">1569957188&amp;format</ins>=<ins class="diffchange diffchange-inline">interactive|861.1859838274931|532.5}}</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">[[media type</del>=<del class="diffchange diffchange-inline">"custom" key</del>=<del class="diffchange diffchange-inline">"29628925"]]</del></div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">{{#iDisplay:https://docs.google.com/spreadsheets/d/e/2PACX-1vRTqfedW7WxkTeam0WehVmNouUd5R9N6Ho0lHGPii_CdnD9joiL7vxZG3QQ_9m6TH8ks-ucS3XXxp5d/pubchart?oid</ins>=<ins class="diffchange diffchange-inline">82600298&amp;format</ins>=<ins class="diffchange diffchange-inline">interactive|853.5|527.7475}}</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'>−</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div><del class="diffchange diffchange-inline">[[media type</del>=<del class="diffchange diffchange-inline">"custom" key</del>=<del class="diffchange diffchange-inline">"29628927"]]</del></div></td><td class='diff-marker'>+</td><td style="color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div><ins class="diffchange diffchange-inline">{{#iDisplay:https://docs.google.com/spreadsheets/d/e/2PACX-1vRTqfedW7WxkTeam0WehVmNouUd5R9N6Ho0lHGPii_CdnD9joiL7vxZG3QQ_9m6TH8ks-ucS3XXxp5d/pubchart?oid</ins>=<ins class="diffchange diffchange-inline">819705058&amp;format</ins>=<ins class="diffchange diffchange-inline">interactive|847.5|524.0375}}</ins></div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>[[include component="page" wikiName="climate-cms" page="Index UM" editable="1"]]</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>[[include component="page" wikiName="climate-cms" page="Index UM" editable="1"]]</div></td></tr>
<tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>[[Category:UM]]</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #222; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>[[Category:UM]]</div></td></tr>
</table>
Admin
http://climate-cms.wikis.unsw.edu.au/index.php?title=GA7_Performance&diff=148&oldid=prev
ScottWales: Imported from Wikispaces
2018-04-09T01:11:25Z
<p>Imported from Wikispaces</p>
<p><b>New page</b></p><div>The following charts show the performance of the UM running GA7 at various processor decomposition, to help you decide the best tradeoff between walltime and SU cost<br />
<br />
While increasing the number of CPUs in a run will speed it up, as you add more CPUs the model becomes more inefficient - more time gets spent by the CPUs communicating instead of computing.<br />
<br />
This data was calculated from a number of 10 model day runs. Real run times will also be affected by writing output, and time spent in the queue can increase the walltime spent waiting for the model to complete considerably (changing the restart length / walltime to different values may improve this)<br />
<br />
Changing the science settings can also improve the model performance - for example for longer runs you might consider using the `EasyAerosol` scheme instead of the default aerosols.<br />
<br />
=Recommended settings= <br />
<br />
We recommend for general GA 7 runs running on Raijin's Broadwell nodes the following settings:<br />
<br />
{| <br />
| Description || Config Setting || Value || Comment <br />
|-<br />
| Restart length || RESUB || P4Y || 4 model years <br />
|-<br />
| Walltime || CLOCK || '24:00:00' || 24 hours <br />
|-<br />
| X Decomposition || PE_ATM_NPROCX || 34 <br />
|-<br />
| Y Decomposition || PE_ATM_NPROCY || 28 <br />
|-<br />
| OpenMP Threads || OMPTHR_ATM || 1 <br />
|-<br />
|}<br />
<br />
This will run 4 model years in approximately 18 wall hours, and cost 21 kSU<br />
<br />
To conserve SU, a decomposition of 18 x 28 will run 4 model years in 24 hours and cost 15 kSU<br />
<br />
To speed up the model (at the expense of SU cost) it is important to enable OpenMP threads, by setting OMPTHR_ATM to 2, otherwise the model becomes very inefficient at CPU counts above 1000 (the total CPU count is NPROCX * NPROCY * OMPTHR)<br />
<br />
=Performance by CPU count= <br />
<br />
NCI recommend starting out choosing a decomposition setting by minimising the value (walltime x SU cost), which can be seen below for UM versions 10.6 and 11.0<br />
<br />
[[media type="custom" key="29628909"]]<br />
<br />
[[media type="custom" key="29628925"]]<br />
<br />
[[media type="custom" key="29628927"]]<br />
<br />
[[include component="page" wikiName="climate-cms" page="Index UM" editable="1"]]<br />
[[Category:UM]]</div>
ScottWales