Difference between revisions of "Payuongadi"

m
Line 6: Line 6:
 
Using payu on the new gadi HPC system should be straightforward. Depending on the setup of your configuration you might need to make very few changes.
 
Using payu on the new gadi HPC system should be straightforward. Depending on the setup of your configuration you might need to make very few changes.
  
Everyone will need to load the CMS conda module conda/analysis3-unstable from it's new location. Instructions are here:
+
You will need to [[Conda|load the CMS conda module]] <tt>conda/analysis3-unstable</tt>
  
<span class="marker">LINK TO NEW CONDA LOAD INSTRUCTIONS</span>
+
There is no&nbsp;short file system on gadi. This has been replaced by a time-limited scratch file space. Once raijin is decommissioned&nbsp;the default location for payu laboratories will be changed to <code>/scratch/$PROJECT/$USER/$MODEL</code>.
 
 
There is no&nbsp;short file system on gadi. This has been replaced by a time-limited scratch file space. The latest version of payu has changed the default location for payu laboratories to <code>/scratch/$PROJECT/$USER/$MODEL</code>.
 
  
 
However, if your <code>config.yaml</code> hard codes <code>shortpath</code> to a location under <code>/short</code> this will have to be changed. This is a common practice so that a model can be submitted to the PBS system under more than one project code, but ensure that all files are read to and from the same laboratory space.
 
However, if your <code>config.yaml</code> hard codes <code>shortpath</code> to a location under <code>/short</code> this will have to be changed. This is a common practice so that a model can be submitted to the PBS system under more than one project code, but ensure that all files are read to and from the same laboratory space.

Revision as of 22:24, 4 December 2019

payu on gadi

 

Using payu on the new gadi HPC system should be straightforward. Depending on the setup of your configuration you might need to make very few changes.

You will need to load the CMS conda module conda/analysis3-unstable

There is no short file system on gadi. This has been replaced by a time-limited scratch file space. Once raijin is decommissioned the default location for payu laboratories will be changed to /scratch/$PROJECT/$USER/$MODEL.

However, if your config.yaml hard codes shortpath to a location under /short this will have to be changed. This is a common practice so that a model can be submitted to the PBS system under more than one project code, but ensure that all files are read to and from the same laboratory space.

For example, if you config.yaml contains the following;

shortpath: /short/v45

you will need to change it. Initially the recommendation would be to change it to this:

shortpath: /scratch/v45

but this comes with some drawbacks. The /scratch disk will be purged based on the modification time of files, so some care must be taken to ensure files which must be kept are transferred to other filesystems before they are deleted.