Difference between revisions of "Migrate payu experiment project"

 
Line 12: Line 12:
  
 
'''If''' the laboratory directory is at the top level of your <tt>/scratch</tt> directory, e.g.&nbsp;<tt>/scratch/w40/user/access-esm:</tt>
 
'''If''' the laboratory directory is at the top level of your <tt>/scratch</tt> directory, e.g.&nbsp;<tt>/scratch/w40/user/access-esm:</tt>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;">Edit the <tt>config.yaml</tt> in the control directory and add&nbsp;
+
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;">Edit the <tt>config.yaml</tt> in the control directory and add&nbsp;  
<code>shortpath: /scratch/w40</code>  
+
<code>shortpath: /scratch/w40</code>
 
&nbsp;if there is no shortpath option, or change it to the new project code if there is already a <tt>shortpath</tt> option defined.</div>  
 
&nbsp;if there is no shortpath option, or change it to the new project code if there is already a <tt>shortpath</tt> option defined.</div>  
 
'''Otherwise''', if the laboratory directory is located at some sub-directory path in your&nbsp;<tt>/scratch</tt> directory:
 
'''Otherwise''', if the laboratory directory is located at some sub-directory path in your&nbsp;<tt>/scratch</tt> directory:
 
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;">Edit the <tt>config.yaml</tt> in the control directory and add the full path to the model laboratory directory&nbsp;  
 
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;">Edit the <tt>config.yaml</tt> in the control directory and add the full path to the model laboratory directory&nbsp;  
 
<code>laboratory: /scratch/w40/user/subdirectorypath/access-esm</code>&nbsp;
 
<code>laboratory: /scratch/w40/user/subdirectorypath/access-esm</code>&nbsp;
if there is already a shortpath option remove it</div>
+
if there is already a shortpath option remove it</div>  
 +
Now remove the symbolic link to the archive directory in your control directory:&nbsp;
 +
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><code>rm archive</code></div>
 +
&nbsp;(make sure to not have a trailing <tt>/</tt> because the operating system thinks this refers to the directory it is linking to rather than the link itself) and run
 +
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><code>payu setup --archive</code></div>
 +
to test your paths are correct and create a new <tt>archive</tt>. If this is successful then
 +
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><code>payu sweep</code></div>
 +
&nbsp; and the model is ready to run. &nbsp;

Latest revision as of 21:21, 27 October 2021

Instructions to migrate a payu experiment from one project to another on gadi.  

Definitions:

  • new project: the NCI project code for the project to which the experiment has been migrated (these instructions use w40 as an example, replace w40 with the appropriate project)
  • control directory: location where the model is run (contains config.yaml file)
  • model: the name of the model in your experiment (these instructions use access-esm as an example, replace access-esm with the appropriate model name)
  • laboratory directory: location of the archive and work directories, e.g. /scratch/w40/user/access-esm, where user is your NCI username.

These instructions assume that the laboratory directory has already been copied from the /scratch directory of the original project to the scratch directory of the new project.

If the laboratory directory is at the top level of your /scratch directory, e.g. /scratch/w40/user/access-esm:

Edit the config.yaml in the control directory and add 

shortpath: /scratch/w40

 if there is no shortpath option, or change it to the new project code if there is already a shortpath option defined.

Otherwise, if the laboratory directory is located at some sub-directory path in your /scratch directory:

Edit the config.yaml in the control directory and add the full path to the model laboratory directory 

laboratory: /scratch/w40/user/subdirectorypath/access-esm 

if there is already a shortpath option remove it

Now remove the symbolic link to the archive directory in your control directory: 

rm archive

 (make sure to not have a trailing / because the operating system thinks this refers to the directory it is linking to rather than the link itself) and run

payu setup --archive

to test your paths are correct and create a new archive. If this is successful then

payu sweep

  and the model is ready to run.