Migrate experiment projects

Revision as of 23:51, 10 February 2022 by C.carouge (talk | contribs)

This page contains information on what to do if you want to change project to work at NCI.

Setting your default project

To change the default project that jobs get submitted to when you run 'qsub', edit the file on Gadi '~/.config/gadi-login.conf'

If you also run models from accessdev you can change the default project on that computer by editing the file '~/.rashrc'

In either case you will need to log out and back in again for the change to take effect

Climate model experiments

WRF does not have a standard experiment setup so we can't give specific instructions for this model. But the compilation script will work without modifications after the project merge.

Tips for other scripts

In your script, you may have used w35 or w48 in the following lines:

  • PBS directive -P to specify the project
  • PBS directive -l storage to load the storage space for these projects.
  • Full paths of input or output data

It is difficult to give a list of specific steps that would work for anyone. Below are a few tips that might help you.

Find files with the project listed in

To find all the files that contain the mention of w35, you can use the following command:

grep --exclude=*.nc -irlI w35 <directory_name> > files_to_update.txt

files_to_update.txt will contain a list of files where w35 appear in at least one line. The command will not search in binary files and netCDF files and you can exclude more files from the search (e.g. figures) with the --exclude= option. Replace <directory_name> with the directory you want to search through.

At the opposite, if you only want to search through files with a specific extension, you could use --include=GLOB. Replace GLOB by the extension you want to search. For example the following command will search for w35 in all the Python Notebooks and only these:

grep --include=*.ipynb -irlI w35 <directory_name> > ipynb_to_update.txt

Find all and replace all

All text file editors come with the ability to find all occurences of a pattern and to replace all these occurences. Make sure you know how to use this functionality, including reviewing the changes before making the change, for your favourite text editor.