Difference between revisions of "Admin"

 
(2 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[Category: Contents]][[Category: Admin]]
 
  
=Organisation=  
+
= Organisation =
==Research programs (RPs) and RP leads==  
+
 
{|  
+
== Research programs (RPs) and RP leads ==
| Research Program || RP leads || CMS person
+
 
 +
{|
 
|-
 
|-
| Climate Variability || Andy Hogg, Mat England, Dietmar Dommenget, Neil Holbrooke || Aidan Heerdegen, Holger Wolff
+
| Research Program
 +
| RP leads
 +
| CMS person
 
|-
 
|-
| Heatwaves and Cold air outbreaks || Michael Reeder, Jason Evans || Paola Petrelli
+
| Climate Variability
 +
| Andy Hogg, Mat England, Dietmar Dommenget, Neil Holbrooke
 +
| Aidan Heerdegen, Holger Wolff
 
|-
 
|-
| Rainfall Extremes || Todd Lane, Julie Arblaster || Scott Wales
+
| Heatwaves and Cold air outbreaks
 +
| Michael Reeder, Jason Evans
 +
| Paola Petrelli
 
|-
 
|-
| Drought || Mike Roderick, Andy Pitman || Danny Eisenberg
+
| Rainfall Extremes
 +
| Todd Lane, Julie Arblaster
 +
| Scott Wales
 
|-
 
|-
 +
| Drought
 +
| Mike Roderick, Andy Pitman
 +
| Danny Eisenberg
 
|}
 
|}
==CIs==  
+
 
 +
== CIs ==
 +
 
 
Andy Pitman: Director
 
Andy Pitman: Director
  
Line 44: Line 57:
 
Peter Strutton
 
Peter Strutton
  
=Policies=  
+
= Policies =
==Blogposts==  
+
 
We can publish blogs whenever we have something worth to be published. Just write the post and ask for a review.
+
== Blogposts ==
Note: it can be faster to publish a post from a helpdesk question right after finishing helping the user than to postpone it.
+
 
 +
We can publish blogs whenever we have something worth to be published. Just write the post and ask for a review. Note: it can be faster to publish a post from a helpdesk question right after finishing helping the user than to postpone it.
 +
 
 +
== News ==
  
==News==
 
 
To communicate new work:
 
To communicate new work:
# update all documentation
 
# advertise on [[news | CMS news]] page
 
  
==Help desk==  
+
#update all documentation
 +
#advertise on [[News|CMS news]] page
 +
 
 +
== Help desk ==
 +
 
 
There is now a roster for the help desk:
 
There is now a roster for the help desk:
{|  
+
 
| Monday || Claire / Danny
+
{|
 
|-
 
|-
| Tuesday || Scott
+
| Monday
 +
| Holger
 
|-
 
|-
| Wednesday || Holger
+
| Tuesday
 +
| Ramzi
 
|-
 
|-
| Thursday || Aidan
+
| Wednesday
 +
| CodeBreak 
 
|-
 
|-
| Friday || Paola
+
| Thursday
 +
| Aidan
 
|-
 
|-
 +
| Friday
 +
| Paola
 
|}
 
|}
 +
 
Main tasks on "help desk day" are:
 
Main tasks on "help desk day" are:
# Helpdesk
 
# Documentation / training update. Don't forget this page with information on [[Editing the Wiki|editing the wiki]]
 
# Other work
 
  
==Priorities==  
+
#Helpdesk
 +
#Documentation / training update. Don't forget this page with information on [[Editing_the_Wiki|editing the wiki]]
 +
#Other work
 +
 
 +
== Priorities ==
 +
 
 
We need to update our priorities regularly (~3 months). Update on Trello (and/or spreadsheet?) in consultation with the Infrastructure Committee. Communicate to CIs.
 
We need to update our priorities regularly (~3 months). Update on Trello (and/or spreadsheet?) in consultation with the Infrastructure Committee. Communicate to CIs.
  
==NCI Projects husbandry==  
+
== NCI Projects husbandry ==
# Every 6 months, send a list of members for each CoE projects to CIs. It's a reminder to clean up the memberships.
+
 
# Everyone is in charge of caring for one or several projects. See tables below.
+
#Every 6 months, send a list of members for each CoE projects to CIs. It's a reminder to clean up the memberships.  
# Need to keep track every week or so of the storage and SU usage (use ncimonitor)
+
#Everyone is in charge of caring for one or several projects. See tables below.  
# '''Contact users''' if people are on track to exceed '''storage'''
+
#Need to keep track every week or so of the storage and SU usage (use ncimonitor)  
# '''Contact Aidan''' if people are on track to exceed '''SU'''.
+
#'''Contact users''' if people are on track to exceed '''storage'''  
=NCI Projects=  
+
#'''Contact Aidan''' if people are on track to exceed '''SU'''.  
 +
 
 +
= NCI Projects =
 +
 
 
See this [[CLEX_projects_at_NCI|page]]
 
See this [[CLEX_projects_at_NCI|page]]
  
==Other CoE-Related:==  
+
== Other CoE-Related: ==
===Compute===  
+
 
{|  
+
=== Compute ===
| dt6 || Andy Pitman || Land stuff
+
 
 +
{|
 
|-
 
|-
| e14 || Matthew England || Ocean stuff
+
| dt6
 +
| Andy Pitman
 +
| Land stuff
 
|-
 
|-
 +
| e14
 +
| Matthew England
 +
| Ocean stuff
 
|}
 
|}
  
===Storage===  
+
=== Storage ===
{|  
+
 
! Project !! Lead CI !! Description !! Carer  
+
{| style="width: 667px;"
 +
|-
 +
! Project
 +
! Lead CI (or delegate)
 +
! Description
 +
! style="width: 62px;" | Carer
 +
|-
 +
| access
 +
| Scott Wales, Claire Carouge
 +
| Software group for ACCESS, need membership to run ACCESS
 +
| style="width: 62px;" | Scott
 +
|-
 +
| ks32
 +
| Paola Petrelli
 +
| ARCCSS and CLEX data
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| access || Scott Wales, Claire Carouge || Software group for ACCESS, need membership to run ACCESS || Scott
+
| ub4
 +
| Paola Petrelli
 +
| Era-Interim Data
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| ks32 || Paola Petrelli || ARCCSS and CLEX data || Paola  
+
| rr3
 +
| Yiling Liu
 +
| ESGF CMIP5 Australian Data Publication
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| ub4 || Paola Petrelli || Era-Interim Data || Paola  
+
| al33
 +
| Yiling Liu
 +
| ESGF CMIP5 Data Replication
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| rr3 || Kate Snow || ESGF CMIP5 Australian Data Publication || Paola  
+
| oi10
 +
| Yiling Liu
 +
| ESGF CMIP6 Data Replication
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| al33 || Kate Snow || ESGF CMIP5 Data Replication || Paola  
+
| fs38
 +
| Yiling Liu
 +
| ESGF CMIP6 Australian Data Publication
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| oi10 || Kate Snow || ESGF CMIP6 Data Replication || Paola
+
| p66
 +
| Tony Hirst
 +
| ACCESS GCM
 +
| style="width: 62px;" |  
 
|-
 
|-
| fs38 || Kate Snow || ESGF CMIP6 Australian Data Publication || Paola
+
| rq7
 +
| Paola Petrelli
 +
| YOTC
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| p66 || Tony Hirst || ACCESS GCM ||  
+
| rr4
 +
|  
 +
| BoM ACCESS NWP data
 +
| style="width: 62px;" |  
 
|-
 
|-
| rq7 || Paola Petrelli || YOTC || Paola  
+
| rr7
 +
| Paola Petrelli
 +
| Reanalyses
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| rr4 ||   || BoM ACCESS NWP data || 
+
| wd9
 +
| Paola Petrelli
 +
| CABLE evaluation datasets
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| rr7 || Aurel Moise,<br>Paola Petrelli || Reanalyses || Paola  
+
| hh5
 +
| Paola Petrelli
 +
| Climate LIEF storage grant
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| wd9 || Paola Petrelli || CABLE evaluation datasets || Paola  
+
| ua8
 +
| Paola Petrelli
 +
| Miscellaneous data
 +
| style="width: 62px;" | Paola
 
|-
 
|-
| hh5 || Claire Carouge || Climate LIEF storage grant || Paola
+
| ik11
 +
| Andy Hogg
 +
| Shared COSIMA input data
 +
| style="width: 62px;" | Aidan
 
|-
 
|-
| ua8 || Paola Petrelli || Miscellaneous data || Paola
+
| sx70
|-
+
| Holger Wolff
| ik11 || Andy Hogg || Shared COSIMA input data || Aidan
+
| Shared WRF input data
 +
| style="width: 62px;" | Claire
 
|-
 
|-
| sx70 || Claire Carouge || Shared WRF input data || Claire
+
| ia39
 +
| Richard Matear
 +
| ACS public data collection
 +
| style="width: 62px;" | Paola
 
|}
 
|}
  
===Cloud projects===  
+
=== Cloud projects ===
{|  
+
 
| fe2_2 ||  || ARCCSS cloud
+
{|
 
|-
 
|-
| ju7_1 ||   || CWSlab
+
| fe2_2
 +
| &nbsp;
 +
| ARCCSS cloud
 
|-
 
|-
 +
| ju7_1
 +
| &nbsp;
 +
| CWSlab
 
|}
 
|}
==Requesting Met Office accounts for users==
 
  
New accounts need a sponsor from their institution
+
== Requesting Met Office accounts for users ==
Sponsors are listed at https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors, Current ARCCSS sponsors are Scott, Claire and Holger
+
 
Instructions for an account request are at https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist
+
New accounts need a sponsor from their institution Sponsors are listed at [https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors], Current ARCCSS sponsors are Scott, Claire and Holger Instructions for an account request are at [https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist]
  
 
In brief, create a ticket at https:''code.metoffice.gov.uk/trac/admin/newticket?type=account-request with the user's name and email address, like https:''code.metoffice.gov.uk/trac/admin/ticket/758
 
In brief, create a ticket at https:''code.metoffice.gov.uk/trac/admin/newticket?type=account-request with the user's name and email address, like https:''code.metoffice.gov.uk/trac/admin/ticket/758
  
=Useful contacts=  
+
= Useful contacts =
  
{|  
+
{|
! DATA !! 
 
 
|-
 
|-
| Ben Evans || ben.evans@anu.edu.au
+
! DATA
 +
! &nbsp;
 
|-
 
|-
| Claire Trenham || claire.trenham@csiro.au
+
| Ben Evans
 +
| ben.evans@anu.edu.au
 
|-
 
|-
| Clare Richards || clare.richards@anu.edu.au  
+
| Claire Trenham
 +
| claire.trenham@csiro.au
 
|-
 
|-
| Kelsey Drunken || kelsey.drunken@anu.edu.au
+
| Clare Richards
 +
| clare.richards@anu.edu.au
 
|-
 
|-
 +
| Kelsey Drunken
 +
| kelsey.drunken@anu.edu.au
 
|}
 
|}
  
{|  
+
{|
! User Support !! 
 
 
|-
 
|-
| Roger Edberg || roger.edberg@anu.edu.au
+
! User Support
 +
! &nbsp;
 
|-
 
|-
| Brian Davis || brian.davis@anu.edu.au  
+
| Roger Edberg
 +
| roger.edberg@anu.edu.au
 
|-
 
|-
 +
| Brian Davis
 +
| brian.davis@anu.edu.au
 
|}
 
|}
  
{|  
+
{|
! ACCESS !!  !! 
 
 
|-
 
|-
| Bob Pitt ||  || In charge of access-svn.nci.org.au. (e.g. certificate renewal etc)
+
! ACCESS
 +
! &nbsp;
 +
! &nbsp;
 
|-
 
|-
 +
| Bob Pitt
 +
| &nbsp;
 +
| In charge of access-svn.nci.org.au. (e.g. certificate renewal etc)
 
|}
 
|}
  
=conda environment=  
+
= conda environment =
 +
 
 +
=== Process for update to the conda environment ===
 +
 
 +
Scott is responsible for the update of the stable environment every quarter and deletion of old environments. Aidan is responsible if Scott is away.
 +
 
 +
The stable environment is updated on '''the Tuesday after NCI's quarterly maintenance'''.
 +
 
 +
An announcement of the change is sent '''one week before the update'''.
 +
 
 +
CMS folks are responsible for listing highlights for the update on [http://climate-cms.wikis.unsw.edu.au/Conda|the conda wiki page] '''before the announcement'''.
 +
 
 +
If you want to ask for a delay for the update or you need to ensure the update goes as plan, or you need to retain an old environment, '''discuss it at a team meeting before the announcement'''.
  
CMS maintains an anaconda installation on the NCI systems. To add new packages to the unstable analysis environments clone the [https://github.com/coecms/conda-envs | conda-envs repository]. The master branches contains nothing but a README. The magic happens in other branches. There are two branches, <span style="font-family:monospace">analysis27}} and{{analysis3</span>, for the python2 and python3 environments.
+
=== Add package ===
  
Checkout an analysis branch, add the package name to <span style="font-family:monospace">environment.yml</span> and then commit your change. If the package is to be added to both branches checkout the other branch and make the same change and commit.
+
CMS maintains an anaconda installation on the NCI systems. To add new packages to the unstable analysis environments clone the [https://github.com/coecms/conda-envs conda-envs repository]. The master branches contains nothing but a README. The magic happens in the <span style="font-family:monospace">analysis3</span> branch.
  
Next push altered branches to the repository. If both branches have been updated push both at the same time:
+
Checkout the analysis branch, add the package name to <span style="font-family:monospace">environment.yml</span> and then commit your change.
  
<syntaxhighlight lang=bash>
+
Next push the altered branch to the repository.
git push origin analysis27 analysis3
+
<syntaxhighlight lang="bash">
 +
git push origin analysis3
 
</syntaxhighlight>
 
</syntaxhighlight>
  
Pushing the branches will trigger testing and updating on the jenkins instance. The status of the conda environment update is viewable here:
+
Pushing the branch will trigger testing and updating on the jenkins instance. The status of the conda environment update is viewable here:
 +
 
 +
[https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda]
 +
 
 +
=== Tips and tricks if problems with conda environments ===
  
https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda
+
*Scott said: "for whatever reason (something to do with external c libraries I think) loading packages is sometimes order-dependent." If a package breaks the tests, put its import at the top of the list. It would then be loaded before whatever package is causing the issue.  
  
===Tips and tricks if problems with conda environments===
+
[[Category:Admin]]
* Scott said: "for whatever reason (something to do with external c libraries I think) loading packages is sometimes order-dependent." If a package breaks the tests, put its import at the top of the list. It would then be loaded before whatever package is causing the issue.
 

Latest revision as of 21:13, 9 June 2022

Organisation

Research programs (RPs) and RP leads

Research Program RP leads CMS person
Climate Variability Andy Hogg, Mat England, Dietmar Dommenget, Neil Holbrooke Aidan Heerdegen, Holger Wolff
Heatwaves and Cold air outbreaks Michael Reeder, Jason Evans Paola Petrelli
Rainfall Extremes Todd Lane, Julie Arblaster Scott Wales
Drought Mike Roderick, Andy Pitman Danny Eisenberg

CIs

Andy Pitman: Director

Todd Lane: Vice-director

Christian Jakob

Michael Reeder

Dietmar Dommenget

Steven Sherwood

Lisa Alexander

Julie Arblaster

Nerilie Abram

Gab Abramowitz

Nathaniel Bindoff

Jason Evans

Andy Hogg

Peter Strutton

Policies

Blogposts

We can publish blogs whenever we have something worth to be published. Just write the post and ask for a review. Note: it can be faster to publish a post from a helpdesk question right after finishing helping the user than to postpone it.

News

To communicate new work:

  1. update all documentation
  2. advertise on CMS news page

Help desk

There is now a roster for the help desk:

Monday Holger
Tuesday Ramzi
Wednesday CodeBreak 
Thursday Aidan
Friday Paola

Main tasks on "help desk day" are:

  1. Helpdesk
  2. Documentation / training update. Don't forget this page with information on editing the wiki
  3. Other work

Priorities

We need to update our priorities regularly (~3 months). Update on Trello (and/or spreadsheet?) in consultation with the Infrastructure Committee. Communicate to CIs.

NCI Projects husbandry

  1. Every 6 months, send a list of members for each CoE projects to CIs. It's a reminder to clean up the memberships.
  2. Everyone is in charge of caring for one or several projects. See tables below.
  3. Need to keep track every week or so of the storage and SU usage (use ncimonitor)
  4. Contact users if people are on track to exceed storage
  5. Contact Aidan if people are on track to exceed SU.

NCI Projects

See this page

Other CoE-Related:

Compute

dt6 Andy Pitman Land stuff
e14 Matthew England Ocean stuff

Storage

Project Lead CI (or delegate) Description Carer
access Scott Wales, Claire Carouge Software group for ACCESS, need membership to run ACCESS Scott
ks32 Paola Petrelli ARCCSS and CLEX data Paola
ub4 Paola Petrelli Era-Interim Data Paola
rr3 Yiling Liu ESGF CMIP5 Australian Data Publication Paola
al33 Yiling Liu ESGF CMIP5 Data Replication Paola
oi10 Yiling Liu ESGF CMIP6 Data Replication Paola
fs38 Yiling Liu ESGF CMIP6 Australian Data Publication Paola
p66 Tony Hirst ACCESS GCM  
rq7 Paola Petrelli YOTC Paola
rr4   BoM ACCESS NWP data  
rr7 Paola Petrelli Reanalyses Paola
wd9 Paola Petrelli CABLE evaluation datasets Paola
hh5 Paola Petrelli Climate LIEF storage grant Paola
ua8 Paola Petrelli Miscellaneous data Paola
ik11 Andy Hogg Shared COSIMA input data Aidan
sx70 Holger Wolff Shared WRF input data Claire
ia39 Richard Matear ACS public data collection Paola

Cloud projects

fe2_2   ARCCSS cloud
ju7_1   CWSlab

Requesting Met Office accounts for users

New accounts need a sponsor from their institution Sponsors are listed at https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors, Current ARCCSS sponsors are Scott, Claire and Holger Instructions for an account request are at https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist

In brief, create a ticket at https:code.metoffice.gov.uk/trac/admin/newticket?type=account-request with the user's name and email address, like https:code.metoffice.gov.uk/trac/admin/ticket/758

Useful contacts

DATA  
Ben Evans ben.evans@anu.edu.au
Claire Trenham claire.trenham@csiro.au
Clare Richards clare.richards@anu.edu.au
Kelsey Drunken kelsey.drunken@anu.edu.au
User Support  
Roger Edberg roger.edberg@anu.edu.au
Brian Davis brian.davis@anu.edu.au
ACCESS    
Bob Pitt   In charge of access-svn.nci.org.au. (e.g. certificate renewal etc)

conda environment

Process for update to the conda environment

Scott is responsible for the update of the stable environment every quarter and deletion of old environments. Aidan is responsible if Scott is away.

The stable environment is updated on the Tuesday after NCI's quarterly maintenance.

An announcement of the change is sent one week before the update.

CMS folks are responsible for listing highlights for the update on conda wiki page before the announcement.

If you want to ask for a delay for the update or you need to ensure the update goes as plan, or you need to retain an old environment, discuss it at a team meeting before the announcement.

Add package

CMS maintains an anaconda installation on the NCI systems. To add new packages to the unstable analysis environments clone the conda-envs repository. The master branches contains nothing but a README. The magic happens in the analysis3 branch.

Checkout the analysis branch, add the package name to environment.yml and then commit your change.

Next push the altered branch to the repository.

git push origin analysis3

Pushing the branch will trigger testing and updating on the jenkins instance. The status of the conda environment update is viewable here:

https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda

Tips and tricks if problems with conda environments

  • Scott said: "for whatever reason (something to do with external c libraries I think) loading packages is sometimes order-dependent." If a package breaks the tests, put its import at the top of the list. It would then be loaded before whatever package is causing the issue.