Difference between revisions of "Admin"
P.petrelli (talk | contribs) |
|||
(3 intermediate revisions by 2 users not shown) | |||
Line 1: | Line 1: | ||
− | |||
− | =Organisation= | + | = Organisation = |
− | ==Research programs (RPs) and RP leads== | + | |
− | {| | + | == Research programs (RPs) and RP leads == |
− | + | ||
+ | {| | ||
|- | |- | ||
− | | | + | | Research Program |
+ | | RP leads | ||
+ | | CMS person | ||
|- | |- | ||
− | | | + | | Climate Variability |
+ | | Andy Hogg, Mat England, Dietmar Dommenget, Neil Holbrooke | ||
+ | | Aidan Heerdegen, Holger Wolff | ||
|- | |- | ||
− | | | + | | Heatwaves and Cold air outbreaks |
+ | | Michael Reeder, Jason Evans | ||
+ | | Paola Petrelli | ||
|- | |- | ||
− | | | + | | Rainfall Extremes |
+ | | Todd Lane, Julie Arblaster | ||
+ | | Scott Wales | ||
|- | |- | ||
+ | | Drought | ||
+ | | Mike Roderick, Andy Pitman | ||
+ | | Danny Eisenberg | ||
|} | |} | ||
− | ==CIs== | + | |
+ | == CIs == | ||
+ | |||
Andy Pitman: Director | Andy Pitman: Director | ||
Line 44: | Line 57: | ||
Peter Strutton | Peter Strutton | ||
− | =Policies= | + | = Policies = |
− | ==Blogposts== | + | |
− | We can publish blogs whenever we have something worth to be published. Just write the post and ask for a review. | + | == Blogposts == |
− | Note: it can be faster to publish a post from a helpdesk question right after finishing helping the user than to postpone it. | + | |
+ | We can publish blogs whenever we have something worth to be published. Just write the post and ask for a review. Note: it can be faster to publish a post from a helpdesk question right after finishing helping the user than to postpone it. | ||
+ | |||
+ | == News == | ||
− | |||
To communicate new work: | To communicate new work: | ||
− | |||
− | |||
− | ==Help desk== | + | #update all documentation |
+ | #advertise on [[News|CMS news]] page | ||
+ | |||
+ | == Help desk == | ||
+ | |||
There is now a roster for the help desk: | There is now a roster for the help desk: | ||
− | {| | + | |
− | + | {| | |
|- | |- | ||
− | | | + | | Monday |
+ | | Holger | ||
|- | |- | ||
− | | | + | | Tuesday |
+ | | Ramzi | ||
|- | |- | ||
− | | | + | | Wednesday |
+ | | CodeBreak | ||
|- | |- | ||
− | | | + | | Thursday |
+ | | Aidan | ||
|- | |- | ||
+ | | Friday | ||
+ | | Paola | ||
|} | |} | ||
+ | |||
Main tasks on "help desk day" are: | Main tasks on "help desk day" are: | ||
− | |||
− | |||
− | |||
− | ==Priorities== | + | #Helpdesk |
+ | #Documentation / training update. Don't forget this page with information on [[Editing_the_Wiki|editing the wiki]] | ||
+ | #Other work | ||
+ | |||
+ | == Priorities == | ||
+ | |||
We need to update our priorities regularly (~3 months). Update on Trello (and/or spreadsheet?) in consultation with the Infrastructure Committee. Communicate to CIs. | We need to update our priorities regularly (~3 months). Update on Trello (and/or spreadsheet?) in consultation with the Infrastructure Committee. Communicate to CIs. | ||
− | ==NCI Projects husbandry== | + | == NCI Projects husbandry == |
− | # Every 6 months, send a list of members for each CoE projects to CIs. It's a reminder to clean up the memberships. | + | |
− | # Everyone is in charge of caring for one or several projects. See tables below. | + | #Every 6 months, send a list of members for each CoE projects to CIs. It's a reminder to clean up the memberships. |
− | # Need to keep track every week or so of the storage and SU usage (use ncimonitor) | + | #Everyone is in charge of caring for one or several projects. See tables below. |
− | # '''Contact users''' if people are on track to exceed '''storage''' | + | #Need to keep track every week or so of the storage and SU usage (use ncimonitor) |
− | # '''Contact Aidan''' if people are on track to exceed '''SU'''. | + | #'''Contact users''' if people are on track to exceed '''storage''' |
− | =NCI Projects= | + | #'''Contact Aidan''' if people are on track to exceed '''SU'''. |
+ | |||
+ | = NCI Projects = | ||
+ | |||
See this [[CLEX_projects_at_NCI|page]] | See this [[CLEX_projects_at_NCI|page]] | ||
− | ==Other CoE-Related:== | + | == Other CoE-Related: == |
− | ===Compute=== | + | |
− | {| | + | === Compute === |
− | + | ||
+ | {| | ||
|- | |- | ||
− | | | + | | dt6 |
+ | | Andy Pitman | ||
+ | | Land stuff | ||
|- | |- | ||
+ | | e14 | ||
+ | | Matthew England | ||
+ | | Ocean stuff | ||
|} | |} | ||
− | ===Storage=== | + | === Storage === |
− | {| | + | |
− | ! Project | + | {| style="width: 667px;" |
+ | |- | ||
+ | ! Project | ||
+ | ! Lead CI (or delegate) | ||
+ | ! Description | ||
+ | ! style="width: 62px;" | Carer | ||
+ | |- | ||
+ | | access | ||
+ | | Scott Wales, Claire Carouge | ||
+ | | Software group for ACCESS, need membership to run ACCESS | ||
+ | | style="width: 62px;" | Scott | ||
+ | |- | ||
+ | | ks32 | ||
+ | | Paola Petrelli | ||
+ | | ARCCSS and CLEX data | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | ub4 |
+ | | Paola Petrelli | ||
+ | | Era-Interim Data | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | rr3 |
+ | | Yiling Liu | ||
+ | | ESGF CMIP5 Australian Data Publication | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | al33 |
+ | | Yiling Liu | ||
+ | | ESGF CMIP5 Data Replication | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | oi10 |
+ | | Yiling Liu | ||
+ | | ESGF CMIP6 Data Replication | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | fs38 |
+ | | Yiling Liu | ||
+ | | ESGF CMIP6 Australian Data Publication | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | p66 |
+ | | Tony Hirst | ||
+ | | ACCESS GCM | ||
+ | | style="width: 62px;" | | ||
|- | |- | ||
− | | | + | | rq7 |
+ | | Paola Petrelli | ||
+ | | YOTC | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | rr4 |
+ | | | ||
+ | | BoM ACCESS NWP data | ||
+ | | style="width: 62px;" | | ||
|- | |- | ||
− | | | + | | rr7 |
+ | | Paola Petrelli | ||
+ | | Reanalyses | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | wd9 |
+ | | Paola Petrelli | ||
+ | | CABLE evaluation datasets | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | hh5 |
+ | | Paola Petrelli | ||
+ | | Climate LIEF storage grant | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | ua8 |
+ | | Paola Petrelli | ||
+ | | Miscellaneous data | ||
+ | | style="width: 62px;" | Paola | ||
|- | |- | ||
− | | | + | | ik11 |
+ | | Andy Hogg | ||
+ | | Shared COSIMA input data | ||
+ | | style="width: 62px;" | Aidan | ||
|- | |- | ||
− | | | + | | sx70 |
− | | | + | | Holger Wolff |
− | + | | Shared WRF input data | |
+ | | style="width: 62px;" | Claire | ||
|- | |- | ||
− | | | + | | ia39 |
+ | | Richard Matear | ||
+ | | ACS public data collection | ||
+ | | style="width: 62px;" | Paola | ||
|} | |} | ||
− | ===Cloud projects=== | + | === Cloud projects === |
− | {| | + | |
− | + | {| | |
|- | |- | ||
− | | | + | | fe2_2 |
+ | | | ||
+ | | ARCCSS cloud | ||
|- | |- | ||
+ | | ju7_1 | ||
+ | | | ||
+ | | CWSlab | ||
|} | |} | ||
− | |||
− | New accounts need a sponsor from their institution | + | == Requesting Met Office accounts for users == |
− | Sponsors are listed at https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors, Current ARCCSS sponsors are Scott, Claire and Holger | + | |
− | Instructions for an account request are at https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist | + | New accounts need a sponsor from their institution Sponsors are listed at [https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors], Current ARCCSS sponsors are Scott, Claire and Holger Instructions for an account request are at [https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist] |
In brief, create a ticket at https:''code.metoffice.gov.uk/trac/admin/newticket?type=account-request with the user's name and email address, like https:''code.metoffice.gov.uk/trac/admin/ticket/758 | In brief, create a ticket at https:''code.metoffice.gov.uk/trac/admin/newticket?type=account-request with the user's name and email address, like https:''code.metoffice.gov.uk/trac/admin/ticket/758 | ||
− | =Useful contacts= | + | = Useful contacts = |
− | {| | + | {| |
− | |||
|- | |- | ||
− | + | ! DATA | |
+ | ! | ||
|- | |- | ||
− | | | + | | Ben Evans |
+ | | ben.evans@anu.edu.au | ||
|- | |- | ||
− | | | + | | Claire Trenham |
+ | | claire.trenham@csiro.au | ||
|- | |- | ||
− | | | + | | Clare Richards |
+ | | clare.richards@anu.edu.au | ||
|- | |- | ||
+ | | Kelsey Drunken | ||
+ | | kelsey.drunken@anu.edu.au | ||
|} | |} | ||
− | {| | + | {| |
− | |||
|- | |- | ||
− | + | ! User Support | |
+ | ! | ||
|- | |- | ||
− | | | + | | Roger Edberg |
+ | | roger.edberg@anu.edu.au | ||
|- | |- | ||
+ | | Brian Davis | ||
+ | | brian.davis@anu.edu.au | ||
|} | |} | ||
− | {| | + | {| |
− | |||
|- | |- | ||
− | + | ! ACCESS | |
+ | ! | ||
+ | ! | ||
|- | |- | ||
+ | | Bob Pitt | ||
+ | | | ||
+ | | In charge of access-svn.nci.org.au. (e.g. certificate renewal etc) | ||
|} | |} | ||
− | =conda environment= | + | = conda environment = |
+ | |||
+ | === Process for update to the conda environment === | ||
+ | |||
+ | Scott is responsible for the update of the stable environment every quarter and deletion of old environments. Aidan is responsible if Scott is away. | ||
+ | |||
+ | The stable environment is updated on '''the Tuesday after NCI's quarterly maintenance'''. | ||
+ | |||
+ | An announcement of the change is sent '''one week before the update'''. | ||
+ | |||
+ | CMS folks are responsible for listing highlights for the update on [http://climate-cms.wikis.unsw.edu.au/Conda|the conda wiki page] '''before the announcement'''. | ||
+ | |||
+ | If you want to ask for a delay for the update or you need to ensure the update goes as plan, or you need to retain an old environment, '''discuss it at a team meeting before the announcement'''. | ||
− | + | === Add package === | |
− | + | CMS maintains an anaconda installation on the NCI systems. To add new packages to the unstable analysis environments clone the [https://github.com/coecms/conda-envs conda-envs repository]. The master branches contains nothing but a README. The magic happens in the <span style="font-family:monospace">analysis3</span> branch. | |
− | + | Checkout the analysis branch, add the package name to <span style="font-family:monospace">environment.yml</span> and then commit your change. | |
− | <syntaxhighlight lang=bash> | + | Next push the altered branch to the repository. |
− | git push origin | + | <syntaxhighlight lang="bash"> |
+ | git push origin analysis3 | ||
</syntaxhighlight> | </syntaxhighlight> | ||
− | Pushing the | + | Pushing the branch will trigger testing and updating on the jenkins instance. The status of the conda environment update is viewable here: |
+ | |||
+ | [https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda] | ||
+ | |||
+ | === Tips and tricks if problems with conda environments === | ||
− | + | *Scott said: "for whatever reason (something to do with external c libraries I think) loading packages is sometimes order-dependent." If a package breaks the tests, put its import at the top of the list. It would then be loaded before whatever package is causing the issue. | |
− | + | [[Category:Admin]] | |
− |
Latest revision as of 22:13, 9 June 2022
Organisation
Research programs (RPs) and RP leads
Research Program | RP leads | CMS person |
Climate Variability | Andy Hogg, Mat England, Dietmar Dommenget, Neil Holbrooke | Aidan Heerdegen, Holger Wolff |
Heatwaves and Cold air outbreaks | Michael Reeder, Jason Evans | Paola Petrelli |
Rainfall Extremes | Todd Lane, Julie Arblaster | Scott Wales |
Drought | Mike Roderick, Andy Pitman | Danny Eisenberg |
CIs
Andy Pitman: Director
Todd Lane: Vice-director
Christian Jakob
Michael Reeder
Dietmar Dommenget
Steven Sherwood
Lisa Alexander
Julie Arblaster
Nerilie Abram
Gab Abramowitz
Nathaniel Bindoff
Jason Evans
Andy Hogg
Peter Strutton
Policies
Blogposts
We can publish blogs whenever we have something worth to be published. Just write the post and ask for a review. Note: it can be faster to publish a post from a helpdesk question right after finishing helping the user than to postpone it.
News
To communicate new work:
- update all documentation
- advertise on CMS news page
Help desk
There is now a roster for the help desk:
Monday | Holger |
Tuesday | Ramzi |
Wednesday | CodeBreak |
Thursday | Aidan |
Friday | Paola |
Main tasks on "help desk day" are:
- Helpdesk
- Documentation / training update. Don't forget this page with information on editing the wiki
- Other work
Priorities
We need to update our priorities regularly (~3 months). Update on Trello (and/or spreadsheet?) in consultation with the Infrastructure Committee. Communicate to CIs.
NCI Projects husbandry
- Every 6 months, send a list of members for each CoE projects to CIs. It's a reminder to clean up the memberships.
- Everyone is in charge of caring for one or several projects. See tables below.
- Need to keep track every week or so of the storage and SU usage (use ncimonitor)
- Contact users if people are on track to exceed storage
- Contact Aidan if people are on track to exceed SU.
NCI Projects
See this page
Other CoE-Related:
Compute
dt6 | Andy Pitman | Land stuff |
e14 | Matthew England | Ocean stuff |
Storage
Project | Lead CI (or delegate) | Description | Carer |
---|---|---|---|
access | Scott Wales, Claire Carouge | Software group for ACCESS, need membership to run ACCESS | Scott |
ks32 | Paola Petrelli | ARCCSS and CLEX data | Paola |
ub4 | Paola Petrelli | Era-Interim Data | Paola |
rr3 | Yiling Liu | ESGF CMIP5 Australian Data Publication | Paola |
al33 | Yiling Liu | ESGF CMIP5 Data Replication | Paola |
oi10 | Yiling Liu | ESGF CMIP6 Data Replication | Paola |
fs38 | Yiling Liu | ESGF CMIP6 Australian Data Publication | Paola |
p66 | Tony Hirst | ACCESS GCM | |
rq7 | Paola Petrelli | YOTC | Paola |
rr4 | BoM ACCESS NWP data | ||
rr7 | Paola Petrelli | Reanalyses | Paola |
wd9 | Paola Petrelli | CABLE evaluation datasets | Paola |
hh5 | Paola Petrelli | Climate LIEF storage grant | Paola |
ua8 | Paola Petrelli | Miscellaneous data | Paola |
ik11 | Andy Hogg | Shared COSIMA input data | Aidan |
sx70 | Holger Wolff | Shared WRF input data | Claire |
ia39 | Richard Matear | ACS public data collection | Paola |
Cloud projects
fe2_2 | ARCCSS cloud | |
ju7_1 | CWSlab |
Requesting Met Office accounts for users
New accounts need a sponsor from their institution Sponsors are listed at https://code.metoffice.gov.uk/trac/admin/wiki/GroupSponsors, Current ARCCSS sponsors are Scott, Claire and Holger Instructions for an account request are at https://code.metoffice.gov.uk/trac/admin/wiki/NewUserChecklist
In brief, create a ticket at https:code.metoffice.gov.uk/trac/admin/newticket?type=account-request with the user's name and email address, like https:code.metoffice.gov.uk/trac/admin/ticket/758
Useful contacts
DATA | |
---|---|
Ben Evans | ben.evans@anu.edu.au |
Claire Trenham | claire.trenham@csiro.au |
Clare Richards | clare.richards@anu.edu.au |
Kelsey Drunken | kelsey.drunken@anu.edu.au |
User Support | |
---|---|
Roger Edberg | roger.edberg@anu.edu.au |
Brian Davis | brian.davis@anu.edu.au |
ACCESS | ||
---|---|---|
Bob Pitt | In charge of access-svn.nci.org.au. (e.g. certificate renewal etc) |
conda environment
Process for update to the conda environment
Scott is responsible for the update of the stable environment every quarter and deletion of old environments. Aidan is responsible if Scott is away.
The stable environment is updated on the Tuesday after NCI's quarterly maintenance.
An announcement of the change is sent one week before the update.
CMS folks are responsible for listing highlights for the update on conda wiki page before the announcement.
If you want to ask for a delay for the update or you need to ensure the update goes as plan, or you need to retain an old environment, discuss it at a team meeting before the announcement.
Add package
CMS maintains an anaconda installation on the NCI systems. To add new packages to the unstable analysis environments clone the conda-envs repository. The master branches contains nothing but a README. The magic happens in the analysis3 branch.
Checkout the analysis branch, add the package name to environment.yml and then commit your change.
Next push the altered branch to the repository.
git push origin analysis3
Pushing the branch will trigger testing and updating on the jenkins instance. The status of the conda environment update is viewable here:
https://accessdev.nci.org.au/jenkins/blue/pipelines?search=conda
Tips and tricks if problems with conda environments
- Scott said: "for whatever reason (something to do with external c libraries I think) loading packages is sometimes order-dependent." If a package breaks the tests, put its import at the top of the list. It would then be loaded before whatever package is causing the issue.