Difference between revisions of "Data resources"

(Imported from Wikispaces)
 
m
 
(60 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
This page contains documentation about data relevant to the ARCCSS data climate data and how to access data available at NCI and on web-based climate portals.
 
  
−
===[[DATA NEWS]]===
+
{| class="wikitable" style="width: 100%"
−
Only the most recent appear here, follow the link to the news page to see all of them
+
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data access and management'''
 +
|- style="vertical-align:top;"
 +
| style="width: 50%" |
 +
[[Finding_datasets|Finding datasets]]
  
−
- The ARC has added a new [http://www.arc.gov.au/research-data-management | Research Data Management] page to their website
+
*Common Datasets
 +
**[[CMIP|CMIP]]
 +
**[[ERA5|ERA5]]
 +
**[[ERA_INTERIM|ERA Interim]] 
 +
*'''[[:Category:Dataset|All Datasets]]'''
 +
*[[CLEX_and_ARCCSS_data_collection|Data published by ARCCSS and CLEX]]
 +
*[https://geonetwork.nci.org.au NCI Data Catalogue]  
  
−
- CMIP5 update: most of the ESGF nodes are back online, still missing are NCI and the Chinese nodes.
+
| style="width: 50%" |
 +
[[Data_Management_Plan|Data Management]]
  
−
- CMIP5: the [http://arccssive.readthedocs.org/en/latest/CMIP5.html#examples | ARCCSSive] module has now a new stable version and the database has been updated to include all the data replicated on raijin, both by users and by NCI as a bulk transfer.
+
*[[Data_induction|An overview]]  
 +
*[[Publishing_options|How to Publish Data]]
 +
*[[Publishing_software|Publishing your code]]
 +
*[[Publisher_policies|Journal requirements]]
 +
*[[Open_access_license|Open access licenses]]
 +
*[[Storage|Storage]]
  
−
- There is a new [https://opus.nci.org.au/display/CMIP/CMIP+Community+Home | CMIP community page] on NCI confluence, for information and updates relating to the CMIP data and activities at NCI. This includes regular updates on CMIP6 progress. Anyone <span class="s1">with an NCI login can access and add comments to the pages.</span> This is also the right way to communicate issues with the data and its management on NCI.
+
|}
  
−
===Data policies and services within the Centre===  
+
{| class="wikitable" style="width: 100%"
−
* What data should I publish - Centre position statement:[[Data Management Plan | Preparing a Data Management Plan]]
+
|-
−
** [[:File:ARCCSS data perspectives-21st Jan 2014.docx]]
+
| colspan="2" style="text-align:center;background:skyblue" | '''Data induction'''
−
* [[Data induction | Data management induction]]
+
|- style="vertical-align:top;"
−
* [[Data publishing guidelines | How to publish data when submitting a paper]]
+
| style="width: 258px;" |  
−
* [[mailto:paolap@utas.edu.au | Who to ask for help]]
+
Induction
−
* [http://dmp.climate-cms.org:3000/ | ARCCSS DMPonline] - an online data management plan tool
 
−
* [[storage-request | Requesting extra disk allocation]]
 
−
* [[Researcher-ID | Getting a researcher ID]]
 
  
−
===University data policies and services===
+
*[[Data_induction|Introduction]]  
−
* [[UNSW data requirements and tools |  UNSW]]
+
*[[Why_should_I_care?|Why&nbsp;should&nbsp;I&nbsp;care?]]  
−
* [[Melbourne University data requirements and tools | Melbourne University]]
+
*[[Data_terminology|Commonly used terms and acronyms]]  
−
* [[UTAS data requirements and tools | UTAS]]
 
−
* [[ANU data requirements and tools | ANU]]
 
−
* [[Monash data requirements and tools | Monash]]
 
  
−
===Datasets hosted on raijin and managed by the ARCCSS===
+
| style="width: 500px;" |  
−
* [[CMIP | CMIP5]] - Coupled Model Intercomparison Project Phase 5 data on raijin
+
[[Data_videos|Video testimonials]]
−
* [[CMIP | CMIP6]] - Coupled Model Intercomparison Project Phase 6 data on raijin
 
−
* [[ERA INTERIM]] - ECMWF re-analysis on raijin
 
−
* [[ERA5]] - ECMWF re-analysis
 
−
* [[MACC]] - ECMWF
 
−
* [[YOTC]] - ECMWF re-analysis on raijin
 
−
* [[CABLE Data | CABLE]] datasets collection (in collaboration with the CABLE users group)
 
−
* [[OSTIA-SST]]
 
−
* [[NOAA_OISST]] - Optimum Interpolation Sea Surface Temperature from NOAA
 
−
* CMIP5_ocean_processing
 
−
* [http://polar.ncep.noaa.gov/sst/ | NCEP Polar SST]
 
−
* [[OFES]] - OGCM For the Earth Simulator
 
−
* [[MERRA2]] - Modern-Era Retrospective Analysis for Research and Applications 2
 
−
* [[JRA55]] - Japanese 55-year Reanalysis
 
−
* [[JRA55-do]] - JRA‐55 based data set for Driving Ocean ‐ sea ice model
 
−
* [[Upper Air Sounding Observations for Australia 2000-2015]]
 
−
* [[Lightning Stroke Counts on ECMWF Era Interim Grid  | Lightning Stroke Counts ]]on ECMWF Era Interim Grid 20080301-20151031
 
−
* [[NASA-TRMM  | NASA-TRMM]] - Real-Time TRMM Multi-Satellite Precipitation Analysis
 
−
* [[C20C]]+ - International CLIVAR C20C+ Detection and Attribution project
 
−
* [[CESM1-LME]] - CESM1 Last Millenium Ensemble
 
−
* [[CESM1-CAM5-BGC-LE]] - CESM1-CAM5 BioGeoChemestry 20C + RCP8.5 Large Ensemble model output
 
−
* [[sealevel_GLO_PHY_L4_REP_observations_008_047]] - Global Ocean - Multimission altimeter satellite gridded sea surface heights and derived variables (previously known as AVISO)
 
−
* [[CMORPH | CMORPH ]]-
 
−
* [[GSMaP | GSMaP - Global Satellite Mapping of Precipitation]]
 
−
* [[GHCN]] - Global Historical Climatology Network
 
  
−
===Other datasets hosted on raijin===
+
*[https://drive.google.com/file/d/1yDYRqzmKarVhZC7GTCwn5Wq6WphAJwN-/view?usp=sharing Andy Pittman: CLEX view on data science]  
−
* [http://nci.org.au/data-collections/data-collections/ | NCI collections]
+
*...  
−
* [http://geonetwork.nci.org.au/geonetwork/srv/eng/main.home | NCI geodata network records]
 
−
* [http://dap.nci.org.au/thredds/catalog.html | NCI Thredds catalog]
 
  
−
===ARCCSS datasets and software published on Research Data Australia (RDA)===
+
|}
  
−
The Centre of Excellence for Climate System Science has started publishing its datasets on Research Data Australia (RDA), the Australian National Data Service (ANDS) metadata repository. The first datasets to be published were from the Climate Model Downscaling Data for Impacts Research (CliMDDIR), then the ACCESS CMIP5 simulations.
+
{| class="wikitable" style="width: 100%"
−
* [[ACCESS_CoE_simulations | ACCESS]] - CMIP5 simulations
+
|-
−
* [http://climddir.org/ | CliMDDIR] - Climate Model Downscaling Data for Impacts Research
+
| colspan="2" style="text-align:center;background:skyblue" | '''Data policies'''
−
* [[ARCCSS published datasets | ARCCSS collection]] - ARCCSS datasets on the NCI Data Catalogue
+
|- style="vertical-align:top;"
−
* [https://researchdata.ands.org.au/atmospheric-access13-historical-sub-project/645160 | C20C+ ACCESS] - <span style="color: #454545;">Atmospheric ACCESS1.3 historical all forcing model output for the Climate of the 20th Century Plus (C20C+) Detection and Attribution sub-project</span>
+
| style="width: 257px;" |  
−
* <span style="color: #454545;">[https://researchdata.ands.org.au/marine-heatwaves-detection-code/814983 | marineHeatWaves] - Marine heatwaves detection code</span>
+
Concepts
  
−
===External data resources===
+
*[[FAIR|FAIR principles]]
  
−
* [[GIOVANNI]] - GES-DISC Interactive Online Visualization ANd aNalysis Infrastructure
+
| style="width: 501px;" |
−
* [http://dl.tpac.org.au | TPAC] Climate and Ocean data portal
+
Policies
−
* [http://www.ands.org.au | The Australian National Data Service (ANDS)]
+
 
−
* [http://researchdata.ands.org.au | Research Data Australia]
+
*[[Australian_Code_for_the_Responsible_Conduct_of_Research|Australian&nbsp;Code&nbsp;for&nbsp;the&nbsp;Responsible&nbsp;Conduct&nbsp;of&nbsp;Research]]
−
* [http://cfconventions.org/ | CF metadata conventions website]
+
*[[CLEX_Data_policy|CLEX&nbsp;Data&nbsp;Policy]]
−
* [http://www.bom.gov.au/climate/data/ | BoM Climate data services]
+
*[[Institution_data_requirements|ARC and institutional policies]]
−
* [http://www.bom.gov.au/cyclone/history/tracks/ | BoM Tropical Cyclone data services]
+
*[[Publisher_policies|Journal publishers policies]]
−
* [https://tropicaldatahub.org/ | Tropical Data Hub]
+
*[[Data_Collaboration_Agreement|Data collaboration&nbsp;agreements]]
−
[[Category:Main Menu]]
+
 
 +
|}
 +
 
 +
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Publishing to make data FAIR'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
 +
 
 +
*[[FAIR_-_Findable|Findable]]  
 +
*[[FAIR_-_Accessible|Accessible]]
 +
*[[FAIR_-_Interoperable|Interoperable]]
 +
*[[FAIR_-_Reusable|Reusable]]
 +
 
 +
| style="width: 501px;" |
 +
Guidelines
 +
 
 +
*[[Which_data_should_I_publish|Which data should I&nbsp;publish?]]
 +
*[[Publishing_options|Publishing options]]
 +
*[[Open_access_license|Licensing options]]
 +
*[[Persistent_research_identifiers|ORCID, DOI and other persistent research identifiers]]
 +
*[[Conventions|Conventions]]
 +
*[[Controlled_vocabularies|Keywords and controlled&nbsp;vocabularies]]  
 +
*[[Versioning|Versioning]]
 +
 
 +
|}
 +
 
 +
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Best data practices'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
 +
 
 +
*[[Data_Management_Plan|Planning]]: before you start
 +
*[[Provenance|Provenance]]: record your work
 +
*[[Leaving_the_Centre_guidelines|Leaving the Centre]]: the end of a project
 +
 
 +
| style="width: 501px;" |
 +
Guidelines and tools
 +
 
 +
*[https://clex.dmponline.cloud.edu.au/ CLEX Roadmap] - online data management plan tool
 +
*Data organisation
 +
**[[Best_practices_for_directories_and_files|Directory structure and filenames]]
 +
**[[Storage|Storage]]
 +
**[[NetCDF_Compression_Tools|Compression]] 
 +
*[[Backup_strategy|Backup_strategy]]
 +
*[[Coding_best_practices|Coding_best_practices]]  
 +
*[[Git_Introduction|Version control]]  
 +
*[[Archiving_data|Data archiving]]  
 +
 
 +
|}
 +
 
 +
[[Category:Data]]

Latest revision as of 20:27, 2 May 2022

Data access and management

Finding datasets

Data Management

Data induction

Induction

Video testimonials

Data policies

Concepts

Policies

Publishing to make data FAIR

Concepts

Guidelines

Best data practices

Concepts

Guidelines and tools

Retrieved from "http://climate-cms.wikis.unsw.edu.au/index.php?title=Data_resources&oldid=3522"