Difference between revisions of "Data resources"

m
 
(49 intermediate revisions by the same user not shown)
Line 1: Line 1:
  
This page contains documentation about data relevant to the ARCCSS data climate data and how to access data available at NCI and on web-based climate portals.
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data access and management'''
 +
|- style="vertical-align:top;"
 +
| style="width: 50%" |
 +
[[Finding_datasets|Finding datasets]]
  
=== '''Data policies and services within the Centre''' ===
+
*Common Datasets
 +
**[[CMIP|CMIP]]
 +
**[[ERA5|ERA5]]
 +
**[[ERA_INTERIM|ERA Interim]] 
 +
*'''[[:Category:Dataset|All Datasets]]'''  
 +
*[[CLEX_and_ARCCSS_data_collection|Data published by ARCCSS and CLEX]]
 +
*[https://geonetwork.nci.org.au NCI Data Catalogue]
  
*What data should I publish - Centre position statement:[[Data_Management_Plan|Preparing a Data Management Plan]]
+
| style="width: 50%" |
**[[:File:ARCCSS_data_perspectives-21st_Jan_2014.docx]] 
+
[[Data_Management_Plan|Data Management]]
*[[Data_induction|Data management induction]]
 
*[[Data_publishing_guidelines|How to publish data when submitting a paper]]
 
*[[mailto:paolap@utas.edu.au| Who to ask for help]]
 
*[http://dmp.climate-cms.org:3000/ | ARCCSS DMPonline] - an online data management plan tool
 
*[[Storage-request|Requesting extra disk allocation]]
 
*[[Researcher-ID|Getting a researcher ID]]  
 
  
=== <span style="font-family:Arial,Helvetica,sans-serif;">'''University data policies and services'''</span> ===
+
*[[Data_induction|An overview]]
 +
*[[Publishing_options|How to Publish Data]]
 +
*[[Publishing_software|Publishing your code]]
 +
*[[Publisher_policies|Journal requirements]]
 +
*[[Open_access_license|Open access licenses]]
 +
*[[Storage|Storage]]
  
*[[UNSW_data_requirements_and_tools|UNSW]]
+
|}
*[[Melbourne_University_data_requirements_and_tools|Melbourne University]]
 
*[[UTAS_data_requirements_and_tools|UTAS]]
 
*[[ANU_data_requirements_and_tools|ANU]]
 
*[[Monash_data_requirements_and_tools|Monash]]
 
  
&nbsp;
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data induction'''
 +
|- style="vertical-align:top;"
 +
| style="width: 258px;" |
 +
Induction
  
=== <span style="font-family:Arial,Helvetica,sans-serif;">'''Datasets hosted on raijin and managed by the ARCCSS'''</span> ===
+
*[[Data_induction|Introduction]]
 +
*[[Why_should_I_care?|Why&nbsp;should&nbsp;I&nbsp;care?]]
 +
*[[Data_terminology|Commonly used terms and acronyms]]
  
*[[CMIP|CMIP5]] - Coupled Model Intercomparison Project Phase 5 data on raijin
+
| style="width: 500px;" |  
*[[CMIP|CMIP6]] - Coupled Model Intercomparison Project Phase 6 data on raijin
+
[[Data_videos|Video testimonials]]
*[[ERA_INTERIM|ERA INTERIM]] - ECMWF re-analysis on raijin
 
*[[ERA5|ERA5]] - ECMWF re-analysis
 
*[[MACC|MACC]] - ECMWF
 
*[[YOTC|YOTC]] - ECMWF re-analysis on raijin
 
*[[CABLE_Data|CABLE]] datasets collection (in collaboration with the CABLE users group)
 
*[[OSTIA-SST|OSTIA-SST]]
 
*[[NOAA_OISST|NOAA_OISST]] - Optimum Interpolation Sea Surface Temperature from NOAA
 
*CMIP5_ocean_processing
 
*[http://polar.ncep.noaa.gov/sst/ NCEP Polar SST]
 
*[[OFES|OFES]] - OGCM For the Earth Simulator
 
*[[MERRA2|MERRA2]] - Modern-Era Retrospective Analysis for Research and Applications 2
 
*[[JRA55|JRA55]] - Japanese 55-year Reanalysis
 
*[[JRA55-do|JRA55-do]] - JRA‐55 based data set for Driving Ocean ‐ sea ice model
 
*[[Upper_Air_Sounding_Observations_for_Australia_2000-2015|Upper Air Sounding Observations for Australia 2000-2015]]
 
*[[Lightning_Stroke_Counts_on_ECMWF_Era_Interim_Grid|Lightning Stroke Counts on]] ECMWF Era Interim Grid 20080301-20151031
 
*[[NASA-TRMM|NASA-TRMM]] - Real-Time TRMM Multi-Satellite Precipitation Analysis
 
*[[C20C|C20C]]+ - International CLIVAR C20C+ Detection and Attribution project
 
*[[CESM1-LME|CESM1-LME]] - CESM1 Last Millenium Ensemble
 
*[[CESM1-CAM5-BGC-LE|CESM1-CAM5-BGC-LE]] - CESM1-CAM5 BioGeoChemestry 20C + RCP8.5 Large Ensemble model output
 
*[[Sealevel_GLO_PHY_L4_REP_observations_008_047|sealevel_GLO_PHY_L4_REP_observations_008_047]] - Global Ocean - Multimission altimeter satellite gridded sea surface heights and derived variables (previously known as AVISO)
 
*[[CMORPH|CMORPH ]]-&nbsp;<span style="font-family:Arial,Helvetica,sans-serif;">NOAA CPC MORPHing technique: high resolution precipitation (60S-60N) v1.0</span>
 
*[[GSMaP|GSMaP - Global Satellite Mapping of Precipitation]]
 
*[[GHCN|GHCN]] - Global Historical Climatology Network
 
  
 +
*[https://drive.google.com/file/d/1yDYRqzmKarVhZC7GTCwn5Wq6WphAJwN-/view?usp=sharing Andy Pittman: CLEX view on data science]
 +
*...
  
 +
|}
  
=== '''Other datasets hosted on raijin''' ===
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data policies'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
  
*[[AWAP|AWAP - Australian Water Availability Project]]
+
*[[FAIR|FAIR principles]]  
*[http://openradar.io Australian Operational Weather Radar Archive]
 
*[http://nci.org.au/data-collections/data-collections/ NCI collections]
 
*[http://geonetwork.nci.org.au/geonetwork/srv/eng/main.home NCI geodata network records]
 
*[http://dap.nci.org.au/thredds/catalog.html NCI Thredds catalog]
 
  
=== '''ARCCSS datasets and software published on Research Data Australia (RDA)''' ===
+
| style="width: 501px;" |
 +
Policies
  
The Centre of Excellence for Climate System Science has started publishing its datasets on Research Data Australia (RDA), the Australian National Data Service (ANDS) metadata repository. The first datasets to be published were from the Climate Model Downscaling Data for Impacts Research (CliMDDIR), then the ACCESS CMIP5 simulations.
+
*[[Australian_Code_for_the_Responsible_Conduct_of_Research|Australian&nbsp;Code&nbsp;for&nbsp;the&nbsp;Responsible&nbsp;Conduct&nbsp;of&nbsp;Research]]
 +
*[[CLEX_Data_policy|CLEX&nbsp;Data&nbsp;Policy]]
 +
*[[Institution_data_requirements|ARC and institutional policies]]
 +
*[[Publisher_policies|Journal publishers policies]]
 +
*[[Data_Collaboration_Agreement|Data collaboration&nbsp;agreements]]
  
*[[ACCESS_CoE_simulations|ACCESS]] - CMIP5 simulations
+
|}
*[http://climddir.org/ CliMDDIR] - Climate Model Downscaling Data for Impacts Research
 
*[[ARCCSS_published_datasets|ARCCSS collection]] - ARCCSS datasets on the NCI Data Catalogue
 
*[https://researchdata.ands.org.au/atmospheric-access13-historical-sub-project/645160 C20C+ ACCESS] - <span style="color: #454545;">Atmospheric ACCESS1.3 historical all forcing model output for the Climate of the 20th Century Plus (C20C+) Detection and Attribution sub-project</span>
 
*<span style="color: #454545;">[https://researchdata.ands.org.au/marine-heatwaves-detection-code/814983 MarineHeatWaves] - Marine heatwaves detection code</span>
 
  
=== '''External data resources''' ===
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Publishing to make data FAIR'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
  
*[[GIOVANNI|GIOVANNI]] - GES-DISC Interactive Online Visualization ANd aNalysis Infrastructure
+
*[[FAIR_-_Findable|Findable]]  
*[http://dl.tpac.org.au TPAC] Climate and Ocean data portal
+
*[[FAIR_-_Accessible|Accessible]]
*[http://www.ands.org.au The Australian National Data Service (ANDS)]  
+
*[[FAIR_-_Interoperable|Interoperable]]
*[http://researchdata.ands.org.au Research Data Australia]  
+
*[[FAIR_-_Reusable|Reusable]]
*[http://cfconventions.org/ CF metadata conventions website]  
+
 
*[http://www.bom.gov.au/climate/data/ BoM Climate data services]  
+
| style="width: 501px;" |
*[http://www.bom.gov.au/cyclone/history/tracks/ BoM Tropical Cyclone data services]  
+
Guidelines
*[https://tropicaldatahub.org/ Tropical Data Hub]  
+
 
 +
*[[Which_data_should_I_publish|Which data should I&nbsp;publish?]]
 +
*[[Publishing_options|Publishing options]]
 +
*[[Open_access_license|Licensing options]]  
 +
*[[Persistent_research_identifiers|ORCID, DOI and other persistent research identifiers]]
 +
*[[Conventions|Conventions]]
 +
*[[Controlled_vocabularies|Keywords and controlled&nbsp;vocabularies]]  
 +
*[[Versioning|Versioning]]
 +
 
 +
|}
 +
 
 +
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Best data practices'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
 +
 
 +
*[[Data_Management_Plan|Planning]]: before you start
 +
*[[Provenance|Provenance]]: record your work
 +
*[[Leaving_the_Centre_guidelines|Leaving the Centre]]: the end of a project
 +
 
 +
| style="width: 501px;" |
 +
Guidelines and tools
 +
 
 +
*[https://clex.dmponline.cloud.edu.au/ CLEX Roadmap] - online data management plan tool
 +
*Data organisation
 +
**[[Best_practices_for_directories_and_files|Directory structure and filenames]]
 +
**[[Storage|Storage]]
 +
**[[NetCDF_Compression_Tools|Compression]] 
 +
*[[Backup_strategy|Backup_strategy]]
 +
*[[Coding_best_practices|Coding_best_practices]]  
 +
*[[Git_Introduction|Version control]]  
 +
*[[Archiving_data|Data archiving]]  
 +
 
 +
|}
  
 
[[Category:Data]]
 
[[Category:Data]]

Latest revision as of 20:27, 2 May 2022