Difference between revisions of "Data resources"

m
 
(54 intermediate revisions by 2 users not shown)
Line 1: Line 1:
  
This page contains documentation about data relevant to the ARCCSS data climate data and how to access data available at NCI and on web-based climate portals.
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data access and management'''
 +
|- style="vertical-align:top;"
 +
| style="width: 50%" |
 +
[[Finding_datasets|Finding datasets]]
  
=== '''Data policies and services within the Centre''' ===
+
*Common Datasets
 +
**[[CMIP|CMIP]]
 +
**[[ERA5|ERA5]]
 +
**[[ERA_INTERIM|ERA Interim]] 
 +
*'''[[:Category:Dataset|All Datasets]]'''  
 +
*[[CLEX_and_ARCCSS_data_collection|Data published by ARCCSS and CLEX]]
 +
*[https://geonetwork.nci.org.au NCI Data Catalogue]
  
*What data should I publish - Centre position statement:[[Data_Management_Plan|Preparing a Data Management Plan]]
+
| style="width: 50%" |
**[[:File:ARCCSS_data_perspectives-21st_Jan_2014.docx]] 
+
[[Data_Management_Plan|Data Management]]
*[[Data_induction|Data management induction]]
 
*[[Data_publishing_guidelines|How to publish data when submitting a paper]]
 
*[[mailto:paolap@utas.edu.au| Who to ask for help]]
 
*[http://dmp.climate-cms.org:3000/ | ARCCSS DMPonline] - an online data management plan tool
 
*[[Storage-request|Requesting extra disk allocation]]
 
*[[Researcher-ID|Getting a researcher ID]]  
 
  
=== <span style="font-family:Arial,Helvetica,sans-serif;">'''University data policies and services'''</span> ===
+
*[[Data_induction|An overview]]
 +
*[[Publishing_options|How to Publish Data]]
 +
*[[Publishing_software|Publishing your code]]
 +
*[[Publisher_policies|Journal requirements]]
 +
*[[Open_access_license|Open access licenses]]
 +
*[[Storage|Storage]]
  
*[[UNSW_data_requirements_and_tools|UNSW]]
+
|}
*[[Melbourne_University_data_requirements_and_tools|Melbourne University]]
 
*[[UTAS_data_requirements_and_tools|UTAS]]
 
*[[ANU_data_requirements_and_tools|ANU]]
 
*[[Monash_data_requirements_and_tools|Monash]]
 
  
 +
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data induction'''
 +
|- style="vertical-align:top;"
 +
| style="width: 258px;" |
 +
Induction
  
=== <span style="font-family:Arial,Helvetica,sans-serif;">'''Datasets hosted on raijin and managed by the ARCCSS'''</span> ===
+
*[[Data_induction|Introduction]]
 +
*[[Why_should_I_care?|Why&nbsp;should&nbsp;I&nbsp;care?]]
 +
*[[Data_terminology|Commonly used terms and acronyms]]
  
*[[CMIP|CMIP5]] - Coupled Model Intercomparison Project Phase 5 data on raijin
+
| style="width: 500px;" |  
*[[CMIP|CMIP6]] - Coupled Model Intercomparison Project Phase 6 data on raijin
+
[[Data_videos|Video testimonials]]
*[[ERA_INTERIM|ERA INTERIM]] - ECMWF re-analysis on raijin
 
*[[ERA5|ERA5]] - ECMWF re-analysis
 
*[[MACC|MACC]] - ECMWF
 
*[[YOTC|YOTC]] - ECMWF re-analysis on raijin
 
*[[CABLE_Data|CABLE]] datasets collection (in collaboration with the CABLE users group)
 
*[[OSTIA-SST|OSTIA-SST]]
 
*[[NOAA_OISST|NOAA_OISST]] - Optimum Interpolation Sea Surface Temperature from NOAA
 
*CMIP5_ocean_processing
 
*[http://polar.ncep.noaa.gov/sst/ NCEP Polar SST]
 
*[[OFES|OFES]] - OGCM For the Earth Simulator
 
*[[MERRA2|MERRA2]] - Modern-Era Retrospective Analysis for Research and Applications 2
 
*[[JRA55|JRA55]] - Japanese 55-year Reanalysis
 
*[[JRA55-do|JRA55-do]] - JRA‐55 based data set for Driving Ocean ‐ sea ice model
 
*[[Upper_Air_Sounding_Observations_for_Australia_2000-2015|Upper Air Sounding Observations for Australia 2000-2015]]
 
*[[Lightning_Stroke_Counts_on_ECMWF_Era_Interim_Grid|Lightning Stroke Counts on]] ECMWF Era Interim Grid 20080301-20151031
 
*[[NASA-TRMM|NASA-TRMM]] - Real-Time TRMM Multi-Satellite Precipitation Analysis
 
*[[C20C|C20C]]+ - International CLIVAR C20C+ Detection and Attribution project
 
*[[CESM1-LME|CESM1-LME]] - CESM1 Last Millenium Ensemble
 
*[[CESM1-CAM5-BGC-LE|CESM1-CAM5-BGC-LE]] - CESM1-CAM5 BioGeoChemestry 20C + RCP8.5 Large Ensemble model output
 
*[[Sealevel_GLO_PHY_L4_REP_observations_008_047|sealevel_GLO_PHY_L4_REP_observations_008_047]] - Global Ocean - Multimission altimeter satellite gridded sea surface heights and derived variables (previously known as AVISO)
 
*[[CMORPH|CMORPH ]]-&nbsp;<span style="font-family:Arial,Helvetica,sans-serif;">NOAA CPC MORPHing technique: high resolution precipitation (60S-60N) v1.0</span>
 
*[[GSMaP|GSMaP - Global Satellite Mapping of Precipitation]]
 
*[[GHCN|GHCN]] - Global Historical Climatology Network
 
  
=== '''Other datasets hosted on raijin''' ===
+
*[https://drive.google.com/file/d/1yDYRqzmKarVhZC7GTCwn5Wq6WphAJwN-/view?usp=sharing Andy Pittman: CLEX view on data science]
 +
*...
  
*[http://nci.org.au/data-collections/data-collections/ NCI collections]
+
|}
*[http://geonetwork.nci.org.au/geonetwork/srv/eng/main.home NCI geodata network records]
 
*[http://dap.nci.org.au/thredds/catalog.html NCI Thredds catalog]
 
  
=== '''ARCCSS datasets and software published on Research Data Australia (RDA)''' ===
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Data policies'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
  
The Centre of Excellence for Climate System Science has started publishing its datasets on Research Data Australia (RDA), the Australian National Data Service (ANDS) metadata repository. The first datasets to be published were from the Climate Model Downscaling Data for Impacts Research (CliMDDIR), then the ACCESS CMIP5 simulations.
+
*[[FAIR|FAIR principles]]
  
*[[ACCESS_CoE_simulations|ACCESS]] - CMIP5 simulations
+
| style="width: 501px;" |
*[http://climddir.org/ | CliMDDIR] - Climate Model Downscaling Data for Impacts Research
+
Policies
*[[ARCCSS_published_datasets|ARCCSS collection]] - ARCCSS datasets on the NCI Data Catalogue
 
*[https://researchdata.ands.org.au/atmospheric-access13-historical-sub-project/645160 | C20C+ ACCESS] - <span style="color: #454545;">Atmospheric ACCESS1.3 historical all forcing model output for the Climate of the 20th Century Plus (C20C+) Detection and Attribution sub-project</span>
 
*<span style="color: #454545;">[https://researchdata.ands.org.au/marine-heatwaves-detection-code/814983 | marineHeatWaves] - Marine heatwaves detection code</span>
 
  
=== '''External data resources''' ===
+
*[[Australian_Code_for_the_Responsible_Conduct_of_Research|Australian&nbsp;Code&nbsp;for&nbsp;the&nbsp;Responsible&nbsp;Conduct&nbsp;of&nbsp;Research]]
 +
*[[CLEX_Data_policy|CLEX&nbsp;Data&nbsp;Policy]]
 +
*[[Institution_data_requirements|ARC and institutional policies]]
 +
*[[Publisher_policies|Journal publishers policies]]
 +
*[[Data_Collaboration_Agreement|Data collaboration&nbsp;agreements]]
  
*[[GIOVANNI|GIOVANNI]] - GES-DISC Interactive Online Visualization ANd aNalysis Infrastructure
+
|}
*[http://dl.tpac.org.au TPAC] Climate and Ocean data portal
 
*[http://www.ands.org.au The Australian National Data Service (ANDS)]
 
*[http://researchdata.ands.org.au Research Data Australia]
 
*[http://cfconventions.org/ CF metadata conventions website]
 
*[http://www.bom.gov.au/climate/data/ BoM Climate data services]
 
*[http://www.bom.gov.au/cyclone/history/tracks/ BoM Tropical Cyclone data services]
 
*[https://tropicaldatahub.org/ Tropical Data Hub]
 
  
[[Category:Main Menu]]
+
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Publishing to make data FAIR'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
 +
 
 +
*[[FAIR_-_Findable|Findable]]
 +
*[[FAIR_-_Accessible|Accessible]]
 +
*[[FAIR_-_Interoperable|Interoperable]]
 +
*[[FAIR_-_Reusable|Reusable]]
 +
 
 +
| style="width: 501px;" |
 +
Guidelines
 +
 
 +
*[[Which_data_should_I_publish|Which data should I&nbsp;publish?]]
 +
*[[Publishing_options|Publishing options]]
 +
*[[Open_access_license|Licensing options]]
 +
*[[Persistent_research_identifiers|ORCID, DOI and other persistent research identifiers]]
 +
*[[Conventions|Conventions]]
 +
*[[Controlled_vocabularies|Keywords and controlled&nbsp;vocabularies]]
 +
*[[Versioning|Versioning]]
 +
 
 +
|}
 +
 
 +
{| class="wikitable" style="width: 100%"
 +
|-
 +
| colspan="2" style="text-align:center;background:skyblue" | '''Best data practices'''
 +
|- style="vertical-align:top;"
 +
| style="width: 257px;" |
 +
Concepts
 +
 
 +
*[[Data_Management_Plan|Planning]]: before you start
 +
*[[Provenance|Provenance]]: record your work
 +
*[[Leaving_the_Centre_guidelines|Leaving the Centre]]: the end of a project
 +
 
 +
| style="width: 501px;" |
 +
Guidelines and tools
 +
 
 +
*[https://clex.dmponline.cloud.edu.au/ CLEX Roadmap] - online data management plan tool
 +
*Data organisation
 +
**[[Best_practices_for_directories_and_files|Directory structure and filenames]]
 +
**[[Storage|Storage]]
 +
**[[NetCDF_Compression_Tools|Compression]] 
 +
*[[Backup_strategy|Backup_strategy]]
 +
*[[Coding_best_practices|Coding_best_practices]]
 +
*[[Git_Introduction|Version control]]
 +
*[[Archiving_data|Data archiving]]
 +
 
 +
|}
 +
 
 +
[[Category:Data]]

Latest revision as of 19:27, 2 May 2022