Dataset readme file template - Revision history

P.petrelli at 05:46, 14 July 2021

2021-07-14T05:46:47Z

P.petrelli at 22:58, 30 June 2021

2021-06-30T22:58:20Z

P.petrelli at 06:28, 18 June 2021

2021-06-18T06:28:09Z

P.petrelli: Created page with "{{Template:Working on}} A good readme file attached to your published data is a useful t..."

2021-06-18T06:27:20Z

Created page with "{{Template:Working on}} <span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">A good readme file attached to your published data is a useful t..."

New page

{{Template:Working on}}

<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">A good readme file attached to your published data is a useful tool for a potential user. If they have found the data online by downloading the readme file they can keep the data description and publications details together with the data. If they are using the data directly on the server where the data is stored, then they can get the information on the dataset without having to go online.</span></span>

<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">More importantly the data description shown on online repository is limited in size and a readme file is useful to add more technical details, direcotry structure and other information that you might have to leave out of the main abstract.</span></span>

=== '''<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Readme template and example</span></span>''' ===

<font face="Arial, Helvetica, sans-serif" size="3">When you are publishing on NCI we provide a Readme file template in the working directory we create for each dataset. here I am using a real readme file from a record we recently published to illustrate the template structure. This particular readme file is quite long as there are a lot of technical details, so it provides a good example to show the kind of information you can include. However, if your dataset is less complex is likely your readme file will be a lot shorter than this.</font>

<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><Dataset title and version></span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;">High-Resolution Modelling of Extreme Storms over the East Coast of Australia v1.0</div>
 <span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><Abstract usually the same as published record></span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>This dataset includes data of 11 extreme East Coast Lows simulated using a multi-physics (5), multi-resolution (3) approach for 4 different boundary conditions, leading to a total of 660 simulations. All simulations were performed using the Weather Research and Forecasting (WRF v3.6) regional model using a triple nesting approach with different domain sizes.<br/> The outer domain corresponds to the CORDEX (Coordinated Regional Climate Downscaling Experiment) Australasia domain and is discretized using a 24-km horizontal grid spacing.<br/> ECMWF ERA Interim (ERAI) reanalysis are use to initialize and drive the model for present climate simulations. For future climate simulations, the Pseudo Global Warming (PGW) approach is used. In this case, initial and boundary conditions are built by adding the climate change signal obtained from a global climate multi-model ensemble from the CMIP5.<br/> We selected a total of eleven events featuring an extreme east coast low over the eastern coast of Australia. Events were selected based on their impacts around the Sydney area and the selection includes some of the most iconic events in recent times such as the "Pasha Bulker" (June 2007) and the June 2016 storms. All events were simulated for a total of 8 days, starting about 4 days before the storm peaked near the Sydney's area. A full list of events dates is given below.</samp> </div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><list of relevant elements of the data as simulations,  data sources etc.></span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Events:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>2007-06-04 to 2007-06-12<br/> 2007-06-13 to 2007-06-21<br/> 2007-06-22 to 2007-06-30<br/> 2001-07-23 to 2001-07-31<br/> 2005-03-18 to 2005-03-26<br/> 2008-09-02 to 2008-9-10<br/> 2015-04-18 to 2015-04-26<br/> 2008-08-18 to 2008-08-26<br/> 2013-02-17 to 2013-02-25<br/> 2016-06-01 to 2016-06-09<br/> 2006-09-03 to 2006-09-11</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><br/> <samp>Boundary conditions:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>    HIST - (ERAI) reanalysis is used as lateral and surface (SST) boundary conditions for present climate simulations<br/>     HIST-BRAN - (ERAI) reanalysis is used as lateral boundary conditions and BRAN for surface (SST), for present climate simulations<br/>         FUT - initial and boundary conditions are built by adding the climate change signal from the CMIP5 RCP8.5 scenario climate multi-model ensemble to ERAI.<br/>         FUT-THERMO - initial and boundary conditions are built by adding the climate change signal from the CMIP5 climate multi-model ensemble to ERAI, but only to thermodynamical variables (temperature and humidity) </samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Physics:<br/> There is one control run (CTL) and four perturbed physics members that include modifications in the cumulus (CU), the surface and planetary boundary layer (PBL), the radiation (RAD) and the microphysics (MPS) schemes. Members are denoted according to the physical scheme that is being changed compared to the CTL run. </samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><extra information if necessary as more details on technical aspects, sources etc.> </span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Table summary for physics</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Name           |   CTL     |   CU      |   PBL     |   RAD    |  MPS<br/> --------------------------------------------------------------------------<br/> cumulus        | BMJ (2)   | KF (1)    | BMJ (2)   | BMJ (2)  | BMJ (2)<br/> S/PBL          | YSU (1)   | YSU (1)   | MYJ (2)   | YSU (1)  | YSU (1)<br/> shortwave rad. | RRTM (2)  | RRTM (2)  | RRTM (2)  | CAM (3)  | RRTM (2)<br/> longwave rad.  | Dudhia (1)| Dudhia (1)| Dudhia (1)| CAM (3)  | Dudhia (1)<br/> microphysics   | WSM6 (6)  | WSM6 (6)  | WSM6 (6)  | WSM6 (6) | Thomp. (8)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Numbers after each of the schemes denote the code used in the WRF namelist.<br/> MYJ [9]; YSU [8]; KF [12, 11]; BMJ [1, 9, 10]; WSM6 [14]; Dudhia [6], RRTM<br/> [15]; CAM [4].</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><variables list> </span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp> The final data product is the post-processing files of all simulations made following CORDEX standards.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Names and units of the variables that are available after post-processing. The frequency and the level is also included. Pressure levels are 200, 500, 700, 850 and 925 hPa.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Surface level variables at 1 hr frequency:<br/>    prm - precipitation rate (mm)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>2m surface variables at 1 hr frequency:<br/>    tas - temperature (K)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Surface level variables at 3 hrs frequency:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>   psl - mean sea level pressure (hPa)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Near-surface level variables at 3 hrs frequency:<br/>    cape2d - Convective Available Potential Energy - CAPE (J kg-1)<br/>    tpw - total precipitable water (mm)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>2m surface variables at 3 hrs frequency:<br/>    hus - specic humidity (%) <br/>    hurs relative humidity (%)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>10m surface variables at 3 hrs frequency:<br/>    uas - zonal wind (m s-1) <br/>    vas - meridional wind (m s-1)</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Pressure level variables at 6 hrs frequency:<br/>    ta - temperature (K)<br/>    ua - zonal wind (m s-1)<br/>    va - meridional wind (m s-1)<br/>    wa - vertical wind (m s-1)<br/>    zg - gepotential height (m)<br/>    hus - specic humidity (kg kg-1)</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><Dataset creator, grants if relevant, CLEX research program or other project this dataset is an output of> </span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>This dataset was created by Dr Alejandro Di Luca as part of the Australian Research Council (ARC) Discovery Early Career Researcher Award (DECRA) funded project (DE170101191) and is part of the Centre of Excellence for Climate Extremes (CLEX) Extreme Rainfall research program.</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><where to find the data online and how the data is organised on the server></span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>The data is available online on the NCI TDS server:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>  https://dapds00.nci.org.au/thredds/catalogs/ks32/CLEX/HiRes-MESECA/HiRes-MESECA.html</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>and for NCI users in the ks32 project.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>File organisation:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>  /g/data/ks32/CLEX_Data/HiRes-MESECA/v1-0/<resolution>/<event>/<boundary conditions>/<physics>/<frequency>/<variable>/<files></samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>where<br/>     <resolution> is WRF24, WRF8 and WRF2 for horizontal grid resolution of 24 km, 8 km and 2 km, respectively <br/>     <event> is the starting date of each event<br/>     <boundary conditions> are FUT, FUT-THERMO, HIST and HIST-BRAN<br/>     <physics> are CONTROL, CU, MPS, PBL and RAD <br/>     <frequency> are 6hr, 3hr, 1hr</samp><br/>  </div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>filenames:<br/>    <variable>_HiRes-MESECA_UNSW-WRF360-i1_<resolution>_<event>_<boundary conditions>_<physics>_<frequency>_v1-0.nc</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Example: va200_HiRes-MESECA_UNSW-WRF360-i1_WRF2_2001-07-23_FUT_CTL_6hr_v1-0.nc</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"> < if there is more than one author and/or collaborators list the names and their roles in regard to the data></span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Author:<br/>  · Alejandro Di Luca: designed and performed calculations to generate historical and pseudo-global warming boundary conditions; conceived, designed and performed all simulations; coded and run postprocessing scripts.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Contributors:<br/> ·        Daniel Argueso (d.argueso@uib.es): designed and performed calculations to generate historical and pseudo-global warming boundary conditions; coded postprocessing scripts.<br/> ·        Nicolas Jourdain (nicolas.jourdain@univ-grenoble-alpes.fr): designed and performed calculations to generate pseudo-global warming boundary conditions.<br/> ·        Jason Evans (jason.evans@unsw.edu.au): installed and setup the model in the NCI supercomputer, helped on the design and performance of simulations.</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><Main contact, if relevant specify a contact for scientific questions and one for file access></span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Contact: di_luca.alejandro@uqam.ca for any question on the dataset content and provenance<br/>          paola.petrelli@utas.edu.au for questions or issues with file accessibility</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><Dataset citation, this should always include the dataset doi> </span></span>
<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Citation: <br/>     Di Luca, Alejandro, Argueso, D., Jourdain, N., Evans, J., 2021. High-Resolution Modelling of Extreme Storms over the East Coast of Australia v1.0. NCI National Research Data Collection, doi:10.25914/604eb7628b4e7</samp></div>
<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Other information you can include which was not present in this particular example are</span></span>

*<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">References list, if you are citing other sources in the description</span></span>
*<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Associated paper/s for publications that are based on the dataset</span></span>

← Older revision		Revision as of 05:46, 14 July 2021
Line 33:		Line 33:
	*<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Associated papers for publications that are based on the dataset</span></span>		*<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Associated papers for publications that are based on the dataset</span></span>

−	~~[[Category:Data]]~~[[Category:Data induction]]	+
		+
		+	[[Category:Data induction]]

@@ Line 1: / Line 1: @@
 <span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">A good readme file attached to your published data is a useful tool for a potential user.&nbsp;If they have found the data online by downloading the readme file they can keep the data&nbsp;description and publications details together with the data. If they are using the data directly&nbsp;on the server where the data is stored, then they can get the information on the dataset without having to go online.</span></span>
@@ Line 33: / Line 31: @@
 *<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">References list, if you are citing other sources in the description</span></span>
 *<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Associated papers&nbsp;for publications that are based on the dataset</span></span>

@@ Line 1: / Line 1: @@
 {{Template:Working on}}
@@ Line 22: / Line 23: @@
 <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>This dataset was created by Dr Alejandro Di Luca as part of the Australian Research Council (ARC) Discovery Early Career Researcher Award (DECRA) funded project (DE170101191) and is part of the Centre of Excellence for Climate Extremes (CLEX) Extreme Rainfall research program.</samp></div>
 <span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;"><where to find the data online and how the data is organised on&nbsp;the server></span></span>
-<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>The data is available online on the NCI TDS server:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>&nbsp; https://dapds00.nci.org.au/thredds/catalogs/ks32/CLEX/HiRes-MESECA/HiRes-MESECA.html</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>and for NCI users in the ks32 project.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>File organisation:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>&nbsp; /g/data/ks32/CLEX_Data/HiRes-MESECA/v1-0/<resolution>/<event>/<boundary conditions>/<physics>/<frequency>/<variable>/<files></samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>where<br/> &nbsp; &nbsp; <resolution> is WRF24, WRF8 and WRF2 for horizontal grid resolution of 24 km, 8 km and 2 km, respectively&nbsp;<br/> &nbsp; &nbsp; <event> is the starting date of each event<br/> &nbsp; &nbsp; <boundary conditions> are FUT, FUT-THERMO, HIST and HIST-BRAN<br/> &nbsp; &nbsp; <physics> are CONTROL, CU, MPS, PBL and RAD&nbsp;<br/> &nbsp; &nbsp; <frequency> are 6hr, 3hr, 1hr</samp><br/> &nbsp;</div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>filenames:<br/> &nbsp; &nbsp;<variable>_HiRes-MESECA_UNSW-WRF360-i1_<resolution>_<event>_<boundary conditions>_<physics>_<frequency>_v1-0.nc</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Example: va200_HiRes-MESECA_UNSW-WRF360-i1_WRF2_2001-07-23_FUT_CTL_6hr_v1-0.nc</samp></div>
+<div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>The data is available online on the NCI TDS server:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>&nbsp; [https://dapds00.nci.org.au/thredds/catalogs/ks32/CLEX/HiRes-MESECA/HiRes-MESECA.html https://dapds00.nci.org.au/thredds/catalogs/ks32/CLEX/HiRes-MESECA/HiRes-MESECA.html]</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>and for NCI users in the ks32 project.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>File organisation:</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>&nbsp; /g/data/ks32/CLEX_Data/HiRes-MESECA/v1-0/<resolution>/<event>/<boundary conditions>/<physics>/<frequency>/<variable>/<files></samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>where<br/> &nbsp; &nbsp; <resolution> is WRF24, WRF8 and WRF2 for horizontal grid resolution of 24 km, 8 km and 2 km, respectively&nbsp;<br/> &nbsp; &nbsp; <event> is the starting date of each event<br/> &nbsp; &nbsp; <boundary conditions> are FUT, FUT-THERMO, HIST and HIST-BRAN<br/> &nbsp; &nbsp; <physics> are CONTROL, CU, MPS, PBL and RAD&nbsp;<br/> &nbsp; &nbsp; <frequency> are 6hr, 3hr, 1hr</samp><br/> &nbsp;</div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>filenames:<br/> &nbsp; &nbsp;<variable>_HiRes-MESECA_UNSW-WRF360-i1_<resolution>_<event>_<boundary conditions>_<physics>_<frequency>_v1-0.nc</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Example: va200_HiRes-MESECA_UNSW-WRF360-i1_WRF2_2001-07-23_FUT_CTL_6hr_v1-0.nc</samp></div>
 <span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">&nbsp;< if there is more than one author and/or collaborators list the names and their roles in regard to the data></span></span>
 <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Author:<br/> &nbsp;· Alejandro Di Luca: designed and performed calculations to generate historical and pseudo-global warming boundary conditions; conceived, designed and performed all simulations; coded and run postprocessing scripts.</samp></div> <div style="background:#eeeeee;border:1px solid #cccccc;padding:5px 10px;"><samp>Contributors:<br/> · &nbsp; &nbsp; &nbsp; &nbsp;Daniel Argueso (d.argueso@uib.es): designed and performed calculations to generate historical and pseudo-global warming boundary conditions; coded postprocessing scripts.<br/> · &nbsp; &nbsp; &nbsp; &nbsp;Nicolas Jourdain (nicolas.jourdain@univ-grenoble-alpes.fr): designed and performed calculations to generate pseudo-global warming boundary conditions.<br/> · &nbsp; &nbsp; &nbsp; &nbsp;Jason Evans (jason.evans@unsw.edu.au): installed and setup the model in the NCI supercomputer, helped on the design and performance of simulations.</samp></div>
@@ Line 32: / Line 33: @@
 *<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">References list, if you are citing other sources in the description</span></span>
-*<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Associated paper/s for publications that are based on the dataset</span></span>
+*<span style="font-size:medium;"><span style="font-family:Arial,Helvetica,sans-serif;">Associated papers&nbsp;for publications that are based on the dataset</span></span>