12/28/2017 The nine daily netcdf fields were created on discover by running the grads scripts currently in /gpfsm/dhome/jacarton/merra2/execs/daily/1980-2017 which produce a daily average from the 24 hourly analysis fields. Then the cdo routine import_binary, e.g.: cdo -b F32 -f nc4 import_binary lwgab.ctl /gpfsm/dnb32/jacarton/lwgab-1980-2017.nc was run to create nc4 files and these were sftp'd to: /aosc/indian/carton/merra2/daily_data/1980-2017. Finally, each field was compared to the corresponding field in /aosc/indian/carton/merra2/daily_data/1980-2015 to ensure that the downloads are correct. This procedure showed that there was an erroneous 1dy shift in a single older file: /1980-2015/merra2_precsnoocn_1980-2015.nc 12/28/2017 I checked the min and max of three fields: precsonocn (0 to 0.003), rainocn (0 to 0.01), and qv2m (e-7 to 0.03). All seem within reasonable limits so there was no need to filter. 10/14/2018 I downloaded the nine daily average forcing files for 01/2010 through something like 08/2010 onto NOBACKUP on discover. I converted them to NetCDF and ftp'd them to atlantic. I then combined them with the files on /aosc/greenland/forcing/merra2 which stopped in mid-2017, and checked for range and missing values as follows: #combine new files with the original files setenv SKIP_SAME_TIME "1" cdo mergetime lwgab-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_lwga_1980-2017.nc merra2_lwga_1980-2017full.nc cdo mergetime qv2m-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_qv2m_1980-2017.nc merra2_qv2m_1980-2017full.nc cdo mergetime swgdn-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_swgdn_1980-2017.nc merra2_swgdn_1980-2017full.nc cdo mergetime u10m-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_u10m_1980-2017.nc merra2_u10m_1980-2017full.nc cdo mergetime precsnoocn-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_precsnoocn_1980-2017.nc merra2_precsnoocn_1980-2017full.nc cdo mergetime rainocn-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_rainocn_1980-2017.nc merra2_rainocn_1980-2017full.nc cdo mergetime slp-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_slp_1980-2017.nc merra2_slp_1980-2017full.nc cdo mergetime t2m-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_t2m_1980-2017.nc merra2_t2m_1980-2017full.nc cdo mergetime v10m-2010-2017.nc /aosc/greenland/forcing/merra2/merra2_v10m_1980-2017.nc merra2_v10m_1980-2017full.nc #check for odd extremes and missing values (probably unnecessary, but...) cdo setvrange,0,500 merra2_lwga_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_lwga_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_lwga_1980-2017full.nc cdo setvrange,0,0.03 merra2_qv2m_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_qv2m_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_qv2m_1980-2017full.nc cdo setvrange,0,500 merra2_swgdn_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_swgdn_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_swgdn_1980-2017full.nc cdo setvrange,-50,50 merra2_u10m_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_u10m_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_u10m_1980-2017full.nc cdo setvrange,0,0.01 merra2_precsnoocn_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_precsnoocn_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_precsnoocn_1980-2017full.nc cdo setvrange,0,0.01 merra2_rainocn_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_rainocn_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_rainocn_1980-2017full.nc cdo setvrange,90000,110000 merra2_slp_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_slp_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_slp_1980-2017full.nc cdo setvrange,150,350 merra2_t2m_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_t2m_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_t2m_1980-2017full.nc cdo setvrange,-50,50 merra2_v10m_1980-2017full.nc temp.nc cdo setmisstonn temp.nc merra2_v10m_1dy_1-1980-8-2017.nc rm temp.nc rm merra2_v10m_1980-2017full.nc # create monthly fields to allow for easier checking of the fields cdo monmean merra2_lwga_1dy_1-1980-8-2017.nc merra2_lwga_mn_1-1980-8-2017.nc cdo monmean merra2_qv2m_1dy_1-1980-8-2017.nc merra2_qv2m_mn_1-1980-8-2017.nc cdo monmean merra2_swgdn_1dy_1-1980-8-2017.nc merra2_swgdn_mn_1-1980-8-2017.nc cdo monmean merra2_u10m_1dy_1-1980-8-2017.nc merra2_u10m_mn_1-1980-8-2017.nc cdo monmean merra2_precsnoocn_1dy_1-1980-8-2017.nc merra2_precsnoocn_mn_1-1980-8-2017.nc cdo monmean merra2_rainocn_1dy_1-1980-8-2017.nc merra2_rainocn_mn_1-1980-8-2017.nc cdo monmean merra2_slp_1dy_1-1980-8-2017.nc merra2_slp_mn_1-1980-8-2017.nc cdo monmean merra2_t2m_1dy_1-1980-8-2017.nc merra2_t2m_mn_1-1980-8-2017.nc cdo monmean merra2_v10m_1dy_1-1980-8-2017.nc merra2_v10m_mn_1-1980-8-2017.nc 5-9-2019 The nine daily netcdf fields were created on discover by running the grads scripts currently in /gpfsm/dhome/jacarton/merra2/execs/daily/2017-2018 which produce a daily average from the 24 hourly analysis fields. Then the cdo routine import_binary, e.g.: cdo -b F32 -f nc4 import_binary lwgab.ctl /gpfsm/dnb32/jacarton/lwgab-2017-2018.nc was run to create nc4 files and these were sftp'd to: /aosc/horse/carton 5-9-2019 The daily data was merged with the older files using: setenv SKIP_SAME_TIME 1 cdo mergetime /aosc/greenland/forcing/merra2/merra2_lwga_1dy_1-1980-8-2017.nc lwgab-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_lwga_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_precsnoocn_1dy_1-1980-8-2017.nc precsnoocn-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_precsnoocn_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_qv2m_1dy_1-1980-8-2017.nc qv2m-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_qv2m_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_rainocn_1dy_1-1980-8-2017.nc rainocn-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_rainocn_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_slp_1dy_1-1980-8-2017.nc slp-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_slp_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_swgdn_1dy_1-1980-8-2017.nc swgdn-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_swgdn_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_t2m_1dy_1-1980-8-2017.nc t2m-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_t2m_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_u10m_1dy_1-1980-8-2017.nc u10m-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_u10m_1dy_1-1980-1-2019.nc cdo mergetime /aosc/greenland/forcing/merra2/merra2_v10m_1dy_1-1980-8-2017.nc v10m-2017-2018.nc /aosc/greenland/forcing/merra2/merra2_v10m_1dy_1-1980-1-2019.nc and then the older files were moved to ./junk/ 8-27-2019 Gena pointed out that precsnoocn had NAN values over land beginning in September, 2018 for some reason. I got rid of them by running: cdo setmisstonn merra2_precsnoocn_1dy_1-1980-1-2019.nc merra2_precsnoocn_1dy_1-1980-1-2019_new.nc Then I moved merra2_precsnoocn_1dy_1-1980-1-2019.nc to ./junk/ 8-27-2019 The corrected files: /aosc/greenland/forcing/merra2/merra2_lwgab_corrected_1980-2019_new.nc /aosc/greenland/forcing/merra2/merra2_rainocn_corrected_1980-2019_new.nc were createdd. These files are extention merra2_lwgab_corrected_1980-2017_new.nc and merra2_rainocn_corrected_1980-2017_new.nc up to 2018 and cover 1jan1980-1jan2019 time. Files were created by merra2_heat_bias_correction_mld_short.gs and merra2_rain_bias_correction_mld_short.gs GRADS's scripts.