Ancillary Data Sets Used for ADL and CSPP Product Generation ------------------------------------------------------------ Kathleen Strabala kathy.strabala@ssec.wisc.edu Space Science and Engineering Center University of Wisconsin-Madison 5 July 2013 The entire set of leading edge and archived ancillary data sets used by the CSPP and some ADL software is available from this web site: https://jpssdb.ssec.wisc.edu/ancillary/ These files are selected and downloaded automatically if required by any of the JPSS CSPP SDR or EDR algorithms. Descriptions of files in daily directories follows: ------------------------------------------------------------------------------- Name: Daily Two Line Element Files (TLE Files) Blob and Ascii Files Example File Names: 4fe9f2c6-a2a28-6880dc6d-f929ca0b.TLE-AUX_npp_20120626140339Z_20120626000000Z_ee00000000000000Z_-_c3s-_ops_all-_ops 4fe9f2c6-a2a28-6880dc6d-f929ca0b.asc Required for VIIRS, ATMS and CrIS SDR creation File Description: The Blob files is a binary file that contains two lines of information about the Suomi Keplerian orbital elements. The accompanying .asc file contains metadata including the Effectivity date range. These files are created daily except for weekends and holidays. These files are converted from the .h5 files that are distributed through NOAA CLASS - http://www.class.ngdc.noaa.gov/saa/products/welcome ------------------------------------------------------------------------------- Name: Weekly Polar Wander Blob and Ascii Files Example File Names: 4fe4cc2e-a2c1f-6880dc6d-8988aaea.off_USNO-PolarWander-UT1-ANC_Ser7_USNO_000f_20120622_201206221200Z_20120622000005Z_ee20120629120000Z_np.bin_Internal 4fe4cc2e-a2c1f-6880dc6d-8988aaea.asc Required for VIIRS, ATMS and CrIS SDR creation File Description: The Polar Wander file describes the relationship of changes in the spin axis to the hemispherical assymetry. The Blob file is a binary file and the .asc file contains the metadata including the Effectivity date range. These files are available once per week. These files are converted from the .h5 files that are distributed through NOAA CLASS - http://www.class.ngdc.noaa.gov/saa/products/welcome ------------------------------------------------------------------------------- Name: The Near Real-Time SSM/I EASE-Grid Daily Global Ice Concentration and Snow Extent (NISE) Example File Name: NISE_SSMISF17_20120613.HDFEOS Required for VIIRS EDR Products File Structure Description: Each file contains NISE snow/ice extent on 721x721 northern and southern hemisphere azimuthal grids. The file is in HDF-EOS format. Record/Line Format: Snow/ice extent for the northern and southern hemispheres stored in separate HDF-EOS Grid objects. Product Description: The Near Real-Time SSM/I EASE-Grid Daily Global Ice Concentration and Snow Extent (NISE) product is generated by the National Snow and Ice Data Center (http://nsidc.org). This data set was originally designed to provide NASA EOS researchers with near real-time, daily, global snow extent and sea ice concentration data. The MODIS Instrument Team uses the NISE data as input to their products. Data access is unrestricted but users are strongly encouraged to register with NSIDC as users of the data. Registered users automatically receive notification of changes in the product-generation algorithm and of modifications in data manipulation and formatting. Registered users automatically receive E-mail notification of any data production problems. NSIDC requests that prospective data users explain how the data will be used and agree to contribute comments regarding the usefulness, relevance, and accuracy of the data. Such feedback is essential to ensure ongoing product improvement. A link to register for the data and read more about the product can be found at: http://nsidc.org/data/nise1.html ------------------------------------------------------------------------------ Name: 6 hourly Global Data Assimilation System T126 resolution analysis from NCEP at 1 degree resolution Example File Name: gdas1.pgrb00.1p0deg.20120613_00_000.grib2 gdas1.pgrb00.1p0deg.YYYYMMDD_HH_000.grib2 Where: YYYY is the year, MM is the month, DD is the day, HH is the model run time (00,06,12 or 18) Required for VIIRS EDR Products For more information about the models and files, please see: http://www.nco.ncep.noaa.gov/pmb/products/gfs/#GDAS These files are created 4 times per day and staged at these sites: ftp://ftp.ncep.noaa.gov/pub/data/nccf/com/gfs/prod/gdas.YYYYMMDD http://www.ftp.ncep.noaa.gov/data/nccf/com/gfs/prod/gdas.YYYYMMDD These are the files that are used in anything other than real-time processing. In real time, the data will be processed using the GFS forecast model files, since these analysis files are not available until 6-9 hours after the model run time. File naming conventions at the above sites: eg: gdas1.t00z.pgrbanl.grib2 File Type: Binary GRIB2 File Content Description: 6 hourly Global Data Assimilation System T126 resolution analysis from NCEP. File Structure Description: Each file contains fields of z, u, v, temp, vert vel, rh, and absolute vorticity, most of which are on 26 mandatory pressure levels (1000 - 10mb). vv is on 1000-100mb and rh is on 1000-300mb. There are additional single level fields as well, for example, boundary level winds, temps, and rh, trop temp, pressure and winds. The grid is a 1 x 1 deg global grid (GRIB grid #3). ------------------------------------------------------------------------------ Name: 3 hourly Global Forecast System (GFS) Numerical Weather Prediction Fields for NPP at half degree resolution Example File Name: gfs.press_gr.0p5deg_pt.20120613_00_018.npoess.grib2 gfs.press.gr.0p5deg_pt.YYYYMMDD_HH_0XX.npoess.grib2 Where: YYYY is the year, MM is the month, DD is the day, HH is the model run time (00,06,12 or 18), XX is the model run time step (3 hourly, 03-24) Required for VIIRS EDR processing In real time data processing, these GFS model files will be used since the GDAS analysis files are not available until 6-9 hours after the model run time. For more information about these files, please see: JPSS Common Interfaces and Services Interface Control Document Volume 1 JPSS CDFCB - External - Volume VI - Ancillary Data, Auxiliary Data, Messages, and Reports both can be found at: http://npp.gsfc.nasa.gov/science/documents.html These files also distributed through this site: https://msds.npoess.noaa.gov/MSDS/ANC/ODAD/ with file names like: off_NCEP-GFS-03HR-ANC_GFS_NCEP_003f_20120607_201206071800Z_20120607213027Z_ee20120608000000Z_np.grib2 ---------------------------------------------------------------------------- Name: Daily Global Modelled Sea Ice Concentration from NCEP at 0.5 degree resolution Example File Name: eng.YYYYMMDD Where: YYYY is the year, MM is the month, DD is the day, Required for VIIRS Sea Surface Temperature EDR Product For more information about the models and files, please see: http://polar.ncep.noaa.gov/seaice/index.html These files are created once a per day and staged at these sites: ftp://polar.ncep.noaa.gov/pub/cdas/ During a month, each day's GRIB file will be placed here. After the end of the month, the entire month's data will be concatenated to a single file and put in the archive subdirectory ftp://polar.ncep.noaa.gov/pub/cdas/archive/ File naming conventions at the above sites: eg: eng.YYYYMMDD File Type: Binary GRIB File Content Description: Daily Global Modelled Sea Ice Concentration from NCEP at 0.5 degree resolution File Structure Description: Each file contains a single grib message... 1:Ice cover (1=land, 0=sea):(0 - 1) (instant):regular_ll:meanSea:level 0:fcst time 0 :from 201303020000 Values are stored as fractional concentration -- 0.00 to 1.00 for ice cover. In the analyst's grids, values of up to 1.28 are possible, and seem to relate to physical processes. Most users will want to reset all values between 1.00 and 1.28 to 1.00. In the modeller's grid, this is already done. Flag values which may be encountered: 1.57 -- Land 1.95 -- Coast 1.66 -- Weather 2.24 -- No data The modeller's grid sets ice concentrations to zero over land currently. This has not always been the case, and the archive has not yet been corrected to reflect this current practice. Ice concentrations over 'coastal' points are and always have been given. In ideal circumstances, these values would not be used. In order to aid usage of the grids, the land mask is available in ftp://polar.ncep.noaa.gov/seaice/ice/halfdeg.map. This is a 720x360 array of unsigned characters, which carry the flags noted above for land and coast masking.