• Visit our Facebook page
  • Visit our Twitter feed
  •     NASA Home
  •     >    Goddard Home
  •     >    Direct Readout Laboratory
  •     >    Highlights Archive
Click here for information on the NASA Direct Readout Conference (NDRC) Webinar

Direct Readout Laboratory

Highlights Archive

2018 Highlights

IPOPP v3.0 Released - 12/6/2018

The DRL is pleased to announce the release of the International Planetary Observation Processing Package (IPOPP) Version 3.0.  IPOPP v3.0 produces NOAA-20 (JPSS-1) and SNPP VIIRS, CrIS, ATMS, and OMPS output, as well as Terra/Aqua MODIS output.
Enhancements to IPOPP v3.0 include:
  • Automatic IPOPP Dashboard configuration update upon installation of a new or updated Science Processing Algorithm (SPA) or software patch. To ensure IPOPP Dashboard synchronization with the processing science algorithm suite users must update their IPOPP installations with the most current SPA releases, SPA patches, and IPOPP patches. The latest available DRL software releases are available at:https://directreadout.sci.gsfc.nasa.gov/?id=software. The Revision Level entry indicates the latest patch available for each release. Refer to Appendix E, "Installing/Updating/Configuring SPAs.”
  • Fully autonomous ancillary retrievals via FTPS to ensure seamless transition once FTP is phased out by NASA in compliance of US Government IT Security guidelines.  Users are required to update to IPOPP 3.0 due to these enhanced security protocols, otherwise processing will cease.
  • IPOPP installation and features improved for error handling/reporting thereby enhancing user experience.
  • Improved interface when running IPOPP without an Internet connection (e.g., increasing number of users operating in secure network environment without direct external connectivity).
This processing package contains both the data processing framework and select SPAs to form a generalized autonomous data processing basis that may be uniquely value-added by our commercial colleagues and power users. The generalized architecture has been demonstrated by users as a basis for algorithm evaluations for providing feedback to science teams; heterogeneous implementation where the core resource management is verbose and easily referenced yielding ambiguity mitigation when performing detailed inter-comparisons.
 
IPOPP ingests NOAA-20 and SNPP Raw Data Record (RDR), NOAA-20 and SNPP Visible Infrared Imaging Radiometer Suite (VIIRS) and Ozone Mapping Profiler Suite (OMPS) Production Data Set (PDS) files, and Terra/Aqua PDS files to produce higher level data products. For real-time processing, IPOPP automates multi-level processing of the ingested raw data and produces NOAA-20 and SNPP Sensor Data Records (SDRs), NOAA-20 and SNPP Environmental Data Records (EDRs), and Terra/Aqua Level-1 and Level-2 products. IPOPP also ingests RDR, PDS and SDR files from their respective global processing archives to produce higher level products locally.
 
IPOPP v3.0 includes the following SNPP and NOAA-20 (JPSS-1) era SPAs still available in standalone form (standalone under consideration for deprecation) or as an IPOPP plug-in, which are based on JPSS ADL software in support of legacy IPOPP users.  Special thanks to the Land, Atmosphere, Ocean and Ozone Science Teams for their guidance:
  • C-SDR, to produce VIIRS, CrIS and ATMS mission-compliant HDF5 SDR and Geolocation swath products
  • Cloud Mask, to produce the VIIRS Cloud Mask product;
  • Aerosol, to produce the VIIRS Aerosol Optical Thickness (AOT), Aerosol, Suspended Matter, Aerosol Model Information, and the Aerosol Geolocation;
  • Surface Reflectance (SurfReflect), to produce the VIIRS Surface Reflectance;
  • Vegetation Index (VegIndex), to produce the VIIRS Vegetation Index;
  • Cloud Optical Properties (COP), to produce the VIIRS Cloud Optical Properties and the VIIRS Ice & Night Water Cloud Top Temperature;
  • Snow Cover (SnowCov), to produce the VIIRS Snow Cover Binary Map and VIIRS Snow Cover Fraction;
  • Land Surface Temperature (LST), to produce the VIIRS Land Surface Temperature;
  • CVIIRS, to produce the VIIRS Corrected Reflectance;
  • VIIRS-AF, to produce VIIRS Active Fires/Fire Mask;
  • GTMImagery, to produce the VIIRS GTM Imaging Band Imagery EDR; VIIRS GTM Moderate Band Imagery EDR; and VIIRS GTM Near Constant Contrast (NCC) Band Imagery EDR;
  • L2GEN, to produce the VIIRS Level 2 Ocean Color (including Chlor-a) and Sea Surface Temperature (SST)
  • OMPSnadir, to produce Total Column SO2, UV Aerosol Index, Total Column Ozone and Effective Surface Reflectivity (RT-STPS 5.6 or later required);
  • HDF to GeoTIFF (H2G), to create GeoTIFFs from HDF4 and HDF5 products, while also providing capability (via configuration file) to produce value-added products and imagery as input to decision support systems.
  • BlueMarble, to create MODIS sharpened True Color and Natural Color imagery; VIIRS sharpened True Color and Natural Color imagery; VIIRS Enhanced Near Constant Contrast (ENCC) day and night imagery; and overlays of OMPS SO2 and OMPS Ultraviolet Aerosol on True Color, Natural Color or ENCC geotiff imagery.
IPOPP v3.0 also includes the latest versions of these Terra/Aqua SPAs now available in standalone form or as an IPOPP plug-in.  Special thanks to OBPG, CIMSS, and the MODIS Land Team for their science-sanctioned algorithm contributions:
  • MODISL1DB, to produce the MODIS Geolocated/Calibrated product;
  • CREFL, to produce the MODIS Corrected Reflectance;
  • GBAD, to produce ephemeris and attitude files (input for Aqua L1);
  • IMAPP, to produce the MODIS Level 2 Cloudmask, Cloudtop Properties, Cloud Phase, Atmospheric Profiles, and Aerosol;
  • L2GEN, to produce the MODIS Level 2 Ocean Color (including Chlor-a) SST;
  • MOD14, to produce the MODIS Level 2 Fire Mask;
  • MODLST, to produce the MODIS Level 2 Land Surface Temperature (LST);
  • NDVIEVI, to produce the MODIS Level 2 Normalized Difference Vegetation Index (NDVI) and Enhanced Vegetation Index (EVI);
  • HDF to GeoTIFF (H2G), to create GeoTIFFs from HDF, while also providing capability (via configuration file) to produce value-added products and imagery as input to decision support systems.
  • BlueMarble, to create MODIS sharpened True Color and Natural Color imagery; VIIRS sharpened True Color and Natural Color imagery; VIIRS Enhanced Near Constant Contrast (ENCC) day and night imagery; and overlays of OMPS SO2 and OMPS Ultraviolet Aerosol on True Color, Natural Color or ENCC geotiff imagery.
New or updated algorithms from various sources may be integrated seamlessly into the IPOPP framework.  And NASA Science has been enhanced by the relationships with international collaborators (e.g., Alpha Program Users).  Special thanks to the contributions by the Alpha Program Users!
 
Click here to  access IPOPP v3.0.
Click here to access the IPOPP v2.6 User Guide.
Click here to experience the MyDRL Forums.
Follow the DRL on Facebook and Twitter.
 
 

C-SDR SPA v2.5 Released - 10/25/2018

The DRL is pleased to announce the release of C-SDR SPA v2.5.  The Common Sensor Data Record Science Processing Algorithm (C-SDR_SPA) processes NOAA-20 (JPSS-1) and SNPP VIIRS, ATMS and CrIS Raw Data Record (RDR) files into corresponding instrument-specific and mission-compliant HDF5 SDR variable or single granule output. The C-SDR accepts RDRs produced by the RT-STPS and by the NOAA CLASS.  The SPA functions in two modes:  Standalone, or as an IPOPP plug-in (IPOPP v2.6 or later required). 
 
Enhancements to this SPA include:
  • Updated algorithms to Block 2.0 ADL 5.3.19, IDPS I2.1.01.00 baseline, with all Direct Readout (DRO) extensions applied.
  • Modified Block 2.0 Algorithm Development Library (ADL) framework code to suppress network connections to the local system (IDPS-specific artifact), and remove the need to define the system’s Fully-qualified Domain Name (FQDN) in the system’s hosts file.  Thanks to the users that have raised this matter as a significant inconvenience!
  • Updated SNPP/JPSS-1 ATMS, CrIS, CrIS FS, and VIIRS Look-up Tables (LUTs). JPSS-1 LUTs have been updated to latest versions and are autonomously refreshed via IPOPP.
  • Updated test data and scripts for SNPP and JPSS-1 ATMS, CrIS, CrIS FS, and VIIRS. JPSS-1 test data have been updated to latest versions.
Note:  The C-SDR SPA is created using the ADL, which has been configured by the SNPP/JPSS algorithm team and the DRL yielding unique robustness (mitigating calibration issues in the presence of transient reception issues) for regional/real-time applications.  It is encouraged that users update to this version of the SDR algorithms to achieve highest fidelity while ensuring transparency for any HRD downlink reconfiguration plans to-date. 
 
Click here  to access C-SDR SPA v2.5.
Click here to access the C-SDR SPA v2.5 User's Guide.
Follow the DRL on Facebook and Twitter.
Click here to collaborate via the MyDRL Forums.
 

L2GEN SPA v9.3.0 Released - 8/28/2018

The DRL is pleased to announce the release of the L2GEN SPA v9.3.0.  The L2GEN algorithm suite is from the Ocean Biology Processing Group’s (OBPG) SeaWiFS Data Analysis System (SeaDAS) and has been adapted to execute for real-time applications within NASA’s International Planetary Observation Processing Package (IPOPP).  This L2GEN Science Processing Algorithm (SPA) configuration produces MODIS Level 2 Ocean Color and Sea Surface Temperature (SST) products from MODIS Level 1B products, the MODIS Terrain Corrected Geolocation product, and other optional ancillary files.  This SPA also produces VIIRS Level 2 Ocean Color (OC) and Sea Surface Temperature (SST) products from VIIRS Sensor Data Record (SDR) products (future: NASA VIIRS Level 1B inputs), the VIIRS Terrain Corrected Geolocation product, and optional ancillaries.
 
Enhancements to this SPA include:
  • update to version 9.3.0 of the OBPG l2gen algorithm;
  • updated parameter files, test scripts, and test data;
  • updated input file labels for VIIRS ancillaries (ncep_met_*, obpg.noaa_toast_*) to make them consistent with MODIS ancillary file labels;
  • preliminary framework implementation for NOAA-20 (JPSS-1) VIIRS processing.
 
SPAs function in two modes: Standalone, or as an International IPOPP plug-in (IPOPP v2.6 or later required).  

Note: Please be aware that due to limited resources, as well as the many variables that impact data product scientific integrity, the DRL is considering no longer supporting the Standalone Mode for SPA processing.  Feel free to contact us with any questions or concerns.
 
The L2GEN was developed by the OBPG as NASA Science Investigator-led Processing System (SIPS) algorithms.
Click here to access L2GEN SPA v9.3.0.
Click here to access the L2GEN SPA v9.3.0 User's Guide.
Follow the DRL on Facebook and Twitter.
Click here to experience the MyDRL Forums.
 

H2G SPA v2.5 Released - 6/27/2018

The DRL is pleased to announce the release of the H2G_SPA (Version 2.5).
The H2G_SPA (Hierarchical Data Format [HDF] to Georeferenced Tagged Image File Format [GeoTIFF] Converter Science Processing Algorithm) is designed specifically for real-time applications to create geolocated GeoTIFF images, jpeg browse images, and png browse images for parameter datasets in NOAA-20 (JPSS-1), SNPP, and EOS (Terra/Aqua) products.  H2G also creates standard true color images from supported VIIRS and MODIS science products.   The H2G_SPA functions in two modes:  Standalone, or as an IPOPP plug-in (IPOPP v2.6 required).
 
The H2G_SPA incorporates features to enhance output from standard science products thereby facilitating scientific interpretation for broader applications:
  • 186 pre-configured image products spanning multiple missions, multiple instruments, and multiple disciplines.
  • Emphasis on GIS-ingestible GeoTIFF output; useful for bridging RT and NRT decision support systems.
  • Pre-defined color map and scales for appropriate science product representation.
  • Choice of either geographic or stereographic projection for the output image.  Based on user requests, inclusion of other projections is under consideration.
  • Use of appropriate land/water masks when applicable for better science product representation.
  • Subsetting of swaths into user-defined regions of interest.
  • Mosaicing of multiple swaths.
  • jpeg and png browse images with legends, vector overlays, latitude/longitude overlays and legends.
  • Flagged pixel overlays on H2G geotiffs (e.g., fire pixel overlays on True Color image).
  • The capability exists to customize H2G for user-defined parameter scales, colormaps and masks.  Documentation can be made available on request for unique application. 
Enhancements to H2G_SPA v2.5 include:
  • Added support for NOAA-20 (JPSS-1) VIIRS/ATMS/CrIS image processing.
  • Updated testdata and testscripts.
  • The capability to generate high resolution VIIRS and MODIS imagery was migrated to the BlueMarble SPA for producing sharpened True Color imagery, which allows VIIRS/MODIS-scan-geometry consistent high resolution products.
  • Improved fire mask presentation based on the VIIRS-AF and VFIRE375 SPAs. 
Click here to access H2G SPA v2.5.
Click here to access the H2G SPA v2.5 User's Guide.
Follow the DRL on Facebook and Twitter.
Click here to experience the MyDRL Forums.

RT-STPS v6.0 Patch 1 Released - 2/27/2018

The DRL is pleased to announce the release of Patch 1 for the RT-STPS v6.0 package.  Patch 1 enables real-time visualization of JPSS-1/NOAA-20 VIIRS data using Simulcast v6.0, which is downstream of the pre-processor, RT-STPS, and accepts the on-orbit instrument data in real-time to single or multiple destinations simultaneously. 
 
The Real-time Software Telemetry Processing System (RT-STPS) is a Java real-time application that ingests real-time telemetry data from a spacecraft transmission via TCP socket or from an equivalent demodulated file, performs multi-mission protocol processing including link-layer artifact corrections, provides data integrity statistics, and produces output to a file or TCP/IP socket.
 
RT-STPS is preconfigured to enable the Real-Time Community to acquire transmissions from Terra/Aqua, SNPP and JPSS-1, and produce output in numerous file formats.  The preconfigured output formats are: Raw Data Records (RDRs) for the SNPP and JPSS-1 VIIRS, CrIS ATMS, and OMPS instruments; as well as Production Data Sets (PDS) for these SNPP instruments, Terra MODIS, and Aqua MODIS, AIRS, AMSR, AMSU, and CERES instruments.
 
Simulcast is a multi-mission tool that enables a user to select and view quicklook instrument data (JPSS-1/SNPP VIIRS as well as Aqua/Terra MODIS) in real time with a single Viewer, thus providing a valuable real-time data quality assessment utility (e.g., Global Mission Operations, Regional Ground Station Operations).
 
Simulcast processes and visualizes instrument data in real time, and accepts as input CCSDS packet streams (e.g., RT-STPS). Simulcast provides real-time geolocation and pseudo-calibration, and projects data on Mercator and Polar maps.  Simulcast can replay recent satellite passes, export displayed images to JPEG format, and save replayed passes to AVI/Quicktime movies. 
 
The RT-STPS and Simulcast packages were previously verified as elements of the JPSS-1/NOAA-20 Spacecraft Integration and Test Team, and again during the on-orbit direct broadcast (HRD) commissioning.
 
Click here to access RT-STPS v6.0 Patch 1 and Simulcast v6.0.
Click here to access the RT-STPS v6.0 and Simulcast v6.0 User's Guides.
Follow the DRL on Facebook and Twitter.
Click here to experience the MyDRL Forums.

2017 Highlights

2016 Highlights

2015 Highlights

2014 Highlights

2013 Highlights

2012 Highlights

2011 Highlights

2010 Highlights

2009 Highlights

2008 Highlights

2007 Highlights

2006 Highlights

Old Highlights