Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Online domain check for satellite radiance data #224

Open
xyzemc opened this issue Nov 15, 2024 · 0 comments
Open

Online domain check for satellite radiance data #224

xyzemc opened this issue Nov 15, 2024 · 0 comments
Assignees

Comments

@xyzemc
Copy link
Contributor

xyzemc commented Nov 15, 2024

The online domain check filter has been tested for atms_npp, atms_n20, and amsua_n19. The yaml file for applying domain check for satellite radiance is as bellow:

   - filter: Bounds Check
     filter variables:
     - name: brightnessTemperature
       channels: *atms_npp_channels
     test variables:
     - name: GeoVaLs/observable_domain_mask
       flag all filter variables if any test variable is out of bounds: true
       minvalue: 0.0
       maxvalue: 0.5

Example: atms_n20
Before QC:
image

After QC:
image

In the above figures, the dark blue color represent the data kept after domain check. So the data points outside of the domain are still kept in hofx file and filled with missing value, instead of completely removed. The previous 'circle domain check' filter does not remove the data outside of the domain either. With the filtered data kept in the memory, the size of output hofx file become very large. We need to address this problem with a long-term solution considering the operational implementation.

@xyzemc xyzemc self-assigned this Nov 15, 2024
hu5970 pushed a commit that referenced this issue Dec 13, 2024
This PR is going to merge the ATMS NOAA_20 JEDI yaml file into RDASApp validated yaml file templates.

As the test in issue #203, atms_n20 data has been tested in MPAS_JEDI including all QC filters and bias correction. Not only the ioda data converted from regular feed bufr data has been tested, but also the ioda data converted from combined regular feed, DBNet, and ESRs bufr data has been tested too.

In addition, this atms_n20 yaml file has included the online domain check filters as described in and issue #224, and removed the 'circle domain check' filter
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant