Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update renders metadata for NLCD* collections #293

Closed
2 of 3 tasks
anayeaye opened this issue Feb 12, 2025 · 4 comments
Closed
2 of 3 tasks

Update renders metadata for NLCD* collections #293

anayeaye opened this issue Feb 12, 2025 · 4 comments
Assignees

Comments

@anayeaye
Copy link
Contributor

anayeaye commented Feb 12, 2025

What

NLCD categorical data requires using a custom colormap_name from the raster-api to render the complex colormap behind a firewall with url length restrictions. This is successfully implemented for nlcd-annual-conus but a couple collections have full colormap definitions which fail in production because of the firewall.

Working custom colormap

https://openveda.cloud/stac/collections/nlcd-annual-conus

Collections that need revision

  • houston-landcover
  • campfire-nlcd

AC

  • houston-landcover renders corrected in veda-data and production stac
  • campfire-nlcd renders corrected in veda-data and production stac
  • veda-data reviewed for other custom colormaps that exceed WAF url restrictions and corrections applied (and veda-config mdx updates added to Update NLCD datasets to use custom colormap_name veda-config#665)
@smohiudd
Copy link
Contributor

@anayeaye are houston-landcover and campfire-nlcd using the same colormap as nlcd-annual-conus

@botanical
Copy link
Member

@botanical
Copy link
Member

botanical commented Feb 28, 2025

The bangladesh-landcover-2001-2020 collection has a long renders but renders fine https://openveda.cloud/stac/collections/bangladesh-landcover-2001-2020

https://github.com/NASA-IMPACT/veda-data/blob/main/ingestion-data/staging/collections/bangladesh-landcover-2001-2020.json#L46-L80

I was able to figure out the longest renders values in staging/collections directory

find . -type f -name "*.json" -exec jq -r --arg file "{}" 'if (.renders | tostring | length) > 200 then $file else empty end' {} \;

./geoglam.json
./bangladesh-landcover-2001-2020.json
./nldas3.json
./nldas2.json
find . -type f -name "geoglam.json" -exec jq -r --arg file "{}" '.renders | tostring | "\($file): \(. | length)"' {} \;
./nldas3.json: 292
./nldas2.json: 292
./bangladesh-landcover-2001-2020.json: 252
./geoglam.json: 292

https://openveda.cloud/stac/collections/nldas3
https://openveda.cloud/stac/collections/nldas2

I suppose the nldas2 + 3 renders are slightly off? @anayeaye @smohiudd

@botanical
Copy link
Member

#310

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants