Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AWS NAIP open data #3

Closed
kylebarron opened this issue Dec 6, 2019 · 2 comments
Closed

AWS NAIP open data #3

kylebarron opened this issue Dec 6, 2019 · 2 comments

Comments

@kylebarron
Copy link
Member

May be useful to check out AWS's NAIP imagery. https://registry.opendata.aws/naip/

You'd want the naip-visualization dataset (arn:aws:s3:::naip-visualization)

The data in this bucket is 3 band RGB in Geotiff format. It is converted and managed by Esri. This imagery is provided as Cloud Optimized GeoTIFFs, has been compressed using YCbCr JPEG with quality 85. It is provided as 512x512 tiles, with pyramids created using 2x sampling by averaging. The bucket is set as a Requester Pays bucket.

@kylebarron kylebarron transferred this issue from nst-guide/data Dec 26, 2019
@kylebarron kylebarron changed the title NAIP imagery AWS NAIP open data Dec 26, 2019
@kylebarron
Copy link
Member Author

kylebarron commented Dec 26, 2019

AWS NAIP is actually pretty cool because they have multiple years and multiple sets of data. The data in the naip-visualization bucket looks best for my use case:

The data in this bucket is 3 band RGB in Geotiff format. It is converted and managed by Esri. This imagery is provided as Cloud Optimized GeoTIFFs, has been compressed using YCbCr JPEG with quality 85. It is provided as 512x512 tiles, with pyramids created using 2x sampling by averaging. The bucket is set as a Requester Pays bucket.

NAIP annual coverage map

Directory Structure

  • Imagery : Bucketname/state/YYYY/resolution*/bands/quad/.mrf (.idx, .lrc) files
  • Metadata : Bucketname/state/YYYY/resolution/fgdc/quad/.txt files
  • State/Year Index : Bucketname/state/YYYY/resolution/index/.shp (.dbf, .shx, .prj, .sbn) files

Although I've found that with naip-visualization, the imagery bucket is named rgb/ not bands/.

Process

So the process would be:

  1. Take geometry
  2. Load index shapefile, at e.g.
    s3://naip-visualization/wa/2013/100cm/index/
    

image
3. Intersect geometry with index
4. Generate map filenames. It looks like the USGSID, FileName, and ST columns are necessary. They have values of, e.g. 4812247, SW, and WA. And correspond to file names like:

```
s3://naip-visualization/{ST}/2015/100cm/rgb/{USGSID[:5]}/{FileName}
s3://naip-visualization/wa/2015/100cm/rgb/45122/m_4512229_ne_10_1_20150728.tif
```
  1. Download all imagery for that year and state and tile it?

@kylebarron
Copy link
Member Author

This is superseded by https://github.com/kylebarron/serverless-aerial-imagery

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant