New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ENH: Improve performance of zonal_stats_bulk #38

Open

3 of 5 tasks

theroggy opened this issue Mar 31, 2023 · 0 comments

Open

3 of 5 tasks

ENH: Improve performance of zonal_stats_bulk #38

theroggy opened this issue Mar 31, 2023 · 0 comments

Milestone

Owner

theroggy commented Mar 31, 2023 •

edited

Loading

Calculating the zonal stats now takes a long time. It would be great if that could be made faster.

Steps to take:

make list of existing relevant libraries: see below
benchmark them: benchmarks: based on the benchmarks, the pyqgis zonal_stats was the (only) one with with significantly better performance.
first rough implementation: Add bulk zonal stats option using pyqgis - first version #42
tests still need to be added
decouple implementation further for rasterstats one + make implementation more generic

Listing of relevant libraries

rasterio: manual
pygeoprocessing (open?): doc
pyjeo (GPL): doc
pyQGIS (GPL): post
- fast, but less clean on server.
- relevant src
?: doc

These libraries also take partial pixels in account, so they are not fit for purpose.

xagg: repo
exactextract (apache2): repo

theroggy mentioned this issue

Add bulk zonal stats option using pyqgis - first version #42

Merged

theroggy added this to the 0.1.0 milestone

theroggy mentioned this issue

Create new tmp dir for each zonal_stats_bulk calculation #46

Merged

theroggy changed the title ~~Improve performance of zonal_stats_bulk~~ ENH: Improve performance of zonal_stats_bulk

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment