Access files in an AWS S3 requester pay bucket

[giswqs]

Can Titiler access COG files in an AWS S3 requester pay bucket, such as the naip bucket? I am able to acess the files using gdal and rasterio, but I can't find an example using TiTiler to access the tiles.

https://registry.opendata.aws/naip/

import rasterio

with rasterio.Env(AWS_REQUEST_PAYER='requester'):
    with rasterio.open('s3://naip-analytic/al/2011/100cm/rgbir_cog/30085/m_3008501_ne_16_1_20110815.tif') as src:
        print(src.profile)

gdalinfo /vsis3/naip-analytic/al/2011/100cm/rgbir_cog/30085/m_3008501_ne_16_1_20110815.tif \
--config AWS_REQUEST_PAYER requester

[vincentsarago]

@giswqs if you set AWS_REQUEST_PAYER='requester' in your deployment environment, titiler will be able to access requester-pays bucket

if the question is: can I access requester-pays bucket with titiler.xyz? the answer is no because we can't assume the price for this

[vincentsarago]

😬 I have no idea what's going on

[giswqs]

That's puzzling. I tried the link on multiple computers and cellphone networks, none of them works. Sometimes getting this error

[vincentsarago]

Yeah I'm getting this one too ... that's new to me 😬

[vincentsarago]

Maybe it's with this dataset only

I have no issue with s3://naip-analytic/wa/2017/100cm/rgbir_cog/48117/m_4811762_se_11_1_20170723.tif

[giswqs]

Something strange. The old example dataset works for me now, but the new one you just mentioned does not work for me.
It seems if the dataset has been tried for many times, somehow it works. Newly accessed dataset does not work?

[giswqs]

Tried it on some new datasets. Did not work either. How strange.

https://titiler.xyz/cog/info?url=s3://naip-analytic/tn/2018/60cm/rgbir_cog/34084/649969903%20m_3408401_ne_16_060_20181021.tif

s3 ls s3://naip-analytic/tn/2018/60cm/rgbir_cog/34084/ --request-payer 

[vincentsarago]

FYI
you share https://titiler.xyz/cog/info?url=s3://naip-analytic/tn/2018/60cm/rgbir_cog/34084/649969903%20m_3408401_ne_16_060_20181021.tif but the correct URL is
https://titiler.xyz/cog/info?url=s3://naip-analytic/tn/2018/60cm/rgbir_cog/34084/m_3408401_ne_16_060_20181021.tif

[giswqs]

My bad. Your titile seems to be working now. Mine is still not working. Keep trying

[solomon-negusse]

Hi @giswqs, curious if you have been able to resolve this? Quite puzzled by this issue as well..

[giswqs]

@solomon-negusse See this example: banesullivan/localtileserver#182 (comment)

[solomon-negusse]

Thanks, @giswqs!