You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This however is insensible as the default settings have 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware': 590, which means that a custom response_is_ban(self, request, response) implementation receives a gzipped response and response.css('whatever') leads to exceptions.
In your
README
you recommend settingThis however is insensible as the default settings have
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware': 590,
which means that a customresponse_is_ban(self, request, response)
implementation receives a gzipped response andresponse.css('whatever')
leads to exceptions.To avoid that, something like
makes more sense.
The text was updated successfully, but these errors were encountered: