TLS Client support - bypass 403 Forbidden errors on sites like StockX, Indeed, etc!

[cullenwatson]

Integrates https://github.com/bogdanfinn/tls-client which is a modern http client to bypass modern blocking techniques (TLS signatures)

I know this repo isn't maintained anymore but PRed for reach if anyone is struggling with this problem.

[WGH-]

It's really unfortunate this can't be just plugged as a transport with WithTransport. I'm not sure it's a good idea to infect the public API with custom types coming from third-party fhttp library (with unclear license status)

[kqvanity]

@cullenwatson I've tried your fork, and I ran into issues. The first one has to do with the module e.g., module declares its path as but was required as: which didn't get resolved until i matched the github repo name with the go.mod package name.

After the first one was resolved, it raised the issue

../../../go/pkg/mod/github.com/kqvanity/colly/[email protected]/colly.go:1174:30: cannot use cnew (variable of type []*"github.com/bogdanfinn/fhttp".Cookie) as []*"net/http".Cookie value in argument to storage.ContainsCookie
../../../go/pkg/mod/github.com/kqvanity/colly/[email protected]/colly.go:1175:24: cannot use c (variable of type *"net/http".Cookie) as *"github.com/bogdanfinn/fhttp".Cookie value in argument to append
../../../go/pkg/mod/github.com/kqvanity/colly/[email protected]/colly.go:1178:49: cannot use cnew (variable of type []*"github.com/bogdanfinn/fhttp".Cookie) as []*"net/http".Cookie value in argument to storage.StringifyCookies
../../../go/pkg/mod/github.com/kqvanity/colly/[email protected]/colly.go:1195:23: cannot use c (variable of type *"net/http".Cookie) as *"github.com/bogdanfinn/fhttp".Cookie value in argument to append
make: *** [makefile:2: run] Err