- Get proxy lists for parsing from API endpoint, curl or php
- Rotating proxy for parsing anything - proxy are being changed automatically until website returns proper content
- Parsing pages protected by Cloudflare from scraping
If you are looking for a way to parse website which is protected by cloudflare or some other custom made solution you are in the right place.
Usually if you need to get a few dozens of pages from website you can go directory for website and scrape data easily. Issues comes if website has some kind of protection you need to get a lot of data on regular basis.
We handle all blocking from protection on our behalf. You get data like you were requesting them directly.
This solution works for parsing and collection of data. It doesn't work for DDOS, spam sending or abusing internet.
Javascript is optionally executed if you need it. Essentially it's slower than just getting page as is so consider finding a way to get data without Javascript execution.
curl http://public.proxyrequest.ru/api/proxyget/free
Run first composer command in your shell:
composer require gorlovka/proxy-request-builder
<?php
use Proxyrequest\ProxyRequestGet;
$proxyRequestGet = new ProxyRequestGet();
echo $proxyRequestGet->sendRequest();
See TestProxyGet.php file for example.
bash tests/TestCurlRotateProxy.sh
Run first composer command in your shell:
composer require gorlovka/proxy-request-builder
<?php
use Proxyrequest\ProxyRequestRotate;
$proxyRequestRotate = new ProxyRequestRotate('URL_TO_GET', 'PRIVATE_TOKEN_KEY_HERE');
echo $proxyRequestRotate->sendRequest();
Not publicly available. Available upon request. Possibility of it depends on how it's configured on exact website. Feel free to get in touch mentioning the address of website and how many pages per day is it needed to collect.
Currently, there are three types of tokens
-
Proxy lists free token is here
-
Rotating proxy free token is here
-
Cloudflare token (to be released soon)
Private token removes time limits in accessing to proxy lists. Allows filtering. New features may be added upon request.
You should use these proxies responsibly, without abusing them, and without intent to commit illegal activity.
There are three kind of tokens:
-
Proxy lists Paid token removes time limits in accessing to proxy lists. Allows filter by type, country, ip mask, last check, speed, level.
-
Rotating proxy Software built upon proxy lists. Which consumes target url to be parsed and it manages to get content from website upon your request. Paid token allows here to do such requests. Free testing period available.
-
Bypassing cloudflare(any other protection) for parsing Software on our side goes to specified url which is behind protection and gives you content of it back. Free testing period available
We have no limits on traffic. If you have big count of requests it's possible to provide dedicated resources just for you.
Email for contacts is [email protected].