Proxies for web scraping
A scraper sends a lot of requests to the same site in a short time. The HiProxy unlimited plan sends each of those requests from a different home connection IP and bills by the day, whatever the volume.
Why does a single server IP get blocked?
Most sites slow down or block an address once it passes a certain number of requests. A scraper making thousands of requests from one server crosses that line quickly.
Through the gateway, requests spread over many IPs from home internet connections (residential IPs). Total volume stays the same, but each IP sends about as much as an ordinary visitor.
What does a day cost, and what sets the price?
The smallest tier (200 connections, 100 Mbps) is $4.75 on the Day plan. Week (7 days) is $4.47 a day, Month (30 days) $4.04 and Quarter (90 days) $3.61, so the rate drops as the period grows.
Bytes are not counted. Image heavy pages and tiny API responses fit inside the same daily price. Only the period, the connection count and the bandwidth change what you pay.
How do I choose the connection count?
Count how many requests your scraper keeps open at one moment. With 150 worker threads, the 200 connection tier fits and leaves room for retries.
If you run several scrapers together, add up their threads. Past 200, the 500 connection tier (200 Mbps, $7.77 a day) is the better fit. You can change tiers when you buy your next plan.
What is fine to collect?
Pages anyone can open without logging in are the usual targets: product listings, news articles, public business directories. Read the site's terms and the laws where you operate before you start.
HiProxy suspends accounts used for logins with leaked credentials, spam, DDoS or access to government sites. Spacing out your requests keeps the target site healthy and keeps your scraper running longer.
Connect HiProxy for Web scraping
1
Sign up with just a username and password, then top up at least $30 in crypto in the payment window.
2
Under unlimited residential, pick Day, Week, Month or Quarter and choose a connection tier.
3
Add -zone-unl to your proxy username, plus a country such as -cc-us when the data differs by country.
4
Point the scraper at gate.hiproxy.shop on port 6100 (HTTP) or 6200 (SOCKS5), and the IP changes on every request.
Common questions
When does the IP change?
Without a -sid option in the username, every request leaves from a new residential IP.
Can I hold one IP for a few pages behind a login?
Yes. Add -sid- followed by any session name. Requests with the same name share one IP. Set how long it holds with -ttl-, up to 60 minutes.
Is unlimited really unlimited on traffic?
Traffic is not measured. Only the number of open connections and the speed follow the tier you chose.
My plan shows as activating.
It shows that way for a short time until the network turns it on. If an order cannot be activated, it is cancelled and the full amount returns to your balance.
Top up $30 and get 78 GB of residential traffic
Pick a username and a password and you're in. Your balance never expires.