Real estate sources and their defences
| Source | Defence | Webshare | Geonode |
|---|---|---|---|
| Agency and broker websites | Light | Datacenter list | Rotating datacenter |
| Public records portals | Light, rate-limited | Datacenter list, slow | Rotating datacenter, slow |
| Major national listing portals | Moderate to strong | Rotating residential | Rotating residential |
| Rental platforms | Moderate | Residential, test datacenter | Residential, test datacenter |
Provider guides: Webshare for real estate data and Geonode for real estate data.
Agency sites and records: Webshare's lists
Hundreds of agency sites and public record portals accept datacenter traffic at polite rates. Webshare's per-IP datacenter lists make that long tail cheap, with a predictable monthly cost.
Major portals: residential on either
Big portals use bot protection. Residential traffic is needed, and Geonode's per-GB list prices are lower. Listing pages with photos can be heavy; fetch HTML or JSON and skip images to keep costs down.
Scheduled runs and billing
Real estate collection often runs weekly or monthly rather than continuously. That's a good fit for non-expiring bandwidth: buy a balance and draw it down over runs. Monthly residential plans suit daily collection better. See bandwidth expiry compared.
Sessions for search pagination
Portal searches are paginated and often cookie-dependent. Use one sticky session per search area on either provider, and a new session for the next area.
Proxy tip: If you need managed scraping rather than raw proxies, Geonode also sells a Scraper API with a free monthly allowance, which Webshare doesn't offer. More in our complete Geonode guide.
Data and compliance
Deduplicate cross-listed properties, normalise units and currencies, and handle personal data (agent and owner details) carefully. Many portals restrict automated access in their terms. See ethical web scraping.
Verdict
- Agency sites and public records: Webshare datacenter lists.
- Major portals, weekly or monthly runs: Geonode residential.
- Full market coverage: both, routed by source.
Source routing table
| Source type | Route | Frequency |
|---|---|---|
| National portals | Geonode residential, session per search | Daily or weekly |
| Regional portals | Test datacenter first, then residential | Weekly |
| Agency sites | Webshare datacenter | Weekly |
| Public records | Webshare datacenter, slow | Monthly |
Volume estimate
| Market | Active listings | Weekly full refresh | Approx. GB per month (HTML) |
|---|---|---|---|
| Mid-size city | 10,000 | 4 runs | About 16 |
| Large metro | 60,000 | 4 runs | About 100 |
Fetching search pages daily and listing pages only when they change reduces these numbers substantially.
Budget tip: Many teams end up using both: Webshare for cheap per-IP datacenter and static residential lists, Geonode for per-GB residential traffic that doesn't expire. Start with Webshare for real estate data.
Data products
Turn raw listings into indices (median price, inventory, days on market) per area. Indices are easier to validate and far more useful to customers than raw data.
A real-world example
A proptech startup tracks listings in 12 cities. National portals run through Geonode residential on a weekly schedule, drawing down a non-expiring balance. Agency sites and public records, which make up most of the requests, run through a Webshare datacenter list. Search pages are fetched daily, and listing pages only when the search shows a change, keeping residential usage to about 30 GB a month.
Before you commit to any provider, it helps to see the wider market: our guide to the best proxies in 2026 compares proxy types by job, and cheap proxies explains how to keep costs down without buying IPs that get blocked.
Key takeaways
- Agency sites and public records suit Webshare datacenter lists.
- Major portals need residential traffic, usually cheaper on Geonode.
- Weekly or monthly runs suit non-expiring bandwidth.
- Use sessions per search area and fetch listing pages only on change.
- Handle personal data carefully and check portal terms.
FAQ
Do real estate portals block datacenter proxies?
Major ones often do; agency sites and records usually don't.
Which provider is cheaper for weekly collection?
For residential traffic, usually Geonode, thanks to lower per-GB prices and no expiry.
Should I download listing photos?
Only if you need them. Photos dominate bandwidth.
Do listing portals vary by country?
Yes. Major portals differ by country in structure, defences and terms.
How do I map listings to neighbourhoods?
Geocode addresses and join them to boundary data for the areas you report on.
Which provider is better for daily collection?
Compare per-GB prices and success rates on your portals; monthly plans suit steady daily volume.
Editorial note: Proxy providers change their pools, features and prices often, so treat any figures here as typical ranges at the time of writing and confirm current terms with the provider before you buy.