Crawler information
Our crawler identifies itself with the User-Agent PCPartsIndia-Crawler/1.0 and includes a contact URL in every request.
Politeness
- We honour
robots.txton every fetch. - Default per-host rate limit is 1 request every 1.5 seconds.
- Long-tail crawls run between 02:00 and 06:00 IST.
- We back off on HTTP 429 or 503 with exponential delay; three failures and we pause the vendor.
Want us to slow down, change cadence, or stop?
Email contact@pcpartsindia.com or open a line of dialogue with us via your platform's support contact. We action opt-outs within 24 hours and unconditionally.
Want a partnership feed instead of crawling?
We'd prefer it. A simple daily CSV/JSON push gives you full control over what we display, avoids any load on your servers, and earns you priority placement in our deal digests.