← Back to home

ITADpricing Bot - Web Crawler Information

What is ITADpricing Bot?

ITADpricing Bot is a web crawler operated by Proofen B.V. (Zwijndrecht, Netherlands) that collects publicly available product pricing data from e-commerce platforms selling refurbished electronics. We aggregate this data to provide B2B pricing intelligence for the ITAD (IT Asset Disposition) and circular economy industry.

What data do we collect?

  • Product names and model identifiers
  • Listed consumer prices
  • Product condition/grade labels
  • Stock availability status

We do not collect:

  • Personal data (names, emails, addresses of sellers or buyers)
  • Product descriptions, images, or copyrighted content
  • Customer reviews or ratings
  • Any data behind login walls or paywalls

How do we identify ourselves?

Our crawler identifies itself in HTTP requests with the User-Agent string:

ITADpricingBot/1.0 (+https://itadpricing.com/bot)

For JavaScript-rendered pages, we use a standard Chromium browser which identifies as a regular Chrome browser. This is necessary because some platforms require JavaScript to display their product pages.

How we respect your platform

  • We check and respect robots.txt directives
  • We limit our request rate (minimum 1-3 seconds between requests per domain)
  • We only access publicly available pages (no authentication bypass)
  • We run our crawler during off-peak hours (02:00-08:00 CET) to minimize server load
  • We aggregate data (min/avg/max prices) rather than reproducing individual listings

Opt-out

If you operate a platform and would like ITADpricing Bot to stop crawling your site, you can:

  1. Add a Disallow rule for ITADpricingBot in your robots.txt file. We check robots.txt before every crawl session.
  2. Contact us at info@proofen.nl and we will remove your platform within 48 hours.

Legal basis

Price comparison from publicly accessible web pages is a recognized and protected activity under EU competition policy. Our data collection does not fall under the EU Database Directive (96/9/EC) sui generis right, as the platforms we collect from create their own pricing data rather than obtaining it from external sources (ref: CJEU, BHB v William Hill, C-203/02).

We collect no personal data and are therefore not subject to GDPR obligations in relation to our crawling activity.

Contact

Proofen B.V.
Zwijndrecht, Netherlands
Email: info@proofen.nl