Skip to main content

RunShoeIndexBot

The polite crawler behind RUNSHOEINDEX price tracking.

What it does

RunShoeIndexBot fetches individual running-shoe product pages so we can record price changes over time and notify subscribed runners when a price drops. We only request specific product URLs, never sale pages, category indexes, or search results. We do not crawl your site.

How to identify it

The bot sends this exact User-Agent on every request:

RunShoeIndexBot/1.0 (+https://www.runshoeindex.com/bot)

Politeness

  • robots.txt is honored. Before any fetch, we read your /robots.txt and follow its rules for our User-Agent and the wildcard group.
  • Rate: at most one request per URL per 24 hours.
  • Scope: only product detail pages explicitly submitted by a logged-in user as part of a deal submission.
  • Parsing: we read public JSON-LD Product and Offer structured data published by your site for SEO. We do not parse private or authenticated content.
  • Images: we never rehost retailer product images. We deep-link to your image URL or use a manufacturer-supplied image.

Blocking the bot

To block RunShoeIndexBot, add the following to your /robots.txt:

User-agent: RunShoeIndexBot
Disallow: /

We will stop fetching your site within 24 hours of the next robots.txt re-read.

Contact

Site owner with a concern? Want a faster block, attribution change, or partnership chat? Get in touch and we will respond within two business days.