Skip to main content

RunShoeIndexBot

The polite crawler behind RUNSHOEINDEX price tracking.

What it does

RunShoeIndexBot fetches individual running-shoe product pages so we can record price changes over time and notify subscribed runners when a price drops. We only request specific product URLs — never sale pages, category indexes, or search results. We do not crawl your site.

How to identify it

The bot sends this exact User-Agent on every request:

RunShoeIndexBot/1.0 (+https://www.runshoeindex.com/bot)

Politeness

  • robots.txt is honored. Before any fetch, we read your /robots.txt and follow its rules for our User-Agent and the wildcard group.
  • Rate: at most one request per URL per 24 hours.
  • Scope: only product detail pages explicitly submitted by a logged-in user as part of a deal submission.
  • Parsing: we read public JSON-LD Product and Offer structured data published by your site for SEO. We do not parse private or authenticated content.
  • Images: we never rehost retailer product images. We deep-link to your image URL or use a manufacturer-supplied image.

Blocking the bot

To block RunShoeIndexBot, add the following to your /robots.txt:

User-agent: RunShoeIndexBot
Disallow: /

We will stop fetching your site within 24 hours of the next robots.txt re-read.

Contact

Site owner with a concern? Want a faster block, attribution change, or partnership chat? Get in touch and we will respond within two business days.