Scraper Policy

What our scrapers do, what they don't, and how vendors can opt out — published so vendors and visitors can audit our behaviour.

Plain-English summary

Who we are

Operator: Eugene Bidchenco. Project repository: github.com/WhiteShoeBanker.

What we collect

Only publicly visible product information. Where vendors expose structured data (schema.org Product / ProductGroup JSON-LD), we read that; otherwise we parse the same HTML a customer's browser receives.

Fields we collect from vendor product pages and what each is used for.
FieldExamplePurpose
Product titleBPC-157 5mgDisambiguating peptide-vendor pairings.
Quantity & unit5 / mgNormalizing prices to dollars-per-milligram.
Price & currencyUSD 64.99Comparison ranking.
Stock statusin stock / out of stockSorting in-stock listings first.
Product URLhttps://vendor.com/products/bpc-157-5mgOutbound link target and audit trail.
Fetched timestamp2026-05-12T03:00:00ZShowing freshness; expiring stale listings.

What we don't collect

Categories explicitly outside our scope. We do not bypass paywalls, run browser automation to defeat anti-bot measures, or request URLs that robots.txt disallows.

  • Pages behind login or paywallNo
  • Vendor descriptions, prose, or marketing copyNo
  • Vendor images, video, or other mediaNo
  • Customer reviews or testimonialsNo
  • Customer account or order dataNo
  • Personally identifying information from any sourceNo

Crawl cadence

One run reads at most one product index page plus one detail page per product. We do not crawl the full site, do not follow tag/category/filter links, and do not paginate beyond what is needed to enumerate products. Cadence is per vendor:

Pure Rawz

Cadence
Daily
Scope
Full catalog
Last successful refresh
Notes
Runs at 03:00 UTC.

Core Peptides

Cadence
Weekly
Scope
Full catalog
Last successful refresh
Notes
Sundays, split A/M then N/Z for runtime budget.

SwissChems

Cadence
Weekly
Scope
Peptides category only
Last successful refresh
Notes
Sundays. SARMs, nootropics, PCT, bioregulators, bundles, and powders are excluded.

Ascension Peptides

Cadence
Weekly
Scope
Full catalog
Last successful refresh
Notes
Sundays, split A/M then N/Z. Honours robots.txt Crawl-delay of 10s.

We wait at least 5 secondsbetween requests to the same domain. If a vendor's robots.txt declares a longer Crawl-delay, we honour the larger value. We do not run requests in parallel against the same vendor.

User-Agent

All production scraper traffic from this site is sent with the following User-Agent string:

peptide-intel/1.0 (+https://peptide-intel.com/scraper-policy) - research peptide price comparison

Any traffic from this project that does not carry that User-Agent is either occasional, manually issued reconnaissance (prefixed peptide-intel-recon/) or, if you see a different identifier, not us.

Robots.txt opt-out

We re-fetch robots.txt at the start of every scrape run and respect its Disallow and Crawl-delay directives, both for User-agent: * and for any rule block specifically targeting peptide-intel/1.0.

Vendors who do not wish to be scraped can add the following two lines to their robots.txt:

User-agent: peptide-intel/1.0
Disallow: /

Our scraper detects this on its next scheduled run and stops fetching pages from your domain. No email or manual contact is needed; the file is the source of truth. A robots.txt change takes effect on our next scheduled run.

Contact

For removal questions outside the robots.txt route, see the contact page or email contact@peptide-intel.com with the subject "Remove vendor: [vendor name]".