WatchlistBot
WatchlistBot checks the price and stock of products that people have saved in Watchlist (justwatchlist.com), so it can tell them when a price drops or an item is back in stock.
What it reads
Only product pages that a Watchlist user saved. It never signs in, never adds anything to a cart and never collects personal data. Some pages are loaded with a browser so that their own scripts can show the price.
How often
Each product at most every few hours (2 to 24 hours, depending on how its price changes). One request per shop at a time, at least 10 seconds apart.
robots.txt
WatchlistBot follows robots.txt. Rules for "WatchlistBot" (or our former name "watchlist") apply, and so do rules for all agents. Disallow a path and it is not checked again.
How to recognise it
User agent: Mozilla/5.0 (compatible; WatchlistBot/1.0; +https://justwatchlist.com/bot)
IP addresses: 193.160.119.233, 2a02:4780:c:d190::1
Machine-readable list: https://justwatchlist.com/bot/ips.json
Every request is signed with Web Bot Auth (HTTP Message Signatures, Ed25519; Signature-Agent "https://justwatchlist.com"). Key directory: https://justwatchlist.com/.well-known/http-message-signatures-directory
Contact
Questions, or a shop that wants us to check less often or not at all: hello@justwatchlist.com. WatchlistBot is run by It depends OÜ.