DataDripperBot
The browser DataDripper uses to look at an online store the way a shopper on a phone does, when someone asks us to check that store.
When it visits
Only when a person asks: a store owner checking their own store on datadripper.ai, or a DataDripper customer whose store we read each day. It acts for that person, like their browser would. It doesn't crawl the web on its own.
A free check runs at most once a week per store. Stores that use DataDripper are read about once a day.
What it does
It opens the store's home page, the pages its ads link to, a product, the cart, and the first step of checkout. It adds one item to a cart to see that step. It never places an order, never types an address or a card, and never signs in.
If a store answers “slow down” (HTTP 429, or 503 with Retry-After), it waits once and then stops.
How to recognise it
Every request to a store is signed with Web Bot Auth (HTTP Message Signatures, Ed25519):
Signature-Agent: "https://api.datadripper.ai"- Public keys:
https://api.datadripper.ai/.well-known/http-message-signatures-directory - User agent contains
DataDripperBot/1.0 (+https://www.datadripper.ai/bot)
A request that claims to be us without a valid signature isn't us.
robots.txt
We follow every rule you write for DataDripperBot by name. To stop all checks of your store:
User-agent: DataDripperBot Disallow: /
Rules for User-agent: * are written for crawlers and search engines. Because a person asks for each check and it acts like their browser, those don't stop a check. That's why it can still open the cart and checkout, which many stores hide from search.
Blocking it
Besides robots.txt, you can block requests carrying our signature agent or user agent in your firewall or bot settings. A blocked check simply tells the person that your store's security stopped us. Or email us and we'll stop checking your store.