MailVetBot
MailVet is an email validation API. MailVetBot reads the domains temporary email services publish, so we can tell our customers when an address is disposable.
User agent
MailVetBot/1.0 (+https://mailvet.dev/bot)
What we fetch
- robots.txt.
- Public pages and documented APIs that list a temporary email service's domains. A plain GET, and we keep the domain names and nothing else.
Some of these pages show a random address when they load. We ignore it: we read the list of domains only, and never use, record or read that address.
Every few hours, one request per service per run, plus its robots.txt. A paged API can take up to 5. At least 2 seconds apart per host, longer if your crawl delay says so.
What it finds doesn't go straight on our list. A domain needs two different services, or a review by us. How the data is built has the rest.
What we don't do
- Submit forms, create accounts, use an inbox or read mail.
- Run a browser, solve challenges, use proxies, or pretend to be something else.
- Retry after a 401, 403, 429, a challenge page or a login wall. That service is skipped for the run.
Opt out
Either works:
- In robots.txt:
User-agent: MailVetBotandDisallow: /. We read it on every run. - Email hello@mailvet.dev with your domain and we'll remove it from the sources.