Tomedia

Tomedia Seer crawler identity

Tomedia Seer Technical Crawler

This is Tomedia's policy-aware technical SEO crawler. It inspects authorised public websites to understand crawlability, page metadata, internal links, and observed public link relationships.

Identification

Requests identify themselves with this HTTP user agent:

Tomedia-Seer-TechnicalCrawler/1.0 (+https://tomedia.com.au/seer/crawler)

How it behaves

  • It runs only for explicitly authorised and operator-allowlisted hosts.
  • It follows robots.txt, crawl-delay directives, and strict same-origin crawl limits.
  • It uses ordinary HTTP GET requests and does not submit forms, sign in, retain page bodies, or run a browser.
  • It limits redirects, pages, depth, runtime, response size, and total bytes.

Block the crawler

Site operators can block the crawler with this rule in /robots.txt:

User-agent: Tomedia-Seer-TechnicalCrawler
Disallow: /

Contact

Questions, incorrect behaviour, or urgent block requests can be sent to [email protected].