JobRadarBot

What is JobRadarBot?

JobRadarBot is JobRadar's crawler. It reads job openings that employers publish on their own careers pages so job seekers can find them. Its user agent always contains JobRadarBot and a link to this page.

How does it behave?

  • It obeys robots.txt. To keep it out, disallow JobRadarBot or all user agents.
  • It skips sites whose terms forbid automated access, unless the employer has given us written permission. Career sites that applicant-tracking vendors such as Workday host for employers are the exception.
  • It stays on the employer's own career site and makes at most one request every 5 seconds to any host.
  • It stops crawling a site as soon as the site refuses or challenges it. It never uses proxies, rotating addresses or a disguised user agent.
  • It does not collect personal data about recruiters or other staff.

How do I stop it?

To ask us to stop, or to have your jobs removed, email hello@jobradar.ai. We stop crawling your site and delete its jobs within 24 hours.