User-agent: AdsBot-Google User-agent: AdsBot-Google-Mobile User-agent: AdsBot-Google-Mobile-Apps User-agent: Google-Extended User-agent: GoogleOther User-agent: GPTBot User-agent: AhrefsBot User-agent: aiohttp User-agent: APIs-Google User-agent: archive.org_bot User-agent: AwarioRssBot User-agent: AwarioSmartBot User-agent: barkrowler User-agent: bl.uk_lddc_bot User-agent: BLEXBot User-agent: Buck User-agent: bytespider User-agent: CCBot User-agent: DataForSeoBot User-agent: DomainAppender User-agent: dotbot User-agent: Feed a Fever User-agent: Go-NEB User-agent: GPTBot User-agent: heritrix User-agent: HTTrack User-agent: ia_archiver User-agent: JamesBOT User-agent: LCC User-agent: linkdexbot User-agent: LinkedInBot User-agent: ltx71 User-agent: magpie-crawler User-agent: Mediapartners-Google User-agent: MJ12bot User-agent: oBot User-agent: omgili User-agent: omgilibot User-agent: RankActiveLinkBot User-agent: rogerbot User-agent: SemrushBot User-agent: SemrushBot-BA User-agent: SemrushBot-BM User-agent: SemrushBot-CT User-agent: SemrushBot-SA User-agent: SemrushBot-SEOAB User-agent: SemrushBot-SI User-agent: SemrushBot-SWA User-agent: serpstatbot User-agent: spbot User-agent: special_archiver User-agent: XoviBot User-agent: Zoominfobot Disallow: / User-agent: * Crawl-delay: 1 Disallow: /cgi-bin/ Disallow: /mt/ Disallow: /mt-static/ Disallow: /ehasbrouck.asc Sitemap: https://hasbrouck.org/sitemap.xml