# Scraper # https://darkvisitors.com/agents/008 User-agent: 008 Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/a360-search User-agent: A360-Search Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/activecomply User-agent: ActiveComply Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/adagiobot User-agent: Adagiobot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/adbeat-bot User-agent: adbeat_bot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/adidxbot User-agent: AdIdxBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/adsbot-google User-agent: AdsBot-Google Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/adsbot-google-mobile User-agent: AdsBot-Google-Mobile Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/ai2bot User-agent: AI2Bot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/aihitbot User-agent: aiHitBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/amazon-adbot User-agent: Amazon AdBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/amazonadbot User-agent: AmazonAdBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/anderspinkbot User-agent: AndersPinkBot Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/anthropic-ai User-agent: anthropic-ai Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/applebot-extended User-agent: Applebot-Extended Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/archivebot User-agent: ArchiveBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/awario User-agent: Awario Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/awariobot User-agent: AwarioBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/awariosmartbot User-agent: AwarioSmartBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/bigupdatabot User-agent: BigUpDataBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/bing-ads User-agent: Bing Ads Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/bitsightbot User-agent: BitSightBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/blackboard User-agent: Blackboard Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/brandverity User-agent: BrandVerity Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/brightedge-bot User-agent: BrightEdge Bot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/bytespider User-agent: Bytespider Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/ccbot User-agent: CCBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/channable User-agent: channable Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/cincraw User-agent: Cincraw Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/claude-web User-agent: Claude-Web Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/claudebot User-agent: ClaudeBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/clickagy-intelligence-bot-v2 User-agent: Clickagy Intelligence Bot v2 Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/cloudvertexbot User-agent: CloudVertexBot Disallow: / # Undocumented AI Agent # https://darkvisitors.com/agents/cohere-ai User-agent: cohere-ai Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/cohere-training-data-crawler User-agent: cohere-training-data-crawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/contxbot User-agent: contxbot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/cotoyogi User-agent: Cotoyogi Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/criteobot User-agent: CriteoBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/cxensebot User-agent: cXensebot Disallow: / # Scraper # https://darkvisitors.com/agents/dataprovider-com User-agent: Dataprovider.com Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/datenbank-crawler User-agent: Datenbank Crawler Disallow: / # Scraper # https://darkvisitors.com/agents/dcrawl User-agent: dcrawl Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/diffbot User-agent: Diffbot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/echobot-bot User-agent: Echobot Bot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/epivozcrawler User-agent: EpivozCrawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/ev-crawler User-agent: ev-crawler Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/facebookbot User-agent: FacebookBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/factset-spyderbot User-agent: factset_spyderbot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/fdl-stats-bot User-agent: FDL Stats Bot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/google-adsbot User-agent: Google AdsBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/google-adsense User-agent: Google AdSense Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/google-adwords-instant User-agent: Google-Adwords-Instant Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/google-extended User-agent: Google-Extended Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/googleother User-agent: GoogleOther Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/gptbot User-agent: GPTBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/grapeshotcrawler User-agent: GrapeshotCrawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/groovinaadsbot User-agent: GroovinaAdsbot Disallow: / # Scraper # https://darkvisitors.com/agents/helloworkjobpostingbot User-agent: HelloworkJobPostingBot Disallow: / # Scraper # https://darkvisitors.com/agents/httrack User-agent: HTTrack Disallow: / # Scraper # https://darkvisitors.com/agents/httrack-3-0 User-agent: HTTrack 3.0 Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/hubspot User-agent: HubSpot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/ias-crawler User-agent: ias_crawler Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/icc-crawler User-agent: ICC-Crawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/imagesiftbot User-agent: ImagesiftBot Disallow: / # Scraper # https://darkvisitors.com/agents/indeedjobbot User-agent: IndeedJobBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/innguma User-agent: Innguma Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/interactiveadvertisingbureau User-agent: InteractiveAdvertisingBureau Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/ioncrawl User-agent: IonCrawl Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/jugendschutzprogramm-crawler User-agent: Jugendschutzprogramm-Crawler Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/kangaroo-bot User-agent: Kangaroo Bot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/klaviyo User-agent: Klaviyo Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/kstandbot User-agent: KStandBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/leikibot User-agent: Leikibot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/lightspeedsystemscrawler User-agent: LightspeedSystemsCrawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/linkfluence User-agent: linkfluence Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/linkwalker User-agent: LinkWalker Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/macrobondbot User-agent: Macrobondbot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/magpie-crawler User-agent: magpie-crawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/medialogiabot User-agent: MedialogiaBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/mediamonitoringbot User-agent: MediaMonitoringBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/mediapartners-google User-agent: Mediapartners-Google Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/mediatoolkitbot User-agent: Mediatoolkitbot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/mediavine-medatada-parser User-agent: Mediavine Medatada Parser Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/mediavinemetadataparser User-agent: MediavineMetadataParser Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/meta-externalagent User-agent: meta-externalagent Disallow: / # Scraper # https://darkvisitors.com/agents/metainspector User-agent: MetaInspector Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/mgidbot User-agent: MgidBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/missinglettr-bot User-agent: Missinglettr Bot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/muckrack User-agent: MuckRack Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/netcraft User-agent: Netcraft Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/netcraftsurveyagent User-agent: NetcraftSurveyAgent Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/netestate-imprint-crawler User-agent: netEstate Imprint Crawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/netestate-ne-crawler User-agent: netEstate NE Crawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/netvibes User-agent: Netvibes Disallow: / # Scraper # https://darkvisitors.com/agents/newspaper User-agent: newspaper Disallow: / # Scraper # https://darkvisitors.com/agents/nutch User-agent: Nutch Disallow: / # Scraper # https://darkvisitors.com/agents/offline-explorer User-agent: Offline Explorer Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/omgili User-agent: omgili Disallow: / # Scraper # https://darkvisitors.com/agents/openindexspider User-agent: OpenindexSpider Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/outbrain User-agent: outbrain Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/page-preview-tool User-agent: page-preview-tool Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/pandalytics User-agent: Pandalytics Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/pangubot User-agent: PanguBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/panscient-com User-agent: panscient.com Disallow: / # Scraper # https://darkvisitors.com/agents/potions User-agent: Potions Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/proximic User-agent: proximic Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/quantcastbot User-agent: Quantcastbot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/retrolistecom User-agent: RetroListeCOM Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/salesviewerbot User-agent: SalesViewerBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/scoop-it User-agent: scoop.it Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/scrapingnytimes-com User-agent: scraping@nytimes.com Disallow: / # Scraper # https://darkvisitors.com/agents/scrapy User-agent: Scrapy Disallow: / # Scraper # https://darkvisitors.com/agents/serverhunterspider User-agent: ServerHunterSpider Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/slickbot User-agent: SlickBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/slickstream User-agent: Slickstream Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/smartologybot User-agent: SmartologyBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/smtbot User-agent: SMTBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/statistikaustria User-agent: StatistikAustria Disallow: / # Scraper # https://darkvisitors.com/agents/statsdronebot User-agent: StatsDroneBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/taboola User-agent: Taboola Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/taboolabot User-agent: Taboolabot Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/timpibot User-agent: Timpibot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/trendictionbot User-agent: trendictionbot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/trendsmapresolver User-agent: TrendsmapResolver Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/ttd-content User-agent: TTD-Content Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/turnitinbot User-agent: TurnitinBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/tweetmemebot User-agent: TweetmemeBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/twingly User-agent: Twingly Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/um-ln User-agent: um-LN Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/velenpublicwebcrawler User-agent: VelenPublicWebCrawler Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/virustotal User-agent: virustotal Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/webspidermount User-agent: webspidermount Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/webzio User-agent: Webzio Disallow: / # AI Data Scraper # https://darkvisitors.com/agents/webzio-extended User-agent: Webzio-Extended Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/yahoo-ad-monitoring User-agent: Yahoo Ad monitoring Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/yahoo-japan User-agent: Yahoo Japan Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/yext-inc User-agent: Yext Inc Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/yextbot User-agent: YextBot Disallow: / # Intelligence Gatherer # https://darkvisitors.com/agents/zoominfobot User-agent: ZoominfoBot Disallow: / User-agent: * Disallow: /404/ Disallow: /p/ Disallow: /private/ User-agent: * Allow: / Sitemap: https://cedmax.net/sitemap-index.xml