# START nuxt-simple-robots (indexable) User-agent: * Disallow: /datasets/file Disallow: /datasets/*/version/ Disallow: /file Disallow: /welcome Disallow: /user Disallow: /contact-us Disallow: /contact-us/*?* Disallow: /help Disallow: /signup Disallow: /maps Disallow: /news-and-events/submit Disallow: /news-and-events/community-spotlight/submit Disallow: /*?*path= Disallow: /*?*source_url= Disallow: /*source_url= Disallow: /communication-preferences # Block bots that don't benefit us. User-agent: Nuclei User-agent: WikiDo User-agent: Riddler User-agent: PetalBot User-agent: Zoominfobot User-agent: Go-http-client User-agent: Node/simplecrawler User-agent: CazoodleBot User-agent: dotbot/1.0 User-agent: Gigabot User-agent: Barkrowler User-agent: BLEXBot User-agent: magpie-crawler Disallow: / Sitemap: https://sparc.science/sitemap.xml # END nuxt-simple-robots