User-agent: Scrapy Allow: / User-Agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Crawl-Delay: 30 Sitemap: https://www.cityofderryairport.com/sitemap_index.xml