Sitemap: https://skiplagged.com/sitemap.xml User-agent: * Allow: / Crawl-delay: 1 # 1 second between crawl requests Disallow: /api/hotel_redirect.php Disallow: /hotel/book/ Disallow: /flights/view/ Disallow: /flights/book/ Disallow: /flights/confirmation/ Disallow: /flights-widget/ Disallow: /hotel/reservation/ Disallow: /unsubscribe/