TEXT   40
robots txt crawl delay
Guest on 7th February 2023 01:47:58 PM


  1. user-agent: *
  2. disallow:
  3. crawl-delay: 60
Raw Paste

Login or Register to edit or fork this paste. It's free.