TEXT 30
Robots.txt Guest on 28th June 2020 01:18:48 PM
  1. # If the Joomla site is installed within a folder such as at
  2. # e.g. www.example.com/joomla/ the robots.txt file MUST be
  3. # moved to the site root at e.g. www.example.com/robots.txt
  4. # AND the joomla folder name MUST be prefixed to the disallowed
  5. # path, e.g. the Disallow rule for the /administrator/ folder
  6. # MUST be changed to read Disallow: /joomla/administrator/
  7. #
  8. # For more information about the robots.txt standard, see:
  9. # http://www.robotstxt.org/orig.html
  10. #
  11. # For syntax checking, see:
  12. # http://www.sxw.org.uk/computing/robots/check.html
  13.  
  14. User-agent: *
  15. Disallow: /administrator/
  16. Disallow: /cache/
  17. Disallow: /cli/
  18. Disallow: /components/
  19. Disallow: /images/
  20. Disallow: /includes/
  21. Disallow: /installation/
  22. Disallow: /language/
  23. Disallow: /libraries/
  24. Disallow: /logs/
  25. Disallow: /media/
  26. Disallow: /modules/
  27. Disallow: /plugins/
  28. Disallow: /templates/
  29. Disallow: /tmp/

Paste is for source code and general debugging text.

Login or Register to edit, delete and keep track of your pastes and more.

Raw Paste

Login or Register to edit or fork this paste. It's free.