Source code for my website.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 

21 lines
338 B

  1. User-agent: SemrushBot
  2. Disallow: /
  3. User-agent: SemrushBot-SA
  4. Disallow: /
  5. User-agent: AhrefsBot
  6. Disallow: /
  7. User-agent: dotbot
  8. Disallow: /
  9. User-agent: rogerbot
  10. Disallow: /
  11. User-agent: BLEXBot
  12. Disallow: /
  13. User-agent: AspiegelBot
  14. Disallow: /
  15. User-agent: ZoominfoBot
  16. Disallow: /
  17. User-agent: Yandex
  18. Disallow: /
  19. User-agent: MJ12bot
  20. Disallow: /