Browse Source

Added robots.txt

Signed-off-by: Dušan Mitrović <dusan@dusanmitrovic.xyz>
master
Dušan Mitrović 1 month ago
parent
commit
a5c3f0707b
No known key found for this signature in database GPG Key ID: 54261991535AB4CB
1 changed files with 20 additions and 0 deletions
  1. +20
    -0
      robots.txt

+ 20
- 0
robots.txt View File

@@ -0,0 +1,20 @@
User-agent: SemrushBot
Disallow: /
User-agent: SemrushBot-SA
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: rogerbot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: AspiegelBot
Disallow: /
User-agent: ZoominfoBot
Disallow: /
User-agent: Yandex
Disallow: /
User-agent: MJ12bot
Disallow: /

Loading…
Cancel
Save