UZFOR
Сирожиддин
Oddiy misol
  1. Allow: /rasmlar/
  2. Disallow: /admin_panel/

bu yerda Allow - robot uchun ruxsat berilgan zona. Disallow esa ruxsat berilmagan
  1. User-agent: * / barcha botlar uchun cheklanganlardan tashqari
  2. Disallow: / bot uchun yopiq 
  3. Crawl-delay: 60 / pauklarni cheklash agar cheklanmasa saytga nagruzka tushadi
  4. Disallow: /wp-admin/ / bot uchun yopiq 
  5. Disallow: /wp-includes/ / bot uchun yopiq 
  6. Disallow: /wp-content/plugins / bot uchun yopiq 
  7. Disallow: /wp-content/cache / bot uchun yopiq 
  8. Disallow: /wp-content/themes / bot uchun yopiq 
  9.  
  10. Sitemap: http://sayt-manzili.uz/sitemap.xml / sayt xaritasi
  11.  
  12. User-agent: msnbot / msnbot uchun yopiq 
  13. Disallow: /
  14. User-agent: psbot / psbot uchun yopiq 
  15. Disallow: /
  16. User-agent: yahoo-slurp / yahoo-slurp uchun yopiq 
  17. Disallow: /
0 Mavzuga qaytish