вот робот который я написал пару дней назад, может в нем проблема?
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Disallow: /index.php?option=com_content&view=article&id=199
Disallow: /?*
Disallow: /search/
Disallow: /*.pdf
Disallow: /*print=1
Disallow: /*type=atom
Disallow: /*type=rss
Disallow: /*task=rss
Disallow: /*?sl*
Disallow: /*?sl*
Disallow: /index.html
Disallow: /function.require
Disallow: /forum/*
Disallow: /function.require-once
Disallow: /index.php/*
Allow: /index.php?option=com_xmap&view=xml&tmpl=component&id=2
Allow: /sitemap.html
Sitemap: http://мой сайт/index.php?option=com_xmap&view=xml&tmpl=component&id=2
User-agent: Yandex
Disallow: /administrator/
Disallow: /cache/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Disallow: /index.php?option=com_content&view=article&id=199
Disallow: /?*
Disallow: /search/
Disallow: /*.pdf
Disallow: /*print=1
Disallow: /*type=atom
Disallow: /*type=rss
Disallow: /*task=rss
Disallow: /*?sl*
Disallow: /*?sl*
Disallow: /index.html
Disallow: /function.require
Disallow: /forum/*
Disallow: /function.require-once
Disallow: /index.php/*
Allow: /index.php?option=com_xmap&view=xml&tmpl=component&id=2
Allow: /sitemap.html
Sitemap:
http://www.мой сайт/index.php?option=com_xmap&view=xml&tmpl=component&id=2
Host: www.мой сайт.net
User-agent: Googlebot
Disallow: /administrator/
Disallow: /cache/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Disallow: /?*
Disallow: /search/
Disallow: /*.pdf
Disallow: /*print=1
Disallow: /*type=atom
Disallow: /*type=rss
Disallow: /*task=rss
Disallow: /*?sl*
Disallow: /*?sl*
Disallow: /index.html
Disallow: /function.require
Disallow: /forum/*
Disallow: /function.require-once
Disallow: /index.php/*
Disallow: /index.php?option=com_content&view=article&id=199
Allow: /index.php?option=com_xmap&view=xml&tmpl=component&id=2
Allow: /sitemap.html
Sitemap:
http://www.мой сайт/index.php?option=com_xmap&view=xml&tmpl=component&id=2