Hi
I am getting two kind of link crawled by google on my Joomla site where K2 component is used, both links are same and because of which my content and title are duplicating, example is as below

www.vjcyber.com/blog/beaches-blog/item/14-the-pakiri-beach-auckland-new-zealand
www.vjcyber.com/component/k2/item/14-the-pakiri-beach-auckland-new-zealand

I only want the first kind which is actual link and for second i don't know where these links are coming from as in the front end only first one is appearing. I tried to remove some from google search console but these are reappearing and alot of links. Please support to tell how to make google stop for crawling the second kind of link and from where it is generated?.

Well i have found a very similar topic in this forum but i still have some confusion.

Here i found www.joomlaworks.net/forum/k2-en/49238-k2-duplicate-url

Now confusion in my mind is in the solution post robots.txt file is like below!

It is very simple. In the robots.txt write tihs:

Disallow: /component/

And if you want to properly configure robots.txt for Joomla and K2 write this:

User-agent: *
Allow: *Your sitemap URL*
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /component/k2/itemlist/tag/
Disallow: /component/
Disallow: /images/
Disallow: /component/tags*
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /tmp/
Disallow: /*%
Disallow: /?start
Disallow: /?
Disallow: /index.php?
Disallow: /*?
Disallow: /index.php*?
Disallow: /item
Disallow: /item/



In the above solution at the item mean what? as all my links have item like below link

www.vjcyber.com/blog/beaches-blog/item/14-the-pakiri-beach-auckland-new-zealand

will this link be crawled or not?

site map should be like this
Allow: www.vjcyber.com/index.php?option=com_jmap&view=sitemap&format=xml&xslt=1


????