robots.txt file is file to tell the search engine about your website and content that you placed in website/blog(Create blog using blogspot).
Yes Google or any other search engine before visiting or in the time of visiting it will check whether robots.txt file is exist or not, if exist it will look it into the file for your content and index the content in the search engine that is the major use of robots.txt file for your blog/website.
This file is need to make your blog/website more searchable by search engines(How to make your blog searchable) .
What we need to place in this robots.txt file.?
This includes only few tags we need to give some inputs to this file like below.
User-agent: *
Disallow: /cgi-bin/
Allow: /
Sitemap:http://www.example.com//atom.xml?redirect=false&start-index=1&max-results=500
User-agent: give '*' for allowing all search engines.
Disallow : give particular engines to block or not allowed to crawl your content.
Allow: leave as it is with '/' as mentioned above.
sitemap : need to generate site map.(google it you will get more sites to generate)
For bloggers/blogger domains use the same link mentioned above link change your website name.
place this file in website main folder like www.example.com/robots.txt
This will changes traffic users of your website/blog.
related links.
How to create blog using blog spot?
How to earn money online ?
How to add video to blog ?
How to add image to blog ?
How to easily use table on blogger blog?
Yes Google or any other search engine before visiting or in the time of visiting it will check whether robots.txt file is exist or not, if exist it will look it into the file for your content and index the content in the search engine that is the major use of robots.txt file for your blog/website.
This file is need to make your blog/website more searchable by search engines(How to make your blog searchable) .
What we need to place in this robots.txt file.?
This includes only few tags we need to give some inputs to this file like below.
User-agent: *
Disallow: /cgi-bin/
Allow: /
Sitemap:http://www.example.com//atom.xml?redirect=false&start-index=1&max-results=500
User-agent: give '*' for allowing all search engines.
Disallow : give particular engines to block or not allowed to crawl your content.
Allow: leave as it is with '/' as mentioned above.
sitemap : need to generate site map.(google it you will get more sites to generate)
For bloggers/blogger domains use the same link mentioned above link change your website name.
place this file in website main folder like www.example.com/robots.txt
This will changes traffic users of your website/blog.
related links.
How to create blog using blog spot?
How to earn money online ?
How to add video to blog ?
How to add image to blog ?
How to easily use table on blogger blog?
No comments:
Post a Comment