How to Add Custom Robots.txt file in Blogger

Today we're going to enable a custom Robots.Txt file in Blogger which can really help you to index your blog in Google faster and it will also make your blog more search engine friendly. Robots.txt is a text file which contains few lines of simple code. It is saved on the website or blog’s server which instruct the web crawlers to how to index and crawl your blog in the search results. That commands are written in different coding which can only be read by web crawlers. We can allow and disallow search crawlers to what area of our blog they have to crawl and what to not.In old blogger interface there is not any option to add this txt file but in Blogger's new interface we can add it easily.Always remember that search crawlers scan the robots.txt file before crawling any web page or blog.


Also Read : How to Submit Blogger Sitemap to Google Webmaster Tools

Follow this step to enable custome robots.txt file in blogger :

• Go to Blogger Dashboard → Settings → Search preferences.
• In Bottom Custom robots.txt section click on Edit.

• Now a Check box will appear ,click yes and paste the bellow code (see above image).

User-agent: Mediapartners-Google
Disallow:
User-agent: *
Disallow: /search
Allow: /
Sitemap: http://yourblogurl.blogspot.com/feeds/posts/default?orderby=UPDATED

Customize :

• Replace Red URL with your blog URL.
• Then save it.