Vasantharaj R N
Hi Guys , Today I’ll Show You to How To Create Best Robots.txt Settings For WordPress for Seo Optimisation 2020.Most of the People Like to do blogging and most of them wish to make their website to get more visitors.But Out of those Members , Some peoples only succeed in achieving it.Most of them To Get Visitors due to low quality content writing , No Proper Usage of keywords , Lack of Backlinks and mostly Not Properly Indexed and Crawled Their Site.lso Being A Website Beginner You Should Know How to Index Your Site Properly And Crawl It Correctly . Proper Indexation Can be Done By Using Proper Robots.txt File. Let See How To Create It .
Also Read : How To Create a Perfect Custom Robots.txt File in Blogger 2020 ?
What is Robots.txt?
Robots.txt is normal text file which contains a small codings which instructs the web search engines about how to index your website and crawl your website properly.
It can be created or written by using notepad itself.
It Doesn’t Need Any Coding Knowledge . Basic Knowledge is Enough To Manage It.
Robots.txt File has huge imact on Seo point of View.
Without the Proper Usage of this code leads to negative impacts on seo and decrease your Website Seo Ratings and Rankings Also.
How To Create Robots.txt ?
1.By Using WordPress Seo Plugins [ I Recommend Yoast Seo ]
Yoast Seo Plugin usually Creates Default Robots.txt and that is more than Enough For Any Websites.
But If you Wanted to Stop or Block any Urls from Indexing in Search Engine You Need To Change That Default Code Via Yoast Itself.
Steps For How To Create a Best Robots.txt Settings For WordPress for Seo Optimisation 2020
Step 1 : Download Yoast Seo Plugin From WordPress Plugins Market.
Step 2 : After Installing The Yoast Seo Plugin , You’ll see a Seo Settings On the Left Side Panel Click On It
Step 3 : You’ll Find Number Of Lists In That Select Tools Settings And Now Click Edit File Editor .
Step 4 : Now Copy Paste The Codes Which We Give In Our Site or Use Default Yoast Robots.txt
Here is Our Search Engine Optimised Robots.txt Code that We used given Below .This is the Default Best Robots.txt Code For every Website .
@@ Default Best Settings @@
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: https://www.example.com/sitemap.xml
@@ CODE 2 @@
User-agent: *
Disallow: /wp-content/plugins/
Disallow: /wp-admin/
User-agent: Mediapartners-Google*
Allow: /
User-agent: Googlebot-Image
Allow: /wp-content/uploads/
User-agent: Adsbot-Google
Allow: /
User-agent: Googlebot-Mobile
Allow: /
Sitemap: https://www.example.com/sitemap.xml
Important Note : In Sitemap Url , Replace ” example ” with your site name.
Step 5 : Click Save Changes . That’s All You Are Done Man
How to Check Your Robots.txt File?
https://example.com/robots.txt
Replace ” Example “ With Your Site Name
Final Step
How To Inform Google about the Updated The Robots.txt ?
You Can Inform Google About The Changes You Made in Robots.txt File because google takes time to update the robots.txt file , So You can Tell Google Quickly To Update it Via Manually Using the Below Given Url and also check it whether the changes are made or not
https://www.google.com/webmasters/tools/robots-testing-tool?
Important Note : You Must Verify Your Blog in Google Webmasters Tool in order to access the Robots Testing Tool
***
@@@ If any Problem Still Persists Leave the Comments !!! @@@
***
