Is This Robots.txt File Valid? - Webmasters - Nairaland
Nairaland Forum / Science/Technology / Webmasters / Is This Robots.txt File Valid? (415 Views)
Please Help, My Robots.txt File Is Showing Error 404 / Steps To Add Ads.txt File To Blogger For Google Adsense / Add Ads.txt File To Blogger Blogs Via Settings (2) (3) (4)
(1) (Reply)
| Is This Robots.txt File Valid? by Johnny8877: 6:08am On Nov 16, 2018 |
Hey guys, Is the below robots.txt file code generated by below tool valid https://www.crawlcenter.com/robots-txt-generator #Robots txt file data User-agent: Googlebot Disallow: /wp-admin/ Crawl-delay: 30 User-agent: Googlebot Allow: / Sitemap: http://example.com What are your thoughts? |
| Re: Is This Robots.txt File Valid? by Greeninho: 9:28am On Nov 16, 2018 |
Use Disallow: /wp-admin instead of Disallow: /wp-admin/ |
(1) (Reply)
Mconnect Ajax Product Infinite Scroll Extension For Magento 2 / Fb Accounts For Sale / 7 Ways To Make Money With Your Blog
(Go Up)
| Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health religion celebs tv-movies music-radio literature webmasters programming techmarket Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10) Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 38 |