If your robots.txt file is malformed, crawlers may not be able to understand how you want your website to be crawled or indexed. ## 馃懀 Steps to reproduce Run "lighthouse" in Chrome ## 馃敩 Expected behavior robots.txt should validate ## 馃尦 Environments All
If your robots.txt file is malformed, crawlers may not be able to understand how you want your website to be crawled or indexed.
馃懀 Steps to reproduce
Run "lighthouse" in Chrome
馃敩 Expected behavior
robots.txt should validate
馃尦 Environments
All