Skip to content

robots.txt is not valid#276

Description

@THEjoezack

If your robots.txt file is malformed, crawlers may not be able to understand how you want your website to be crawled or indexed.

馃懀 Steps to reproduce

Run "lighthouse" in Chrome

馃敩 Expected behavior

robots.txt should validate

馃尦 Environments

All

Metadata

Metadata

Assignees

No one assigned

    Labels

    seoSearch Engine Optimization

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions