You can prevent search engines from indexing pages, folders, your entire site, or just your webflow.io subdomain. This is uesful for things like 404 pages, and other not useful content.
How to prevent webflow.io subdomain from being indexed:
- Open your Site Settings
- Go to the SEO tab
- Scroll down to the Miscellaneous section
- Set Disable Subdomain Indexing to "Yes"
- Click Save Changes
- Publish your site
How to prevent your entire site, a page, or folder of pages from being indexed:
- Open your Site Settings
- Go to the SEO tab
- Scroll down to the Miscellaneous section
- Add robots.txt rules:
Entire site:
User-agent: *
Disallow: /
Individual pages:
User-agent: *
Disallow: /page-name
Entire folder of pages:
User-agent: *
Disallow: /folder-name - Click Save Changes
- Publish your site
NOTE: The User-agent: * means this section applies to all robots. The Disallow: tells the robot to not visit the site, page, or folder.
Oops! Something went wrong while submitting the form
Oops! Something went wrong while submitting the form
More articles on
SEO
Tutorials on
SEO
Words to know
No items found.