What is the recommended method for hiding CMS item pages from Google search results in Webflow? Can the NOFOLLOW meta tag be applied to all CMS pages or is a Robots.txt file the only option?
TL;DR
- Use Webflow’s robots.txt file to disallow the CMS collection path (e.g.,
/blog/) and block indexing of all CMS item pages. - Avoid using the NOFOLLOW meta tag, as it doesn’t prevent indexing and Webflow doesn’t support dynamic NOINDEX meta tags without custom code.
To hide CMS item pages from Google search results, the most effective and Webflow-supported method is via the robots.txt file, not the nofollow meta tag.
Here’s how you can do it:
1. Understand the Difference Between NOFOLLOW and NOINDEX
- NOFOLLOW tells search engines not to follow links on a page; it does not prevent a page from being indexed.
- NOINDEX prevents a page from appearing in search results.
- In Webflow, you cannot use NOINDEX dynamically on CMS template pages without custom code or API workarounds.
2. Use robots.txt to Block CMS Template URLs
- Webflow allows you to add rules to disallow specific URL patterns.
- To block CMS item pages, identify the base URL path (e.g.,
/blog/or/projects/).
Example robots.txt rule to disallow all blog posts:
User-agent: *
Disallow: /blog/- This will tell crawlers not to index any pages under
/blog/, which matches all CMS item detail pages assuming that’s the collection slug.
3. Avoid Using NOFOLLOW for This Purpose
- You cannot apply a NOFOLLOW meta tag to block indexing of CMS Collection Pages in Webflow.
- Setting nofollow on links does not prevent the target page from being crawled if other pages link to it or it's directly visited.
- Webflow does not support applying
meta name="robots"per CMS page without custom code.
4. Optional: Use Page Password or Script Workaround
- If you truly need to apply a
noindexmetatag per CMS page, you’ll need to: - Add custom code using the Embed element inside the CMS Template.
- Use a conditional to inject:
<meta name="robots" content="noindex"> - Example: Only apply on specific conditions using visibility rules (e.g., hide SEO test pages).
However, this is more advanced and not as clean as robots.txt.
Summary
To hide all CMS item pages from Google, the recommended method is to Disallow the CMS path in Webflow's robots.txt settings. The NOFOLLOW meta tag is not suitable for preventing indexing and cannot be applied sitewide to CMS pages without custom code.