SEO MCP server: page audits and an AI crawler checker for any page
claude mcp add --transport http crawlview https://plugins.dudelemon.cloud/crawlview/mcpRun this in your terminal. Add --scope user to use it in every project.
CrawlView is an SEO MCP server for Claude, Cursor and VS Code. Ask your assistant about any public page and CrawlView fetches it the way search engines and AI crawlers do: an indexability verdict, titles, descriptions, headings, canonical and robots signals, structured data with rich result eligibility, share previews, images, links, redirects and hreflang.
It previews the Google result in pixels and says what makes Google rewrite a title, finds the passages an AI assistant would quote for a question, checks that a page's dates agree, shows which of 18 search and AI crawlers robots.txt and the firewall let in, and crawls up to 60 pages to find broken links, duplicate titles and orphan pages by cause.
No reviews yet.
Write the first reviewNo. It reads the HTML the server returns, as most AI crawlers do. Content that only appears after scripts run in a browser is invisible to it, and usually to those crawlers too.
No. ChatGPT search uses OAI-SearchBot. GPTBot collects pages for training, so you can block it and stay in ChatGPT search.
As RFC 9309 defines it: the most specific user agent group applies, the longest matching rule wins, and allow wins a tie.
Yes. CrawlView is free and needs no account or API key.
Add https://plugins.dudelemon.cloud/crawlview/mcp to your assistant as a remote MCP server. In Claude Code: claude mcp add --transport http crawlview https://plugins.dudelemon.cloud/crawlview/mcp
Technical SEO audits in Claude Code, traced to the file and line to fix
AI SEO tool that gets your site found on Google and cited by ChatGPT
Schema markup generator and validator skill for Claude, for JSON-LD
llms.txt generator skill for Claude: a curated map of a site for AI