Odel
Scrape-LE

Scrape-LE

Local
@nolindnaidoo1RustMITUpdated 1w ago

Analyse robots.txt content and report whether a path may be crawled.

View on GitHub

Runs locally over stdio

This server isn't hosted — your MCP client launches it from a package registry. Use one of the commands below, or drop the config into your client (e.g. Claude Desktop).

npmscrape-le-mcpv2.2.5

Run

npx -y scrape-le-mcp

MCP client config

{
  "mcpServers": {
    "scrape-le": {
      "command": "npx",
      "args": [
        "-y",
        "scrape-le-mcp"
      ]
    }
  }
}