Skip to content
MCP Directory
Back to Directory

TL;DR

TheCrawler is a Model Context Protocol (MCP) server. Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support. Install with: npx -y thecrawler. Source: https://github.com/manchittlab/TheCrawler. Compatible with MCP clients such as Claude Desktop, Cursor, Cline and Windsurf.

TheCrawler

Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

Install Command

npx -y thecrawler

GitHub Repository

0
Stars
0
Forks
0
Open Issues
View on GitHubVisit Homepage

Frequently Asked Questions

TheCrawler is a Model Context Protocol server that Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.

You can install it by running the install command: `npx -y thecrawler`. It then becomes available to any MCP-compatible client such as Claude, Cursor, Cline, Windsurf.

The TheCrawler MCP Server is compatible with any client that speaks the Model Context Protocol — including Claude, Cursor, Cline, Windsurf.

Check the project license on its repository before use.

Reviews

0 reviews·  0.0 average

No reviews yet. Be the first to share your experience.

Leave a review

Your rating

Rating

0.0 (0)
0.0 / 5.0

Promote this server

Get top placement in category & search with a Featured badge.

Get featured

Details

Agent Rank
0.0
License
Last Updated
Aug 12, 2026
Languages
TypeScript

Client Compatibility

Speaks the Model Context Protocol — works with any compatible client.

ClaudeCursorClineWindsurf