AI Atlas

Version Control · Developer Tools

Crawl4ai MCP logo

Crawl4ai MCP

wyattowalsh/crawl4ai-mcp

MCP-Crawl4AI is a Model Context Protocol server that gives AI systems access to the live web. Built on FastMCP v3 and Crawl4AI, it exposes 4 tools, 2 resources, and 3 prompts through the standardized MCP interface, backed by a lifespan-managed headless Chromium browser.

View on GitHub

Install

pip install mcp-crawl4ai

Client configuration

{
  "mcpServers": {
    "crawl4ai": {
      "command": "mcp-crawl4ai",
      "args": [
        "--transport",
        "stdio"
      ]
    }
  }
}
Author
@wyattowalsh
Category
Version Control, Developer Tools
License
MIT
Updated
Oct 6, 2026

Features

  • Full MCP compliance via FastMCP v3 with tool annotations (readOnlyHint, destructiveHint, etc.)

  • 4 focused tools centered on canonical scrape/crawl plus session lifecycle/artifacts

  • 3 prompts for common LLM workflows (summarize, extract schema, compare pages)

  • 2 resources exposing server configuration and version info

  • Headless Chromium managed as a lifespan singleton (start once, reuse everywhere)

  • Multiple transports — stdio (default) and Streamable HTTP

  • LLM-optimized output — markdown, cleaned HTML, raw HTML, or plain text

  • Canonical option groups for extraction, runtime, diagnostics, sessions, rendering, and traversal

  • List and deep traversal in one crawl contract

  • Session-aware workflows with explicit session close and artifact retrieval tools

Tools (2)

  • close_session

    Close a stateful session created via options.session.session_id.

  • get_artifact

    Retrieve artifact metadata/content captured during scrape or crawl when options.conversion.capture_artifacts is enabled.

Details on this page are taken from the project's README. Open README

Supported clients

Clients mentioned in this server's README:

View all
Claude Desktop logo

Claude Desktop

Desktop · Freemium · Proprietary

Anthropic's official Claude AI desktop application. Supports MCP servers to extend functionality.

WindowsMacOS
Cursor logo

Cursor

Desktop · Freemium · Proprietary

The first agentic IDE. The Cursor editor truly merges how developers and AI work together, delivering a magical coding experience.

WindowsMacOSLinux

Related MCP servers

More servers
core logo

core

opensumi/core

3.3k

A framework helps you quickly build AI Native IDE products.

Version Control
test1 logo

test1

trpc-group/trpc-go

942

tRPC-Go, is the Go language implementation of tRPC, which is a pluggable, high-performance RPC framework.

Version Control
AI-Gateway logo

AI-Gateway

Azure-Samples/AI-Gateway

565

New! The AI Gateway Dev Portal is now live — A starting point for building your own developer portal on top of Azure API Management AI Gateway's. Fork it, open it in VS Code with GitHub Copilot (or any coding agent), and shape it to fit your needs!

Version Control
e2b logo

e2b

e2b-dev/mcp-server

233

Deprecated: This project is no longer actively maintained. It may not receive further updates or bug fixes.

Version Control
MCP Git Ingest logo

MCP Git Ingest

adhikasp/mcp-git-ingest

180

A Model Context Protocol (MCP) server that helps read GitHub repository structure and important files.

Version Control
gitlab mcp logo

gitlab mcp

zereight/gitlab-mcp

70

Documentation → Setup guides, environment variables, and the full tool reference live on the hosted docs site.

Version Control