AgenticCrawler

Verified Integration

Author: @describing•Category: ServerApplication

GitHub Repository

JSON-RPC 2.0

Protocol Standard

Sub-second

Execution Latency

Active

Operational Status

Client Configuration

— Connect AgenticCrawler to Claude Desktop or Cursor in seconds

{
  "mcpServers": {
    "agenticcrawler": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-agenticcrawler"
      ],
      "env": {}
    }
  }
}

Paste into ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows).

Architecture & Capabilities

System Overview

Autonomously crawl websites using large language models by describing goals in plain English to extract structured data.

Indexed Date

7/21/2026

License

Open Source

Protocol Layer

stdio / SSE RPC

Frequently Asked Questions

Architecture and operational details for AgenticCrawler

Instead of writing complex selectors or logic, you simply provide a natural language prompt describing what data you want. The integrated LLM agent intelligently navigates, interacts with pages, and extracts the requested information, making web scraping accessible to everyone.

Related MCP Servers

Browse all servers →

@configuring

0xArchive

Provides comprehensive historical and real-time crypto market data, including orderbooks, trades, candles, and more, from Hyperliquid, HIP-3, and Lighter.xyz.

MCP Server5 FAQs

Learn more

@spawning

0xGasless

Facilitates gasless blockchain transactions and interactions directly from Claude AI conversations.

MCP Server4 FAQs

Learn more

@spawning

0xGasless

Bridges Claude AI with blockchain networks, enabling gasless transactions, swaps, and transfers directly from natural language conversations.

MCP Server5 FAQs

Learn more