Crawler

Web crawler toolkit for site crawling, link extraction, content scraping, sitemap generation, rate limiting, and local data export.

by clawhub community Source: clawhub

Quality: medium Safety: community Category: Search Updated: 2026-03-15

View on ClawHub JSON API

Related Skills in Search

Doppelganger API Provider

Figranium is a self-hosted, free browser automation and scraping platform built ...

querying-indonesian-gov-data

🇮🇩 50 Indonesian Government APIs & Data Sources — BPS, OJK, BPJPH, BPOM, Bank ...

Self-hosted web search skill for AI agents (OpenClaw/Claude Code/Antigravity) vi...

Self-hosted private web search plugin for OpenClaw using SearXNG

anspire-web-search

Anspire Search API 为代理提供实时信息搜索能力。

web-search-plus

Unified search skill for Clawdbot supporting Serper (Google), Tavily (AI-optimiz...

View all Search skills