🕷️ Adaptive web scraping skill for OpenClaw agents — bypasses anti-bot, survives site redesigns. Powered by MyClaw.ai
-
Updated
Mar 28, 2026 - Python
🕷️ Adaptive web scraping skill for OpenClaw agents — bypasses anti-bot, survives site redesigns. Powered by MyClaw.ai
This project is a UI wrapper around Scrapling by Karim Shoair (D4Vinci). Scrapling is an adaptive web scraping framework that handles everything from single requests to full-scale crawls, with built-in anti-bot bypass, smart element tracking, and proxy rotation.
A web scraping platform including Twitter, Instagram, Facebook and Youtube providing reports on sentimental Analysis for TN Election 2026
Open-source lead generation engine — scrape job boards, funding news, and freelance platforms. Configurable for any industry. FastAPI + React dashboard.
NEURO-RECON: Advanced AI-driven reconnaissance orchestrator for bug bounty hunting and security research. Features neural chat, autonomous strategy, and deep form extraction.
Scrape academic papers by DOI and convert to Markdown with images. Supports ACM, IEEE, and institutional access via cookies.
FastAPI service to scrape eBay products with built-in anti-blocking, pagination & SQLite caching
瓜子二手车(m.guazi.com)移动端爬虫,v1/v2 两版迭代,附 10 万+ 行结构化数据与反爬演进记录。Two-iteration Python scraper for guazi.com used cars with anti-bot evolution notes.
Lemon8 profiles posts scraper
Lemon8 feeds post analytics
Concurrent AI web scraping agent. Submit URLs or describe what you need; Autumn finds, scrapes, and summarizes in parallel across HTTP, stealth, and browser tiers. Self-hostable. Pydantic AI · FastAPI · Next.js 16.
🌐 Anti-blok web scraping stack: 4-tier decision tree for Cloudflare Turnstile, x.com login walls, ISP DNS poisoning. Field-tested in Indonesian internet conditions.
StealthPlex is a multi-engine stealth fetch layer for Python scraping anti-bot bypass from TLS fingerprinting to CDP browsers, with optional auto-escalation.
Scrapling MCP Server — 基于 Scrapling 开源的通用 Web 抓取 MCP 服务器。三引擎架构(get/fetch/stealthy_fetch)覆盖静态页面到 Cloudflare 保护。
Give any AI agent web browsing capability via MCP. Fetch URLs as Markdown, search the web, extract content. Works with Claude Code, Cursor, Continue.
Get stuff from websites. Even the ones that don't want you to. And also websites from before.
🔥 50K+ Stars · AI驱动的Python网页爬虫框架 · 一行代码搞定网页数据提取 · 基于Playwright · 自动反爬绕过 · 输出干净JSON/Markdown 直接喂给大模型
Remote MCP server for web scraping with anti-bot evasion. Gives Claude stealth HTTP fetching, headless browser, Cloudflare bypass, CSS extraction, and YouTube transcripts via Scrapling.
Add a description, image, and links to the scrapling topic page so that developers can more easily learn about it.
To associate your repository with the scrapling topic, visit your repo's landing page and select "manage topics."