web-scraping-automation

Here are 7 public repositories matching this topic...

krist-18 / cloudflare-web-scraper

bypass Cloudflare and scrape protected sites

captcha-bypass proxy-rotation anti-bot-evasion web-scraping-automation cloudflare-scraping javascript-execution dynamic-content-extraction cloud-data-collection data-intelligence-tools enterprise-web-scraper

Updated Nov 10, 2025
Python

lhg96 / kamco-data-collector

Star

Integrated solution for KAMCO (Korea Asset Management Corporation) public sale data collection, normalization, and RAG-based analysis - REST API delivery - Automatic data collection and normalization - RAG-based vector search - MongoDB + Qdrant

data-collection api-integration web-scraping-automation kamco-public-auction

Updated Jan 3, 2026
Python

ammieypelesydjeq / scrapercodegenerator

Star

AI scraping code generator

python scraper generator code data-extraction beautifulsoup playwright ai-scraper web-scraping-automation

Updated Dec 19, 2025

alba112 / upwork-scraper-without-stale-job-posts

Star

upwork job scraper fresh listings

upwork-scraping web-scraping-automation job-data-extraction data-collection-tool recruitment-analytics freelance-job-analysis remote-work-listings job-board-intelligence gig-economy-insights freelance-market-research

Updated Nov 10, 2025
JavaScript

Abdullah321Umar / CodeAlpha_Web-Scraping-Project1

Star

💠 FIFA Web Scraping 💠 Automated Python script to scrape FIFA World Rankings from the official FIFA website. Uses Selenium to handle dynamic pages and BeautifulSoup for parsing HTML content. Collects team names, ranks, points, and other stats automatically. Stores the data in a structured CSV file for analysis or visualization.