FreeDNS Afraid.org Domain Scraper

This project scrapes all available domains from freedns.afraid.org that can be used for free subdomain registration.

See the available domains:

Domains Alphabetical | Domains by Length

Features

• Scrapes all ~25,000 public domains from the registry
• Handles pagination
• Extracts domain, status, owner, age, and hosts in use
• Outputs to markdown tables: alphabetical and length-sorted
• Automated via GitHub Actions every 12 hours

Requirements

• Python 3.9+
• Dependencies listed in requirements.txt

Installation

1. Clone or download this repository
2. Install dependencies:

   pip install -r requirements.txt

Usage

Run the scraper:

python scraper.py

Run the scraper with n amount of pages (each page contains approx 100 domains):

python scraper.py -p 10

The script will:

1. Scrape all pages of the domain registry
2. Extract domain information from the HTML tables
3. Save to domains-alphabetical.md and domains-length.md

Automation (GitHub Actions)

The project runs a GitHub Action automatically every 24 hours to update the list of domains.

To set it up:

1. Push this code to a GitHub repository
2. Ensure GitHub Actions is enabled
3. The workflow will run on schedule and commit updates to the markdown files

You can also trigger manually via the Actions tab.

Output

• domains-alphabetical.md: Domains sorted alphabetically
• domains-length.md: Domains sorted by length (shortest first), then alphabetically (ab.cd, then ac.cd)