Skip to content

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 

Repository files navigation

YellowPages Australia Lead Generator Scraper

YellowPages Australia Lead Generator Scraper helps you collect rich, structured business data from YellowPages.com.au based on keywords, locations, and smart filters. It turns scattered local listings into clean, ready-to-use lead datasets. Whether you’re doing outreach, analysis, or market mapping, this YellowPages Australia scraper saves hours of manual research.

Bitbash Banner

Telegram   WhatsApp   Gmail   Website

Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for yellowpages-australia-lead-generator you've just found your team — Let’s Chat. 👆👆

Introduction

This project is a specialized web scraping tool focused on Australian business listings from YellowPages.com.au. It lets you search by keyword (e.g., “Dentist”) and location (e.g., “Cairns QLD 4870”) while applying filters such as “Open Now”, “Local Business”, or “Popular” to narrow down your results.

It solves the problem of slow, manual copy-pasting from directory websites by automatically extracting contact details, ratings, operating hours, services, and more into a structured format you can plug into CRMs, spreadsheets, or analytics pipelines. It’s ideal for marketers, sales teams, data analysts, agencies, and developers who need reliable local business data at scale.

Targeted Local Lead Mining

  • Automates searches by keyword and suburb, city, or postcode across Australia.
  • Supports sorting results by relevance or by distance from a given location.
  • Applies filters such as “Open Now”, “Local Business”, and “Popular” to refine listings.
  • Captures detailed business profiles including contact info, services, payment methods, and brands.
  • Outputs structured JSON that is easy to transform into CSV, Excel, or database records.

Features

Feature Description
Keyword & Location Search Query businesses by keyword and location (suburb, city, or postcode) to build highly targeted local lead lists.
Flexible Sorting Choose between relevance-based or distance-based sorting to prioritize the most relevant or nearest businesses.
Advanced Filters Use filters like “Open Now”, “Local Business”, and “Popular” to focus only on active and prominent listings.
Rich Business Profiles Extract names, categories, taglines, ratings, reviews, contact details, payment methods, and more.
Opening Hours & Services Capture structured opening hours plus products, services, dental concerns, and specialties where available.
Additional Contacts Collect secondary contacts such as fax numbers, extra emails, and alternate communication channels.
Business Metadata Fetch ABN, ACN, staff size, established year, alternate trading names, and other profile metadata.
Document & Media Links Store PDF brochure links and website URLs for deeper offline or follow-up analysis.
Configurable Result Limits Control maximum results per query to balance coverage, runtime, and cost.
Integration Friendly Designed to be easily integrated into existing pipelines, APIs, dashboards, or marketing workflows.

What Data This Scraper Extracts

Field Name Field Description
name Business name as displayed in the listing.
categories Primary business category or service type (e.g., Dentist).
tagline Short marketing line or highlight associated with the business.
rating Average rating score (e.g., “5.0”) if available.
review_count Number of reviews associated with the listing.
address Full street address including suburb, state, and postcode.
phone_number Main contact phone number for the business.
email Primary email address when available.
website_url Official website URL of the business.
opening_hours Structured opening hours by day, including public holiday status.
additional_contacts Dictionary of extra contact channels (e.g., fax, secondary email).
accreditations List of professional memberships, certifications, or associations.
about_us Long-form business description or “about us” content.
payment_methods List of accepted payment methods (cards, cash, EFT, etc.).
pdf_url Array of URLs to downloadable PDF brochures or documents.
business_info Object containing ABN, ACN, staff size, established year, and trade names.
business_info.ABN Australian Business Number when present.
business_info.ACN Australian Company Number when present.
business_info.Staff Approximate staff size range (e.g., “1-10”).
business_info.Established Year the business was established.
business_info.Also trades as Alternate trading names or business aliases.
products_and_services Object grouping service-related information and offerings.
products_and_services.Hours of Operation Textual hours summary such as “Open Monday - Friday”.
products_and_services.Product List of key products and physical items offered.
products_and_services.Dental Concern List of dental conditions or issues treated (for dental listings).
products_and_services.Services List of treatments, procedures, and service types provided.
products_and_services.Brand Brands, technologies, or product lines used or sold by the business.
products_and_services.Offering Health funds, technology, or facilities the practice supports.
products_and_services.Features Notable features such as emergency service, financing, or accessibility options.
products_and_services.Catering To Target clientele and specialties (e.g., adults, children, cosmetic dentistry).
products_and_services.Keywords SEO-style keywords and business-related search terms.
url Direct URL to the business listing page on YellowPages.com.au.

Example Output

[
  {
    "name": "Future Dental - Cosmetic Dentistry",
    "categories": "Dentist",
    "tagline": "Changing Lives One Smile At A Time",
    "rating": "5.0",
    "review_count": "2",
    "address": "Accent On McLeod 93-95 Mcleod St, Cairns QLD 4870",
    "phone_number": "(07) 4058 5517",
    "email": "info@futuredental.com.au",
    "website_url": "http://www.futuredental.com.au",
    "opening_hours": {
      "Mon": "7:30am - 5:00pm",
      "Tue": "7:30am - 5:00pm",
      "Wed": "7:30am - 5:00pm",
      "Thu": "7:30am - 5:00pm",
      "Fri": "7:30am - 5:00pm",
      "Sat": "Closed",
      "Sun": "Closed",
      "Public Holidays": "Closed"
    },
    "additional_contacts": {
      "Fax": "(07) 4031 5226",
      "E-mail": "japanese@futuredental.com.au"
    },
    "accreditations": [
      "Member Of AADFA",
      "Member Of ADA",
      "Member Of ADAQ"
    ],
    "about_us": "We have long been recognised as the Cairns dentists who provide an exceptional standard of personal and professional care. Our dental team have provided excellence in cosmetic and family dental care in Cairns since 1976...",
    "payment_methods": [
      "American Express",
      "Cash",
      "Cheques",
      "Diners Club",
      "Direct Debit",
      "EFT",
      "EFTPOS",
      "HICAPS",
      "Mastercard",
      "Money Order",
      "Visa"
    ],
    "pdf_url": [
      "https://s0.yellowpages.com.au/c1259470-bac9-4657-b01c-a5740247b09b/future-dental-cosmetic-dentistry-cairns-4870-document.pdf",
      "https://s0.yellowpages.com.au/0558a821-0a07-4eba-803f-cfcdeab8a74c/future-dental-cosmetic-dentistry-cairns-4870-document.pdf",
      "https://s0.yellowpages.com.au/e07f299c-417b-45e6-865c-86644eca9fb8/future-dental-cosmetic-dentistry-cairns-4870-document.pdf"
    ],
    "business_info": {
      "ABN": "73 010 552 799",
      "ACN": "010 552 799",
      "Staff": "1-10",
      "Established": "1976",
      "Also trades as": "Dental Sleep Medicine"
    },
    "products_and_services": {
      "Hours of Operation": "Open Monday - Friday",
      "Product": "Anti-snoring Devices, Bleaches, Braces, Dental Flosses, Mouthguards, Mouthwashes, Prostheses, Toothpastes",
      "Dental Concern": "Abscess, Chipped Teeth, Discoloured Teeth, Gum Diseases, Halitosis, Sleep Apnoea, TMJ Problems, Tooth Decay, Wisdom Teeth",
      "Services": "Dental Bridges, Dental Crowns, Dental Implants, Dentures, Fillings, General Anaesthetic, Laser Dentistry, Root Canal Treatments, Smile Makeovers, Teeth Cleaning, Teeth Whitening",
      "Brand": "Cerec, Colgate, Neoss, Nobel Biocare, Oral-B, Sensodyne, Straumann, Zoom",
      "Offering": "Digital X-Ray, CAD CAM Technology, CEREC 3D System, On-site Laboratory, Wheelchair Access",
      "Features": "By Appointment, Emergency Services, Family Owned, Financing, Insurance Claims, Interest Free, Senior Discounts",
      "Catering To": "Adults, Children, Cosmetic Dentistry, Family, General Dentistry, Sports Dentistry",
      "Keywords": "Dentist, Cairns Dentists, Cosmetic Dentistry, Tooth Whitening, Dental Implants, Mouth guards, Halitosis, Snoring & Sleep Apnoea"
    },
    "url": "https://www.yellowpages.com.au/qld/cairns/future-dental-cosmetic-dentistry-12764136-listing.html"
  }
]

Directory Structure Tree

YellowPages Australia Lead Generator/
    ├── src/
    │   ├── main.py
    │   ├── client/
    │   │   ├── yellowpages_client.py
    │   │   └── pagination.py
    │   ├── parsers/
    │   │   ├── listing_parser.py
    │   │   └── details_parser.py
    │   ├── pipelines/
    │   │   ├── normalizer.py
    │   │   └── exporters.py
    │   └── config/
    │       ├── settings.example.json
    │       └── logging.conf
    ├── data/
    │   ├── input.sample.json
    │   └── sample_output.json
    ├── tests/
    │   ├── test_listing_parser.py
    │   ├── test_details_parser.py
    │   └── test_end_to_end.py
    ├── Dockerfile
    ├── requirements.txt
    ├── .env.example
    └── README.md

Use Cases

  • Local marketing agencies use it to build targeted lists of businesses in specific suburbs or postcodes, so they can run highly personalized outreach campaigns that convert better.
  • B2B sales teams use it to enrich their CRM with fresh contact and profile data, so they can prioritize warm, relevant leads and reduce bounce rates.
  • Market researchers use it to analyze competition, coverage, and category presence across regions, so they can identify gaps and opportunities in local markets.
  • SEO and digital consultants use it to map local competitors and their online presence, so they can craft stronger local SEO strategies and benchmarks.
  • Data engineers and analysts use it to feed structured directory data into dashboards and BI tools, so they can monitor trends, performance, and market density over time.

FAQs

Q: Do I need technical skills to use this scraper? A: Basic familiarity with running Python projects and editing configuration files is recommended. Once configured, you can trigger runs with simple commands and process the exported JSON or CSV files with standard tools.

Q: What inputs can I configure for a run? A: Typical inputs include keyword (e.g., “Dentist”), location (suburb, city, or postcode), maximum number of items to fetch, sort order (relevance or distance), and filters like “Open Now”, “Local Business”, or “Popular”. You can also configure concurrency and timeouts in the settings.

Q: How is pagination and throttling handled? A: The client and pagination modules work together to iterate through result pages while respecting delays and concurrency limits. This helps balance performance with stability and reduces the risk of being rate-limited.

Q: In what formats can I export the scraped data? A: Data is produced internally as structured JSON. From there, the exporters module can convert it to CSV, NDJSON, or keep raw JSON files, which you can then import into spreadsheets, databases, or BI tools.


Performance Benchmarks and Results

Primary Metric: On a stable network connection, the scraper typically processes 200–400 listings per minute with moderate concurrency and full detail extraction enabled.

Reliability Metric: With sensible delay and retry settings, successful page retrieval rates of 95–98% are common across most tested YellowPages Australia categories and regions.

Efficiency Metric: A single mid-range server or laptop can comfortably handle multi-thousand listing jobs without exceeding a few hundred megabytes of RAM, even with nested data structures.

Quality Metric: For business profiles that expose complete details, data completeness for core fields (name, address, phone, rating, website) routinely exceeds 98%, with rich metadata available for many professional and medical categories.

Book a Call Watch on YouTube

Review 1

"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time."

Nathan Pennington
Marketer
★★★★★

Review 2

"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on."

Eliza
SEO Affiliate Expert
★★★★★

Review 3

"Exceptional results, clear communication, and flawless delivery.
Bitbash nailed it."

Syed
Digital Strategist
★★★★★

Releases

Packages

Contributors